TEST SUITE:Testsuite
Description:
Duration:4:12:34.805 (-0:12:56.077)
Status:0 critical test, 0 passed, 0 failed
530 test total (±0), 436 passed, 94 failed
Report File:report.html
Log File:log.html

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:00.0433
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0253
 Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:19.7053
 Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:06:09.1523
 Basic 07-Secure Key Management.Test SSH Accessno0:00:33.0283
 Basic 08-Disable Port Security Network Level.Instantiate Network Serviceno0:05:02.3333
 Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0053
 Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0113
 Basic 11-Native Charms.Instantiate Charm Network Serviceno0:06:12.7173
 Basic 11-Native Charms.Test SSH Accessno0:00:00.0153
 Basic 12-Ns Primitives.Instantiate NSno0:06:16.7423
 Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0071
 Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0051
 Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0051
 Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0041
 Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0071
 Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:05:32.9131
 Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0061
 Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0061
 Basic 25-Update Charm In Running Vnf Instance.Check Remote File Created Via Day 2 Operationno0:00:00.0022
 Basic 25-Update Charm In Running Vnf Instance.Check Remote Files Created Via Day 1 Operationno0:00:00.0032
 Basic 25-Update Charm In Running Vnf Instance.Check Remote Folder Created Via Day 2 Operationno0:00:00.0032
 Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operationno0:00:00.0052
 Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operation on Upgraded Charmno0:00:00.0072
 Basic 25-Update Charm In Running Vnf Instance.Get Management Ip Addressno0:00:00.0022
 Basic 25-Update Charm In Running Vnf Instance.Instantiate Charm Network Serviceno0:06:08.0762
 Basic 25-Update Charm In Running Vnf Instance.Set NS Update Configno0:00:00.0052
 Basic 25-Update Charm In Running Vnf Instance.Test SSH Accessno0:00:00.0052
 Basic 25-Update Charm In Running Vnf Instance.Update Running VNF Instanceno0:00:00.0072
 Epa 01-Epa Sriov.Check SR-IOV Interfaceno0:00:30.0213
 Epa 01-Epa Sriov.Get VNF IP Addressno0:00:00.0083
 Epa 01-Epa Sriov.Instantiate Network Serviceno0:05:34.3653
 Hackfest Cloudinit.Check Remote File Injected Via Cloud-initno0:00:00.0073
 Hackfest Cloudinit.Get Vnf Ip Addressno0:00:00.0043
 Hackfest Cloudinit.Network Service Instance Testno0:05:01.8173
 Hackfest Cloudinit.Test SSH Accessno0:00:30.0083
 Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.0073
 Hackfest Multivdu.Network Service Instance Testno0:05:01.8593
 Hackfest Multivdu.Test Pingno0:00:30.1633
 Hackfest Multivdu.Test SSH Accessno0:00:00.0163
 Heal 01-Volume Vdu Healing.Check VDU Disksno0:00:00.0073
 Heal 01-Volume Vdu Healing.Check VNF After Healingno0:00:00.0093
 Heal 01-Volume Vdu Healing.Delete Persistent Volume VDUno0:00:00.0063
 Heal 01-Volume Vdu Healing.Get NS Idno0:00:00.0053
 Heal 01-Volume Vdu Healing.Get VIM Objectsno0:00:00.0063
 Heal 01-Volume Vdu Healing.Get Volume VNF Infono0:00:00.0053
 Heal 01-Volume Vdu Healing.Get Volumes Infono0:00:01.6593
 Heal 01-Volume Vdu Healing.Heal Persistent Volume VDUno0:00:00.0053
 Heal 01-Volume Vdu Healing.Network Service Instance Testno0:05:02.7393
 Heal 01-Volume Vdu Healing.Update VIM Objectsno0:00:00.0083
 Heal 02-Scale Vdu Healing.Check VNF After Healingno0:00:00.0073
 Heal 02-Scale Vdu Healing.Get Charm VNF Infono0:00:00.0053
 Heal 02-Scale Vdu Healing.Get NS Idno0:00:00.0063
 Heal 02-Scale Vdu Healing.Get VIM Objectsno0:00:00.0073
 Heal 02-Scale Vdu Healing.Halt Charm VDUno0:00:00.0043
 Heal 02-Scale Vdu Healing.Heal Charm VDUno0:00:00.0043
 Heal 02-Scale Vdu Healing.Network Service Instance Testno0:05:02.6913
 Heal 02-Scale Vdu Healing.Scale Out Charm VNFno0:00:00.0063
 Heal 02-Scale Vdu Healing.Update VIM Objectsno0:00:00.0063
 Heal 03-Multiple Healing.Check VNFs After Healingno0:00:00.0072
 Heal 03-Multiple Healing.Get Charm VNF Infono0:00:00.0062
 Heal 03-Multiple Healing.Get NS Idno0:00:00.0062
 Heal 03-Multiple Healing.Get VIM Objectsno0:00:00.0072
 Heal 03-Multiple Healing.Get Volume VNF Infono0:00:00.0052
 Heal 03-Multiple Healing.Heal VDUsno0:00:00.0062
 Heal 03-Multiple Healing.Network Service Instance Testno0:05:33.0372
 Heal 03-Multiple Healing.Scale Out Charm VNFno0:00:00.0062
 Heal 03-Multiple Healing.Stop VDUsno0:00:00.0042
 Heal 03-Multiple Healing.Update VIM Objectsno0:00:00.0062
 K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0033
 K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0033
 K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0053
 K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0043
 K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:06:12.4963
 K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0053
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:03.0182
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0172
 K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:19.7182
 K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:06:10.5122
 K8S 06-K8S Secure Key Management.Test SSH Accessno0:00:33.0262
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0031
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0031
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0041
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0071
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:06:10.4611
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.0061
 Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metricsno0:09:00.3373
 Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Serviceno0:05:34.3233
 Slice 02-Shared Network Slicing.Network Slice First Instanceno0:06:11.7062
 Slice 02-Shared Network Slicing.Network Slice Second Instanceno0:01:06.3202
 Slice 02-Shared Network Slicing.Test First Slice Connectivityno0:00:00.0512
 Slice 02-Shared Network Slicing.Test Middle Ns Pingno0:01:30.2212
 Slice 02-Shared Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0172
 Slice 02-Shared Network Slicing.Test Second Slice Connectivityno0:00:03.0282

Nested Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Basic 12-Ns Primitives1 (±0)7 (±0)0:07:32.672 (+0:00:06.939)
Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:20.743 (+0:00:00.017)
Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:52.906 (-0:00:00.321)
Heal 01-Volume Vdu Healing10 (±0)16 (±0)0:06:15.593 (-0:00:30.419)
Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:49.982 (+0:00:00.066)
K8S 07-Dummy Helm0 (±0)10 (±0)0:02:50.008 (+0:00:02.626)
K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:05:03.777 (+0:00:00.017)
Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:03:20.005 (-0:00:00.707)
Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:01:17.711 (+0:00:05.302)
K8S 09-Pebble Charm K8S0 (±0)10 (±0)0:04:46.043 (+0:00:01.131)
K8S 04-Openldap Helm0 (±0)14 (±0)0:04:12.359 (+0:00:02.267)
Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:12.867 (-0:00:00.060)
Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:04.422 (+0:00:00.628)
Basic 20-Manual Native Charm Vdu Scaling8 (+8)18 (±0)0:06:20.707 (-0:02:31.016)
Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:07:09.045 (+0:00:55.746)
Hackfest Cloudinit4 (±0)9 (±0)0:06:32.086 (-0:00:31.030)
Basic 22-Cross Model Relations0 (±0)10 (±0)0:08:27.290 (+0:00:02.008)
Basic 14-Vnf Relations0 (±0)6 (±0)0:04:48.960 (+0:00:00.794)
Hackfest Multivdu4 (±0)9 (±0)0:06:56.958 (+0:00:23.006)
Basic 08-Disable Port Security Network Level1 (±0)9 (±0)0:06:30.100 (-0:00:46.456)
Fail 01-Insufficient Resources0 (±0)6 (±0)0:05:46.686 (-0:00:00.275)
Slice 02-Shared Network Slicing6 (±0)20 (±0)0:12:10.212 (-0:05:20.346)
Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:05:12.069 (+0:00:00.990)
Hackfest Basic0 (±0)9 (±0)0:01:46.642 (-0:00:00.384)
K8S 02-K8Scluster Creation0 (±0)2 (±0)0:00:55.706 (+0:00:00.105)
Basic 07-Secure Key Management5 (±0)12 (±0)0:08:11.435 (+0:00:17.373)
Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)13 (±0)0:08:20.902 (+0:00:00.130)
Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:51.172 (-0:00:00.920)
Heal 03-Multiple Healing10 (±0)16 (±0)0:06:43.652 (+0:00:30.755)
Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:17.485 (-0:00:00.967)
Heal 02-Scale Vdu Healing9 (±0)15 (±0)0:06:12.299 (-0:00:31.293)
Slice 01-Network Slicing0 (-4)13 (±0)0:04:46.349 (-0:05:14.308)
Basic 13-Ns Relations0 (±0)8 (±0)0:04:57.054 (+0:00:02.488)
Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.093 (-0:00:01.020)
Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:22.778 (+0:00:00.049)
Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.616 (+0:00:00.018)
Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:18.789 (-0:00:00.631)
Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:48.879 (-0:00:00.352)
K8S 10-Sol004 Sol007 With K8S Proxy Charms6 (+6)11 (±0)0:08:06.834 (+0:02:38.080)
K8S 08-Simple K8S Scaling0 (±0)14 (±0)0:06:03.418 (-0:00:02.332)
K8S 05-K8S Proxy Charms6 (±0)11 (±0)0:08:08.378 (+0:00:02.184)
Epa 01-Epa Sriov3 (±0)8 (±0)0:06:46.206 (-0:00:02.014)
Heal 04-Autohealing0 (±0)14 (±0)0:05:02.173 (-0:00:16.204)
K8S 06-K8S Secure Key Management5 (±0)12 (±0)0:09:10.675 (+0:00:04.924)
Sa 08-Vnf With Vnf Indicators Snmp2 (±0)7 (±0)0:15:19.139 (-0:00:16.076)
Basic 06-Vnf With Charm0 (-6)11 (±0)0:04:46.860 (-0:02:03.435)
Basic 24-Affinity Groups0 (±0)7 (±0)0:02:00.343 (-0:00:00.147)
Basic 11-Native Charms4 (±0)9 (±0)0:06:58.541 (+0:00:01.403)
Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:19.343 (+0:00:00.537)
Basic 25-Update Charm In Running Vnf Instance10 (±0)16 (±0)0:06:55.323 (-0:00:01.942)
K8S 03-Simple K8S0 (±0)10 (±0)0:04:32.292 (-0:00:02.994)