TEST SUITE:Testsuite
Description:
Duration:4:51:17.830 (-0:19:27.549)
Status:0 critical test, 0 passed, 0 failed
603 test total (±0), 528 passed, 75 failed
Report File:report.html
Log File:log.html

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:00.0483
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0153
 Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:19.5503
 Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:06:08.5583
 Basic 07-Secure Key Management.Test SSH Accessno0:00:33.0213
 Basic 08-Disable Port Security Network Level.Instantiate Network Serviceno0:05:34.0493
 Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0021
 Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0031
 Basic 11-Native Charms.Instantiate Charm Network Serviceno0:06:09.0921
 Basic 11-Native Charms.Test SSH Accessno0:00:00.0041
 Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0063
 Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0053
 Basic 12-Ns Primitives.Instantiate NSno0:06:08.1453
 Basic 25-Update Charm In Running Vnf Instance.Check Remote File Created Via Day 2 Operationno0:00:00.0031
 Basic 25-Update Charm In Running Vnf Instance.Check Remote Files Created Via Day 1 Operationno0:00:00.0071
 Basic 25-Update Charm In Running Vnf Instance.Check Remote Folder Created Via Day 2 Operationno0:00:00.0021
 Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operationno0:00:00.0061
 Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operation on Upgraded Charmno0:00:00.0041
 Basic 25-Update Charm In Running Vnf Instance.Get Management Ip Addressno0:00:00.0021
 Basic 25-Update Charm In Running Vnf Instance.Instantiate Charm Network Serviceno0:06:14.2361
 Basic 25-Update Charm In Running Vnf Instance.Set NS Update Configno0:00:00.0041
 Basic 25-Update Charm In Running Vnf Instance.Test SSH Accessno0:00:00.0141
 Basic 25-Update Charm In Running Vnf Instance.Update Running VNF Instanceno0:00:00.0021
 Basic 29-Vnf Ipv6 Profile.Check Vnf IPsno0:00:00.0083
 Basic 29-Vnf Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0053
 Basic 29-Vnf Ipv6 Profile.Get Vnf Infono0:00:00.0113
 Basic 29-Vnf Ipv6 Profile.Instantiate Network Serviceno0:05:33.2213
 Basic 30-Ns Ipv6 Profile.Check Vnf1 IPsno0:00:00.0063
 Basic 30-Ns Ipv6 Profile.Check Vnf2 IPsno0:00:00.0053
 Basic 30-Ns Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0033
 Basic 30-Ns Ipv6 Profile.Get Vnfs Infono0:00:00.0103
 Basic 30-Ns Ipv6 Profile.Instantiate Network Serviceno0:05:32.7113
 Basic 30-Ns Ipv6 Profile.Verify Vnf1 Interfacesno0:00:00.0053
 Basic 30-Ns Ipv6 Profile.Verify Vnf2 Interfacesno0:00:00.0043
 Epa 01-Epa Sriov.Check SR-IOV Interfaceno0:00:30.0103
 Epa 01-Epa Sriov.Get VNF IP Addressno0:00:00.0053
 Epa 01-Epa Sriov.Instantiate Network Serviceno0:05:34.0563
 Hackfest Cloudinit.Check Remote File Injected Via Cloud-initno0:00:00.0103
 Hackfest Cloudinit.Get Vnf Ip Addressno0:00:00.0073
 Hackfest Cloudinit.Network Service Instance Testno0:05:02.2023
 Hackfest Cloudinit.Test SSH Accessno0:00:30.0133
 Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.0043
 Hackfest Multivdu.Network Service Instance Testno0:05:04.2543
 Hackfest Multivdu.Test Pingno0:00:30.2943
 Hackfest Multivdu.Test SSH Accessno0:00:00.0123
 Heal 02-Scale Vdu Healing.Check VNF After Healingno0:00:00.0051
 Heal 02-Scale Vdu Healing.Get Charm VNF Infono0:00:00.0061
 Heal 02-Scale Vdu Healing.Get NS Idno0:00:00.0081
 Heal 02-Scale Vdu Healing.Get VIM Objectsno0:00:00.0081
 Heal 02-Scale Vdu Healing.Halt Charm VDUno0:00:00.0041
 Heal 02-Scale Vdu Healing.Heal Charm VDUno0:00:00.0031
 Heal 02-Scale Vdu Healing.Network Service Instance Testno0:06:09.5891
 Heal 02-Scale Vdu Healing.Scale Out Charm VNFno0:00:00.0061
 Heal 02-Scale Vdu Healing.Update VIM Objectsno0:00:00.0061
 Heal 03-Multiple Healing.Check VNFs After Healingno0:00:00.0073
 Heal 03-Multiple Healing.Get Charm VNF Infono0:00:00.0053
 Heal 03-Multiple Healing.Get NS Idno0:00:00.0083
 Heal 03-Multiple Healing.Get VIM Objectsno0:00:00.0073
 Heal 03-Multiple Healing.Get Volume VNF Infono0:00:00.0073
 Heal 03-Multiple Healing.Heal VDUsno0:00:00.0063
 Heal 03-Multiple Healing.Network Service Instance Testno0:06:09.6583
 Heal 03-Multiple Healing.Scale Out Charm VNFno0:00:00.0053
 Heal 03-Multiple Healing.Stop VDUsno0:00:00.0053
 Heal 03-Multiple Healing.Update VIM Objectsno0:00:00.0073
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:00.0653
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0153
 K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:19.5003
 K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:06:12.9463
 K8S 06-K8S Secure Key Management.Test SSH Accessno0:00:33.0243
 Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metricsno0:09:00.3073
 Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Serviceno0:05:03.3683
 Slice 01-Network Slicing.Network Slice Instance Testno0:06:11.3333
 Slice 01-Network Slicing.Test Middle Ns Pingno0:01:30.1873
 Slice 01-Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0193
 Slice 01-Network Slicing.Test Slice Connectivityno0:00:00.0573

Nested Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Basic 12-Ns Primitives3 (±0)9 (±0)0:07:19.123 (+0:00:00.287)
Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:23.074 (+0:00:02.935)
Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:53.536 (+0:00:01.750)
Heal 01-Volume Vdu Healing0 (±0)16 (±0)0:07:59.754 (+0:00:03.101)
Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:48.875 (-0:00:00.245)
K8S 07-Dummy Helm0 (±0)10 (±0)0:02:46.861 (-0:00:00.372)
K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:05:01.715 (-0:00:02.568)
Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:03:03.315 (-0:00:17.404)
Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:01:47.675 (-0:00:14.888)
Basic 27-Update Helm Ee In Running Vnf Instance0 (±0)16 (±0)0:04:27.818 (-0:00:00.624)
Basic 30-Ns Ipv6 Profile7 (±0)12 (±0)0:06:36.182 (+0:00:01.135)
K8S 09-Pebble Charm K8S0 (±0)8 (±0)0:02:59.934 (+0:00:00.627)
K8S 04-Openldap Helm0 (±0)12 (±0)0:03:12.819 (-0:00:00.508)
Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.425 (-0:00:00.185)
Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:04.310 (+0:00:00.841)
Basic 20-Manual Native Charm Vdu Scaling0 (-8)18 (±0)0:09:05.889 (+0:03:15.899)
Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:11:44.574 (-0:00:25.882)
Hackfest Cloudinit4 (±0)9 (±0)0:06:32.215 (-0:00:34.209)
Basic 22-Cross Model Relations0 (±0)10 (±0)0:08:27.505 (+0:00:02.633)
Basic 14-Vnf Relations0 (±0)6 (±0)0:04:49.395 (+0:00:31.007)
Hackfest Multivdu4 (±0)9 (±0)0:06:39.026 (+0:00:07.018)
Basic 08-Disable Port Security Network Level1 (±0)9 (±0)0:07:17.772 (+0:00:00.698)
Fail 01-Insufficient Resources0 (±0)6 (±0)0:05:49.415 (+0:00:02.476)
Slice 02-Shared Network Slicing0 (-6)20 (±0)0:06:54.688 (-0:09:48.442)
Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:08:12.833 (-0:01:02.800)
Hackfest Basic0 (±0)9 (±0)0:01:46.579 (+0:00:00.257)
K8S 02-K8Scluster Creation0 (±0)4 (±0)0:01:01.399 (+0:00:00.051)
Basic 07-Secure Key Management5 (±0)12 (±0)0:07:51.855 (-0:00:18.838)
Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)15 (±0)0:14:23.345 (-0:05:02.088)
Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:54.743 (+0:00:02.192)
Heal 03-Multiple Healing10 (±0)16 (±0)0:07:20.552 (-0:00:01.901)
Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:16.310 (+0:00:00.134)
Heal 02-Scale Vdu Healing9 (+9)16 (±0)0:07:23.177 (-0:07:45.985)
Basic 29-Vnf Ipv6 Profile4 (±0)9 (±0)0:06:34.287 (+0:00:48.656)
Slice 01-Network Slicing4 (±0)13 (±0)0:09:59.124 (+0:00:00.319)
Basic 13-Ns Relations0 (±0)8 (±0)0:04:20.723 (-0:00:01.058)
Basic 26-Secure Helm Execution Environment0 (±0)11 (±0)0:03:05.851 (+0:00:37.204)
Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:12.700 (-0:00:00.952)
Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:23.479 (-0:00:00.344)
Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.542 (+0:00:00.015)
Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:21.200 (+0:00:01.997)
Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:49.130 (+0:00:00.120)
K8S 10-Sol004 Sol007 With K8S Proxy Charms0 (±0)11 (±0)0:05:14.230 (+0:00:19.353)
K8S 08-Simple K8S Scaling0 (±0)12 (±0)0:04:35.933 (-0:00:01.461)
Basic 31-Multivdu Volume Multiattach0 (±0)9 (±0)0:03:18.656 (+0:00:01.573)
K8S 05-K8S Proxy Charms0 (-6)11 (±0)0:05:28.955 (-0:02:39.479)
Epa 01-Epa Sriov3 (±0)8 (±0)0:06:46.652 (+0:00:00.597)
Basic 28-Keep Persistent Volumes0 (±0)16 (±0)0:03:42.537 (-0:00:03.112)
Heal 04-Autohealing0 (±0)14 (±0)0:06:34.274 (+0:00:14.005)
K8S 06-K8S Secure Key Management5 (±0)12 (±0)0:09:26.572 (+0:00:19.028)
Sa 08-Vnf With Vnf Indicators Snmp2 (±0)7 (±0)0:15:05.275 (+0:00:17.818)
Basic 06-Vnf With Charm0 (-7)12 (±0)0:05:09.291 (-0:01:43.406)
Basic 24-Affinity Groups0 (±0)7 (±0)0:02:00.022 (+0:00:01.955)
Basic 11-Native Charms4 (+4)9 (±0)0:07:12.458 (+0:01:27.274)
Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:18.743 (-0:00:04.208)
Basic 25-Update Charm In Running Vnf Instance10 (+10)16 (±0)0:07:04.344 (+0:02:23.626)
K8S 03-Simple K8S0 (±0)8 (±0)0:03:17.893 (-0:00:03.171)