Robot Framework Test Results

Executed:20240225 02:36:13.761
Duration:3:16:20.503 (-0:11:18.164)
Status:0 critical test, 0 passed, 0 failed
451 test total (±0), 403 passed, 48 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 08-Disable Port Security Network Level.Instantiate Network Serviceno0:05:01.80510
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check That Ipv6 Address_mode And Ra_mode Are Setno0:00:00.00510
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check Vnf IPsno0:00:00.00610
 Testsuite.Basic 29-Vnf Ipv6 Profile.Get Vnf Infono0:00:00.00710
 Testsuite.Basic 29-Vnf Ipv6 Profile.Instantiate Network Serviceno0:05:37.25810
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf1 IPsno0:00:00.0062
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf2 IPsno0:00:00.0062
 Testsuite.Basic 30-Ns Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0042
 Testsuite.Basic 30-Ns Ipv6 Profile.Get Vnfs Infono0:00:00.0142
 Testsuite.Basic 30-Ns Ipv6 Profile.Instantiate Network Serviceno0:05:33.6232
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf1 Interfacesno0:00:00.0042
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf2 Interfacesno0:00:00.0042
 Testsuite.Epa 01-Epa Sriov.Check SR-IOV Interfaceno0:00:30.02010
 Testsuite.Epa 01-Epa Sriov.Get VNF IP Addressno0:00:00.00710
 Testsuite.Epa 01-Epa Sriov.Instantiate Network Serviceno0:05:33.88110
 Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-initno0:00:00.01010
 Testsuite.Hackfest Cloudinit.Get Vnf Ip Addressno0:00:00.00710
 Testsuite.Hackfest Cloudinit.Network Service Instance Testno0:05:03.00510
 Testsuite.Hackfest Cloudinit.Test SSH Accessno0:00:30.01010
 Testsuite.Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.01310
 Testsuite.Hackfest Multivdu.Network Service Instance Testno0:05:34.61910
 Testsuite.Hackfest Multivdu.Test Pingno0:00:30.09410
 Testsuite.Hackfest Multivdu.Test SSH Accessno0:00:00.01410
 Testsuite.Heal 02-Scale Vdu Healing.Check VNF After Healingno0:00:00.00761
 Testsuite.Heal 02-Scale Vdu Healing.Get Manual Scale VNF Infono0:00:00.0051
 Testsuite.Heal 02-Scale Vdu Healing.Get NS Idno0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Get VIM Objectsno0:00:00.0071
 Testsuite.Heal 02-Scale Vdu Healing.Halt Manual Scale VDUno0:00:00.0031
 Testsuite.Heal 02-Scale Vdu Healing.Heal Manual Scale VDUno0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Network Service Instance Testno0:06:14.1611
 Testsuite.Heal 02-Scale Vdu Healing.Scale Out Manual Scale VNFno0:00:00.0041
 Testsuite.Heal 02-Scale Vdu Healing.Update VIM Objectsno0:00:00.0071
 Testsuite.Heal 03-Multiple Healing.Check VNFs After Healingno0:00:00.00661
 Testsuite.Heal 03-Multiple Healing.Get Manual Scale VNF Infono0:00:00.0066
 Testsuite.Heal 03-Multiple Healing.Get NS Idno0:00:00.0096
 Testsuite.Heal 03-Multiple Healing.Get VIM Objectsno0:00:00.0086
 Testsuite.Heal 03-Multiple Healing.Get Volume VNF Infono0:00:00.0056
 Testsuite.Heal 03-Multiple Healing.Heal VDUsno0:00:00.0056
 Testsuite.Heal 03-Multiple Healing.Network Service Instance Testno0:06:13.7746
 Testsuite.Heal 03-Multiple Healing.Scale Out Manual Scale VNFno0:00:00.0076
 Testsuite.Heal 03-Multiple Healing.Stop VDUsno0:00:00.0056
 Testsuite.Heal 03-Multiple Healing.Update VIM Objectsno0:00:00.0066
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metricsno0:09:00.2979
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Serviceno0:05:02.1699
 Testsuite.Slice 01-Network Slicing.Network Slice Instance Testno0:06:11.5077
 Testsuite.Slice 01-Network Slicing.Test Middle Ns Pingno0:01:30.1867
 Testsuite.Slice 01-Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0227
 Testsuite.Slice 01-Network Slicing.Test Slice Connectivityno0:00:00.0587

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite48 (+2)451 (±0)3:16:20.503 (-0:11:18.164)
Testsuite.Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:22.934 (-0:00:02.385)
Testsuite.Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:02:09.815 (+0:00:14.041)
Testsuite.K8S 13-Two Helm Kdu0 (±0)18 (±0)0:04:59.256 (-0:00:03.452)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)15 (±0)0:14:24.286 (-0:03:59.592)
Testsuite.Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:55.598 (+0:00:02.248)
Testsuite.Heal 01-Volume Vdu Healing0 (±0)16 (±0)0:04:48.343 (-0:00:05.937)
Testsuite.Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:49.899 (-0:00:00.583)
Testsuite.Heal 03-Multiple Healing10 (±0)16 (±0)0:07:22.395 (-0:00:01.583)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:46.473 (+0:00:00.132)
Testsuite.Sol003 02-Dualstack Ip Vnfm0 (±0)9 (±0)0:01:06.275 (-0:00:01.531)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:17.627 (-0:00:02.082)
Testsuite.Heal 02-Scale Vdu Healing9 (+8)16 (±0)0:07:27.735 (+0:02:27.780)
Testsuite.Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:02:53.749 (+0:00:00.596)
Testsuite.Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:00:54.079 (-0:00:00.033)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance0 (±0)16 (±0)0:04:20.079 (-0:00:04.781)
Testsuite.Basic 29-Vnf Ipv6 Profile4 (±0)9 (±0)0:06:37.917 (+0:00:15.270)
Testsuite.Basic 30-Ns Ipv6 Profile7 (±0)12 (±0)0:07:11.323 (+0:00:11.918)
Testsuite.Slice 01-Network Slicing4 (±0)13 (±0)0:09:59.328 (-0:00:01.897)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.678 (+0:00:00.187)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:14.204 (-0:00:00.263)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:24.128 (-0:00:00.128)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.579 (+0:00:00.064)
Testsuite.Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:06.869 (+0:00:00.450)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:12:35.720 (-0:00:17.417)
Testsuite.Hackfest Cloudinit4 (±0)9 (±0)0:06:51.708 (-0:00:01.048)
Testsuite.Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:09.294 (-0:00:00.258)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:19.034 (-0:00:03.071)
Testsuite.Hackfest Multivdu4 (±0)9 (±0)0:07:06.509 (+0:00:08.414)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:15.709 (-0:00:36.163)
Testsuite.Basic 31-Multivdu Volume Multiattach0 (±0)9 (±0)0:03:19.251 (+0:00:01.108)
Testsuite.Lcmop 01-Cancel Operation Basic0 (±0)9 (±0)0:00:47.397 (-0:00:03.180)
Testsuite.Basic 08-Disable Port Security Network Level1 (±0)9 (±0)0:07:41.140 (-0:00:00.372)
Testsuite.Fail 01-Insufficient Resources0 (±0)6 (±0)0:05:48.190 (-0:00:04.044)
Testsuite.Epa 01-Epa Sriov3 (±0)8 (±0)0:06:45.788 (+0:00:09.577)
Testsuite.Basic 28-Keep Persistent Volumes0 (±0)16 (±0)0:03:45.647 (-0:00:01.152)
Testsuite.Slice 02-Shared Network Slicing0 (-6)20 (±0)0:06:53.494 (-0:10:19.662)
Testsuite.Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:07:11.961 (-0:00:02.895)
Testsuite.Heal 04-Autohealing0 (±0)14 (±0)0:08:10.113 (+0:01:01.541)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp2 (±0)7 (±0)0:14:48.431 (-0:00:00.191)
Testsuite.Basic 24-Affinity Groups0 (±0)7 (±0)0:02:01.246 (-0:00:01.752)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:01:47.663 (+0:00:01.064)
Testsuite.Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:22.400 (+0:00:03.001)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:01:00.054 (-0:00:00.077)