Robot Framework Test Results

Executed:20240218 23:34:54.432
Duration:5:06:26.849 (+0:15:09.019)
Status:0 critical test, 0 passed, 0 failed
603 test total (±0), 516 passed, 87 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 08-Disable Port Security Network Level.Instantiate Network Serviceno0:05:33.9464
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0032
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0022
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:06:09.3492
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.0042
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0034
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0034
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:06:06.7074
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0051
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0041
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0061
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0031
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0031
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:05:33.0941
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0071
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0031
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check Vnf IPsno0:00:00.0044
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0044
 Testsuite.Basic 29-Vnf Ipv6 Profile.Get Vnf Infono0:00:00.0064
 Testsuite.Basic 29-Vnf Ipv6 Profile.Instantiate Network Serviceno0:05:04.3034
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf1 IPsno0:00:00.0044
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf2 IPsno0:00:00.0044
 Testsuite.Basic 30-Ns Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0044
 Testsuite.Basic 30-Ns Ipv6 Profile.Get Vnfs Infono0:00:00.0054
 Testsuite.Basic 30-Ns Ipv6 Profile.Instantiate Network Serviceno0:05:01.8854
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf1 Interfacesno0:00:00.0054
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf2 Interfacesno0:00:00.0044
 Testsuite.Epa 01-Epa Sriov.Check SR-IOV Interfaceno0:00:30.0234
 Testsuite.Epa 01-Epa Sriov.Get VNF IP Addressno0:00:00.0084
 Testsuite.Epa 01-Epa Sriov.Instantiate Network Serviceno0:05:01.9924
 Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-initno0:00:00.0114
 Testsuite.Hackfest Cloudinit.Get Vnf Ip Addressno0:00:00.0024
 Testsuite.Hackfest Cloudinit.Network Service Instance Testno0:05:02.3094
 Testsuite.Hackfest Cloudinit.Test SSH Accessno0:00:30.0144
 Testsuite.Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.0054
 Testsuite.Hackfest Multivdu.Network Service Instance Testno0:05:02.0924
 Testsuite.Hackfest Multivdu.Test Pingno0:00:30.0904
 Testsuite.Hackfest Multivdu.Test SSH Accessno0:00:00.0114
 Testsuite.Heal 01-Volume Vdu Healing.Check VDU Disksno0:00:00.0081
 Testsuite.Heal 01-Volume Vdu Healing.Check VNF After Healingno0:00:00.0061
 Testsuite.Heal 01-Volume Vdu Healing.Delete Persistent Volume VDUno0:00:00.0051
 Testsuite.Heal 01-Volume Vdu Healing.Get NS Idno0:00:00.0101
 Testsuite.Heal 01-Volume Vdu Healing.Get VIM Objectsno0:00:00.0091
 Testsuite.Heal 01-Volume Vdu Healing.Get Volume VNF Infono0:00:00.0061
 Testsuite.Heal 01-Volume Vdu Healing.Get Volumes Infono0:00:01.6361
 Testsuite.Heal 01-Volume Vdu Healing.Heal Persistent Volume VDUno0:00:00.0041
 Testsuite.Heal 01-Volume Vdu Healing.Network Service Instance Testno0:06:08.6591
 Testsuite.Heal 01-Volume Vdu Healing.Update VIM Objectsno0:00:00.0061
 Testsuite.Heal 03-Multiple Healing.Check VNFs After Healingno0:00:00.0064
 Testsuite.Heal 03-Multiple Healing.Get Charm VNF Infono0:00:00.0054
 Testsuite.Heal 03-Multiple Healing.Get NS Idno0:00:00.0054
 Testsuite.Heal 03-Multiple Healing.Get VIM Objectsno0:00:00.0074
 Testsuite.Heal 03-Multiple Healing.Get Volume VNF Infono0:00:00.0054
 Testsuite.Heal 03-Multiple Healing.Heal VDUsno0:00:00.0044
 Testsuite.Heal 03-Multiple Healing.Network Service Instance Testno0:06:10.0984
 Testsuite.Heal 03-Multiple Healing.Scale Out Charm VNFno0:00:00.0044
 Testsuite.Heal 03-Multiple Healing.Stop VDUsno0:00:00.0054
 Testsuite.Heal 03-Multiple Healing.Update VIM Objectsno0:00:00.0054
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0031
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0031
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0051
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0061
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:06:10.1611
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0081
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:00.0514
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0174
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:19.4284
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:06:12.5144
 Testsuite.K8S 06-K8S Secure Key Management.Test SSH Accessno0:00:33.0204
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0031
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0031
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0051
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0051
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:06:11.4481
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.0061
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metricsno0:09:00.3074
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Serviceno0:05:03.7774
 Testsuite.Slice 01-Network Slicing.Network Slice Instance Testno0:06:11.1124
 Testsuite.Slice 01-Network Slicing.Test Middle Ns Pingno0:01:30.1954
 Testsuite.Slice 01-Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0214
 Testsuite.Slice 01-Network Slicing.Test Slice Connectivityno0:00:00.0514
 Testsuite.Slice 02-Shared Network Slicing.Network Slice First Instanceno0:06:11.8491
 Testsuite.Slice 02-Shared Network Slicing.Network Slice Second Instanceno0:05:41.2331
 Testsuite.Slice 02-Shared Network Slicing.Test First Slice Connectivityno0:00:00.0611
 Testsuite.Slice 02-Shared Network Slicing.Test Middle Ns Pingno0:01:30.1961
 Testsuite.Slice 02-Shared Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0191
 Testsuite.Slice 02-Shared Network Slicing.Test Second Slice Connectivityno0:00:03.0111

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite87 (+12)603 (±0)5:06:26.849 (+0:15:09.019)
Testsuite.Basic 12-Ns Primitives3 (±0)9 (±0)0:07:18.206 (-0:00:00.917)
Testsuite.Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:20.249 (-0:00:02.825)
Testsuite.Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:52.984 (-0:00:00.552)
Testsuite.Heal 01-Volume Vdu Healing10 (+10)16 (±0)0:07:19.258 (-0:00:40.496)
Testsuite.Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:49.523 (+0:00:00.648)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:46.795 (-0:00:00.066)
Testsuite.K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:05:02.637 (+0:00:00.922)
Testsuite.Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:02:48.434 (-0:00:14.881)
Testsuite.Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:01:02.326 (-0:00:45.349)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance0 (±0)16 (±0)0:04:23.546 (-0:00:04.272)
Testsuite.Basic 30-Ns Ipv6 Profile7 (±0)12 (±0)0:06:03.261 (-0:00:32.921)
Testsuite.K8S 09-Pebble Charm K8S0 (±0)8 (±0)0:03:00.120 (+0:00:00.186)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:13.038 (+0:00:00.219)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:12.755 (-0:00:00.670)
Testsuite.Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:03.565 (-0:00:00.745)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling8 (+8)18 (±0)0:06:20.297 (-0:02:45.592)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:11:55.397 (+0:00:10.823)
Testsuite.Hackfest Cloudinit4 (±0)9 (±0)0:06:32.157 (-0:00:00.058)
Testsuite.Basic 22-Cross Model Relations0 (±0)10 (±0)0:08:58.828 (+0:00:31.323)
Testsuite.Basic 14-Vnf Relations0 (±0)6 (±0)0:04:49.176 (-0:00:00.219)
Testsuite.Hackfest Multivdu4 (±0)9 (±0)0:06:31.907 (-0:00:07.119)
Testsuite.Basic 08-Disable Port Security Network Level1 (±0)9 (±0)0:07:45.424 (+0:00:27.652)
Testsuite.Fail 01-Insufficient Resources0 (±0)6 (±0)0:05:44.960 (-0:00:04.455)
Testsuite.Slice 02-Shared Network Slicing6 (+6)20 (±0)0:16:58.569 (+0:10:03.881)
Testsuite.Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:09:12.154 (+0:00:59.321)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:01:46.296 (-0:00:00.283)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:01:01.528 (+0:00:00.129)
Testsuite.Basic 07-Secure Key Management0 (-5)12 (±0)0:03:49.614 (-0:04:02.241)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)15 (±0)0:19:23.734 (+0:05:00.389)
Testsuite.Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:50.215 (-0:00:04.528)
Testsuite.Heal 03-Multiple Healing10 (±0)16 (±0)0:07:21.348 (+0:00:00.796)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:16.873 (+0:00:00.563)
Testsuite.Heal 02-Scale Vdu Healing0 (-9)16 (±0)0:15:15.608 (+0:07:52.431)
Testsuite.Basic 29-Vnf Ipv6 Profile4 (±0)9 (±0)0:05:50.516 (-0:00:43.771)
Testsuite.Slice 01-Network Slicing4 (±0)13 (±0)0:09:59.139 (+0:00:00.015)
Testsuite.Basic 13-Ns Relations0 (±0)8 (±0)0:04:20.373 (-0:00:00.350)
Testsuite.Basic 26-Secure Helm Execution Environment0 (±0)11 (±0)0:02:27.966 (-0:00:37.885)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:12.532 (-0:00:00.168)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:23.916 (+0:00:00.437)
Testsuite.Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.574 (+0:00:00.032)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:19.157 (-0:00:02.043)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:49.047 (-0:00:00.083)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms6 (+6)11 (±0)0:08:07.228 (+0:02:52.998)
Testsuite.K8S 08-Simple K8S Scaling0 (±0)12 (±0)0:04:37.642 (+0:00:01.709)
Testsuite.Basic 31-Multivdu Volume Multiattach0 (±0)9 (±0)0:03:16.900 (-0:00:01.756)
Testsuite.K8S 05-K8S Proxy Charms6 (+6)11 (±0)0:08:05.399 (+0:02:36.444)
Testsuite.Epa 01-Epa Sriov3 (±0)8 (±0)0:06:14.523 (-0:00:32.129)
Testsuite.Basic 28-Keep Persistent Volumes0 (±0)16 (±0)0:03:11.133 (-0:00:31.404)
Testsuite.Heal 04-Autohealing0 (±0)14 (±0)0:06:35.253 (+0:00:00.979)
Testsuite.K8S 06-K8S Secure Key Management5 (±0)12 (±0)0:09:07.890 (-0:00:18.682)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp2 (±0)7 (±0)0:14:47.350 (-0:00:17.925)
Testsuite.Basic 06-Vnf With Charm0 (±0)12 (±0)0:05:09.033 (-0:00:00.258)
Testsuite.Basic 24-Affinity Groups0 (±0)7 (±0)0:01:59.093 (-0:00:00.929)
Testsuite.Basic 11-Native Charms4 (±0)9 (±0)0:06:52.089 (-0:00:20.369)
Testsuite.Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:17.791 (-0:00:00.952)
Testsuite.Basic 25-Update Charm In Running Vnf Instance0 (-10)16 (±0)0:04:28.929 (-0:02:35.415)
Testsuite.K8S 03-Simple K8S0 (±0)8 (±0)0:03:17.330 (-0:00:00.563)