Robot Framework Test Results

Executed:20240511 22:48:49.938
Duration:4:16:39.109 (-0:01:39.636)
Status:0 critical test, 0 passed, 0 failed
603 test total (±0), 566 passed, 37 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0051
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0061
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0061
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0041
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0071
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:05:32.0411
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0071
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0061
 Testsuite.Heal 01-Volume Vdu Healing.Check VDU Disksno0:00:00.0141
 Testsuite.Heal 01-Volume Vdu Healing.Check VNF After Healingno0:00:00.0061
 Testsuite.Heal 01-Volume Vdu Healing.Delete Persistent Volume VDUno0:00:00.0071
 Testsuite.Heal 01-Volume Vdu Healing.Get NS Idno0:00:00.0071
 Testsuite.Heal 01-Volume Vdu Healing.Get VIM Objectsno0:00:00.0091
 Testsuite.Heal 01-Volume Vdu Healing.Get Volume VNF Infono0:00:00.0071
 Testsuite.Heal 01-Volume Vdu Healing.Get Volumes Infono0:00:01.5841
 Testsuite.Heal 01-Volume Vdu Healing.Heal Persistent Volume VDUno0:00:00.0061
 Testsuite.Heal 01-Volume Vdu Healing.Network Service Instance Testno0:06:04.9871
 Testsuite.Heal 01-Volume Vdu Healing.Update VIM Objectsno0:00:00.0051
 Testsuite.Heal 02-Scale Vdu Healing.Check VNF After Healingno0:00:00.0051
 Testsuite.Heal 02-Scale Vdu Healing.Get Charm VNF Infono0:00:00.0051
 Testsuite.Heal 02-Scale Vdu Healing.Get NS Idno0:00:00.0031
 Testsuite.Heal 02-Scale Vdu Healing.Get VIM Objectsno0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Halt Charm VDUno0:00:00.0041
 Testsuite.Heal 02-Scale Vdu Healing.Heal Charm VDUno0:00:00.0041
 Testsuite.Heal 02-Scale Vdu Healing.Network Service Instance Testno0:06:04.4791
 Testsuite.Heal 02-Scale Vdu Healing.Scale Out Charm VNFno0:00:00.0031
 Testsuite.Heal 02-Scale Vdu Healing.Update VIM Objectsno0:00:00.0061
 Testsuite.Heal 03-Multiple Healing.Check VNFs After Healingno0:00:00.0061
 Testsuite.Heal 03-Multiple Healing.Get Charm VNF Infono0:00:00.0061
 Testsuite.Heal 03-Multiple Healing.Get NS Idno0:00:00.0081
 Testsuite.Heal 03-Multiple Healing.Get VIM Objectsno0:00:00.0071
 Testsuite.Heal 03-Multiple Healing.Get Volume VNF Infono0:00:00.0051
 Testsuite.Heal 03-Multiple Healing.Heal VDUsno0:00:00.0041
 Testsuite.Heal 03-Multiple Healing.Network Service Instance Testno0:06:05.2661
 Testsuite.Heal 03-Multiple Healing.Scale Out Charm VNFno0:00:00.0061
 Testsuite.Heal 03-Multiple Healing.Stop VDUsno0:00:00.0031
 Testsuite.Heal 03-Multiple Healing.Update VIM Objectsno0:00:00.0061

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite37 (+37)603 (±0)4:16:39.109 (-0:01:39.636)
Testsuite.Basic 12-Ns Primitives0 (±0)9 (±0)0:04:25.060 (-0:00:16.473)
Testsuite.Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:19.824 (+0:00:01.045)
Testsuite.Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:50.461 (+0:00:00.913)
Testsuite.Heal 01-Volume Vdu Healing10 (+10)16 (±0)0:07:33.301 (-0:00:34.842)
Testsuite.Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:48.580 (+0:00:00.219)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:46.044 (+0:00:03.177)
Testsuite.K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:08:17.547 (+0:02:16.097)
Testsuite.Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:03:02.000 (+0:00:03.663)
Testsuite.Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:01:02.060 (+0:00:00.656)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance0 (±0)16 (±0)0:04:22.240 (+0:00:01.176)
Testsuite.Basic 30-Ns Ipv6 Profile0 (±0)12 (±0)0:04:19.904 (-0:00:32.009)
Testsuite.K8S 09-Pebble Charm K8S0 (±0)8 (±0)0:03:15.766 (+0:00:18.677)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:11.500 (+0:00:02.937)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:12.687 (-0:00:00.016)
Testsuite.Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:04.842 (+0:00:03.225)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling8 (+8)18 (±0)0:06:37.936 (-0:03:08.247)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:12:32.285 (+0:03:59.977)
Testsuite.Hackfest Cloudinit0 (±0)9 (±0)0:02:37.398 (+0:00:01.957)
Testsuite.Basic 22-Cross Model Relations0 (±0)10 (±0)0:12:13.827 (+0:00:37.021)
Testsuite.Basic 14-Vnf Relations0 (±0)6 (±0)0:10:47.022 (+0:06:02.344)
Testsuite.Hackfest Multivdu0 (±0)9 (±0)0:02:55.604 (+0:00:00.395)
Testsuite.Basic 08-Disable Port Security Network Level0 (±0)9 (±0)0:02:40.512 (-0:00:13.082)
Testsuite.Fail 01-Insufficient Resources0 (±0)6 (±0)0:01:17.079 (+0:00:02.004)
Testsuite.Slice 02-Shared Network Slicing0 (±0)20 (±0)0:07:08.563 (+0:00:18.246)
Testsuite.Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:07:10.747 (-0:01:58.117)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:02:17.937 (+0:00:34.280)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:01:01.127 (-0:00:00.162)
Testsuite.Basic 07-Secure Key Management0 (±0)12 (±0)0:05:57.788 (+0:02:12.172)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)15 (±0)0:19:22.547 (+0:01:02.709)
Testsuite.Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:50.546 (+0:00:36.119)
Testsuite.Heal 03-Multiple Healing10 (+10)16 (±0)0:07:15.492 (-0:09:23.783)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:15.677 (+0:00:01.989)
Testsuite.Heal 02-Scale Vdu Healing9 (+9)16 (±0)0:07:32.915 (-0:09:10.603)
Testsuite.Basic 29-Vnf Ipv6 Profile0 (±0)9 (±0)0:01:53.068 (-0:00:15.901)
Testsuite.Slice 01-Network Slicing0 (±0)13 (±0)0:04:45.026 (+0:00:01.956)
Testsuite.Basic 13-Ns Relations0 (±0)8 (±0)0:08:43.744 (+0:02:15.100)
Testsuite.Basic 26-Secure Helm Execution Environment0 (±0)11 (±0)0:02:58.500 (+0:00:33.867)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:12.616 (-0:00:00.347)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:23.607 (+0:00:01.007)
Testsuite.Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.531 (+0:00:00.523)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:17.266 (+0:00:01.104)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:47.632 (+0:00:34.239)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms0 (±0)11 (±0)0:04:53.627 (-0:00:43.777)
Testsuite.K8S 08-Simple K8S Scaling0 (±0)12 (±0)0:04:33.200 (-0:00:11.713)
Testsuite.Basic 31-Multivdu Volume Multiattach0 (±0)9 (±0)0:03:15.672 (+0:00:01.065)
Testsuite.K8S 05-K8S Proxy Charms0 (±0)11 (±0)0:04:51.939 (-0:00:45.974)
Testsuite.Epa 01-Epa Sriov0 (±0)8 (±0)0:02:17.763 (+0:00:01.325)
Testsuite.Basic 28-Keep Persistent Volumes0 (±0)16 (±0)0:03:41.812 (+0:00:03.435)
Testsuite.Heal 04-Autohealing0 (±0)14 (±0)0:07:50.912 (+0:01:07.086)
Testsuite.K8S 06-K8S Secure Key Management0 (±0)12 (±0)0:06:32.383 (+0:01:09.998)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp0 (±0)7 (±0)0:03:37.010 (-0:00:46.619)
Testsuite.Basic 06-Vnf With Charm0 (±0)12 (±0)0:05:05.315 (+0:00:00.949)
Testsuite.Basic 24-Affinity Groups0 (±0)7 (±0)0:01:58.456 (+0:00:02.748)
Testsuite.Basic 11-Native Charms0 (±0)9 (±0)0:08:45.633 (+0:01:58.855)
Testsuite.Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:19.081 (+0:00:03.423)
Testsuite.Basic 25-Update Charm In Running Vnf Instance0 (±0)16 (±0)0:04:27.113 (+0:00:01.574)
Testsuite.K8S 03-Simple K8S0 (±0)8 (±0)0:03:15.106 (+0:00:02.654)