Robot Framework Test Results

Executed:20240514 22:32:39.037
Duration:4:02:16.988 (-0:09:31.992)
Status:0 critical test, 0 passed, 0 failed
603 test total (±0), 586 passed, 17 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0021
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0031
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0041
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0031
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0041
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:05:33.6721
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0041
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0031
 Testsuite.Heal 02-Scale Vdu Healing.Check VNF After Healingno0:00:00.0051
 Testsuite.Heal 02-Scale Vdu Healing.Get Charm VNF Infono0:00:00.0041
 Testsuite.Heal 02-Scale Vdu Healing.Get NS Idno0:00:00.0021
 Testsuite.Heal 02-Scale Vdu Healing.Get VIM Objectsno0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Halt Charm VDUno0:00:00.0031
 Testsuite.Heal 02-Scale Vdu Healing.Heal Charm VDUno0:00:00.0031
 Testsuite.Heal 02-Scale Vdu Healing.Network Service Instance Testno0:06:04.6011
 Testsuite.Heal 02-Scale Vdu Healing.Scale Out Charm VNFno0:00:00.0031
 Testsuite.Heal 02-Scale Vdu Healing.Update VIM Objectsno0:00:00.0051

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite17 (+17)603 (±0)4:02:16.988 (-0:09:31.992)
Testsuite.Basic 12-Ns Primitives0 (±0)9 (±0)0:03:52.497 (+0:00:02.237)
Testsuite.Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:20.999 (+0:00:02.648)
Testsuite.Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:52.256 (+0:00:01.932)
Testsuite.Heal 01-Volume Vdu Healing0 (±0)16 (±0)0:08:15.128 (+0:00:29.183)
Testsuite.Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:47.981 (-0:00:00.780)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:45.013 (-0:00:00.908)
Testsuite.K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:04:59.157 (-0:00:02.965)
Testsuite.Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:03:00.957 (-0:00:00.678)
Testsuite.Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:01:12.457 (-0:00:33.979)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance0 (±0)16 (±0)0:04:22.582 (+0:00:00.374)
Testsuite.Basic 30-Ns Ipv6 Profile0 (±0)12 (±0)0:04:19.790 (-0:00:33.642)
Testsuite.K8S 09-Pebble Charm K8S0 (±0)8 (±0)0:03:14.762 (+0:00:14.802)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:10.829 (-0:00:00.865)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.149 (+0:00:00.305)
Testsuite.Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:04.720 (+0:00:01.844)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling8 (+8)18 (±0)0:06:56.016 (-0:02:04.168)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:12:33.627 (-0:00:25.711)
Testsuite.Hackfest Cloudinit0 (±0)9 (±0)0:02:38.208 (+0:00:00.765)
Testsuite.Basic 22-Cross Model Relations0 (±0)10 (±0)0:08:56.946 (-0:01:28.656)
Testsuite.Basic 14-Vnf Relations0 (±0)6 (±0)0:05:20.209 (+0:00:34.270)
Testsuite.Hackfest Multivdu0 (±0)9 (±0)0:02:55.474 (+0:00:00.397)
Testsuite.Basic 08-Disable Port Security Network Level0 (±0)9 (±0)0:02:39.330 (-0:00:46.853)
Testsuite.Fail 01-Insufficient Resources0 (±0)6 (±0)0:01:16.773 (+0:00:00.689)
Testsuite.Slice 02-Shared Network Slicing0 (±0)20 (±0)0:06:52.671 (+0:00:00.074)
Testsuite.Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:06:10.302 (-0:03:02.176)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:01:46.262 (+0:00:01.112)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:01:00.691 (-0:00:00.817)
Testsuite.Basic 07-Secure Key Management0 (±0)12 (±0)0:03:46.021 (-0:00:17.259)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)15 (±0)0:18:53.160 (+0:05:28.764)
Testsuite.Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:17.799 (+0:00:00.360)
Testsuite.Heal 03-Multiple Healing0 (±0)16 (±0)0:16:54.315 (+0:00:44.255)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:15.722 (+0:00:01.602)
Testsuite.Heal 02-Scale Vdu Healing9 (+9)16 (±0)0:07:32.919 (-0:08:56.940)
Testsuite.Basic 29-Vnf Ipv6 Profile0 (±0)9 (±0)0:01:51.727 (-0:00:17.327)
Testsuite.Slice 01-Network Slicing0 (±0)13 (±0)0:04:43.056 (-0:00:01.803)
Testsuite.Basic 13-Ns Relations0 (±0)8 (±0)0:05:25.135 (+0:00:34.926)
Testsuite.Basic 26-Secure Helm Execution Environment0 (±0)11 (±0)0:02:58.900 (+0:00:00.173)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.095 (+0:00:00.102)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:23.331 (+0:00:00.573)
Testsuite.Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.167 (+0:00:00.006)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:16.663 (+0:00:00.125)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:46.598 (+0:00:01.721)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms0 (±0)11 (±0)0:05:08.591 (-0:00:35.218)
Testsuite.K8S 08-Simple K8S Scaling0 (±0)12 (±0)0:04:31.436 (-0:00:01.675)
Testsuite.Basic 31-Multivdu Volume Multiattach0 (±0)9 (±0)0:03:15.822 (+0:00:00.950)
Testsuite.K8S 05-K8S Proxy Charms0 (±0)11 (±0)0:05:08.961 (+0:00:15.705)
Testsuite.Epa 01-Epa Sriov0 (±0)8 (±0)0:02:16.321 (-0:00:01.133)
Testsuite.Basic 28-Keep Persistent Volumes0 (±0)16 (±0)0:03:41.420 (+0:00:02.453)
Testsuite.Heal 04-Autohealing0 (±0)14 (±0)0:06:44.210 (-0:00:03.562)
Testsuite.K8S 06-K8S Secure Key Management0 (±0)12 (±0)0:05:09.289 (+0:00:15.651)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp0 (±0)7 (±0)0:03:16.839 (+0:00:55.405)
Testsuite.Basic 06-Vnf With Charm0 (±0)12 (±0)0:04:47.453 (-0:01:08.200)
Testsuite.Basic 24-Affinity Groups0 (±0)7 (±0)0:01:57.771 (-0:00:02.296)
Testsuite.Basic 11-Native Charms0 (±0)9 (±0)0:05:28.241 (-0:00:16.593)
Testsuite.Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:16.103 (-0:00:00.803)
Testsuite.Basic 25-Update Charm In Running Vnf Instance0 (±0)16 (±0)0:06:00.530 (+0:01:21.844)
Testsuite.K8S 03-Simple K8S0 (±0)8 (±0)0:03:31.439 (-0:00:02.238)