Robot Framework Test Results

Executed:20240217 23:40:06.118
Duration:4:51:17.830 (-0:19:27.549)
Status:0 critical test, 0 passed, 0 failed
603 test total (±0), 528 passed, 75 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:00.0483
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0153
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:19.5503
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:06:08.5583
 Testsuite.Basic 07-Secure Key Management.Test SSH Accessno0:00:33.0213
 Testsuite.Basic 08-Disable Port Security Network Level.Instantiate Network Serviceno0:05:34.0493
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0021
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0031
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:06:09.0921
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.0041
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0063
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0053
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:06:08.1453
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Check Remote File Created Via Day 2 Operationno0:00:00.0031
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Check Remote Files Created Via Day 1 Operationno0:00:00.0071
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Check Remote Folder Created Via Day 2 Operationno0:00:00.0021
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operationno0:00:00.0061
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operation on Upgraded Charmno0:00:00.0041
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Get Management Ip Addressno0:00:00.0021
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Instantiate Charm Network Serviceno0:06:14.2361
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Set NS Update Configno0:00:00.0041
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Test SSH Accessno0:00:00.0141
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Update Running VNF Instanceno0:00:00.0021
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check Vnf IPsno0:00:00.0083
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0053
 Testsuite.Basic 29-Vnf Ipv6 Profile.Get Vnf Infono0:00:00.0113
 Testsuite.Basic 29-Vnf Ipv6 Profile.Instantiate Network Serviceno0:05:33.2213
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf1 IPsno0:00:00.0063
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf2 IPsno0:00:00.0053
 Testsuite.Basic 30-Ns Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0033
 Testsuite.Basic 30-Ns Ipv6 Profile.Get Vnfs Infono0:00:00.0103
 Testsuite.Basic 30-Ns Ipv6 Profile.Instantiate Network Serviceno0:05:32.7113
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf1 Interfacesno0:00:00.0053
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf2 Interfacesno0:00:00.0043
 Testsuite.Epa 01-Epa Sriov.Check SR-IOV Interfaceno0:00:30.0103
 Testsuite.Epa 01-Epa Sriov.Get VNF IP Addressno0:00:00.0053
 Testsuite.Epa 01-Epa Sriov.Instantiate Network Serviceno0:05:34.0563
 Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-initno0:00:00.0103
 Testsuite.Hackfest Cloudinit.Get Vnf Ip Addressno0:00:00.0073
 Testsuite.Hackfest Cloudinit.Network Service Instance Testno0:05:02.2023
 Testsuite.Hackfest Cloudinit.Test SSH Accessno0:00:30.0133
 Testsuite.Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.0043
 Testsuite.Hackfest Multivdu.Network Service Instance Testno0:05:04.2543
 Testsuite.Hackfest Multivdu.Test Pingno0:00:30.2943
 Testsuite.Hackfest Multivdu.Test SSH Accessno0:00:00.0123
 Testsuite.Heal 02-Scale Vdu Healing.Check VNF After Healingno0:00:00.0051
 Testsuite.Heal 02-Scale Vdu Healing.Get Charm VNF Infono0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Get NS Idno0:00:00.0081
 Testsuite.Heal 02-Scale Vdu Healing.Get VIM Objectsno0:00:00.0081
 Testsuite.Heal 02-Scale Vdu Healing.Halt Charm VDUno0:00:00.0041
 Testsuite.Heal 02-Scale Vdu Healing.Heal Charm VDUno0:00:00.0031
 Testsuite.Heal 02-Scale Vdu Healing.Network Service Instance Testno0:06:09.5891
 Testsuite.Heal 02-Scale Vdu Healing.Scale Out Charm VNFno0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Update VIM Objectsno0:00:00.0061
 Testsuite.Heal 03-Multiple Healing.Check VNFs After Healingno0:00:00.0073
 Testsuite.Heal 03-Multiple Healing.Get Charm VNF Infono0:00:00.0053
 Testsuite.Heal 03-Multiple Healing.Get NS Idno0:00:00.0083
 Testsuite.Heal 03-Multiple Healing.Get VIM Objectsno0:00:00.0073
 Testsuite.Heal 03-Multiple Healing.Get Volume VNF Infono0:00:00.0073
 Testsuite.Heal 03-Multiple Healing.Heal VDUsno0:00:00.0063
 Testsuite.Heal 03-Multiple Healing.Network Service Instance Testno0:06:09.6583
 Testsuite.Heal 03-Multiple Healing.Scale Out Charm VNFno0:00:00.0053
 Testsuite.Heal 03-Multiple Healing.Stop VDUsno0:00:00.0053
 Testsuite.Heal 03-Multiple Healing.Update VIM Objectsno0:00:00.0073
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:00.0653
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0153
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:19.5003
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:06:12.9463
 Testsuite.K8S 06-K8S Secure Key Management.Test SSH Accessno0:00:33.0243
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metricsno0:09:00.3073
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Serviceno0:05:03.3683
 Testsuite.Slice 01-Network Slicing.Network Slice Instance Testno0:06:11.3333
 Testsuite.Slice 01-Network Slicing.Test Middle Ns Pingno0:01:30.1873
 Testsuite.Slice 01-Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0193
 Testsuite.Slice 01-Network Slicing.Test Slice Connectivityno0:00:00.0573

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite75 (-4)603 (±0)4:51:17.830 (-0:19:27.549)
Testsuite.Basic 12-Ns Primitives3 (±0)9 (±0)0:07:19.123 (+0:00:00.287)
Testsuite.Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:23.074 (+0:00:02.935)
Testsuite.Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:53.536 (+0:00:01.750)
Testsuite.Heal 01-Volume Vdu Healing0 (±0)16 (±0)0:07:59.754 (+0:00:03.101)
Testsuite.Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:48.875 (-0:00:00.245)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:46.861 (-0:00:00.372)
Testsuite.K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:05:01.715 (-0:00:02.568)
Testsuite.Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:03:03.315 (-0:00:17.404)
Testsuite.Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:01:47.675 (-0:00:14.888)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance0 (±0)16 (±0)0:04:27.818 (-0:00:00.624)
Testsuite.Basic 30-Ns Ipv6 Profile7 (±0)12 (±0)0:06:36.182 (+0:00:01.135)
Testsuite.K8S 09-Pebble Charm K8S0 (±0)8 (±0)0:02:59.934 (+0:00:00.627)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:12.819 (-0:00:00.508)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.425 (-0:00:00.185)
Testsuite.Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:04.310 (+0:00:00.841)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling0 (-8)18 (±0)0:09:05.889 (+0:03:15.899)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:11:44.574 (-0:00:25.882)
Testsuite.Hackfest Cloudinit4 (±0)9 (±0)0:06:32.215 (-0:00:34.209)
Testsuite.Basic 22-Cross Model Relations0 (±0)10 (±0)0:08:27.505 (+0:00:02.633)
Testsuite.Basic 14-Vnf Relations0 (±0)6 (±0)0:04:49.395 (+0:00:31.007)
Testsuite.Hackfest Multivdu4 (±0)9 (±0)0:06:39.026 (+0:00:07.018)
Testsuite.Basic 08-Disable Port Security Network Level1 (±0)9 (±0)0:07:17.772 (+0:00:00.698)
Testsuite.Fail 01-Insufficient Resources0 (±0)6 (±0)0:05:49.415 (+0:00:02.476)
Testsuite.Slice 02-Shared Network Slicing0 (-6)20 (±0)0:06:54.688 (-0:09:48.442)
Testsuite.Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:08:12.833 (-0:01:02.800)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:01:46.579 (+0:00:00.257)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:01:01.399 (+0:00:00.051)
Testsuite.Basic 07-Secure Key Management5 (±0)12 (±0)0:07:51.855 (-0:00:18.838)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)15 (±0)0:14:23.345 (-0:05:02.088)
Testsuite.Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:54.743 (+0:00:02.192)
Testsuite.Heal 03-Multiple Healing10 (±0)16 (±0)0:07:20.552 (-0:00:01.901)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:16.310 (+0:00:00.134)
Testsuite.Heal 02-Scale Vdu Healing9 (+9)16 (±0)0:07:23.177 (-0:07:45.985)
Testsuite.Basic 29-Vnf Ipv6 Profile4 (±0)9 (±0)0:06:34.287 (+0:00:48.656)
Testsuite.Slice 01-Network Slicing4 (±0)13 (±0)0:09:59.124 (+0:00:00.319)
Testsuite.Basic 13-Ns Relations0 (±0)8 (±0)0:04:20.723 (-0:00:01.058)
Testsuite.Basic 26-Secure Helm Execution Environment0 (±0)11 (±0)0:03:05.851 (+0:00:37.204)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:12.700 (-0:00:00.952)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:23.479 (-0:00:00.344)
Testsuite.Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.542 (+0:00:00.015)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:21.200 (+0:00:01.997)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:49.130 (+0:00:00.120)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms0 (±0)11 (±0)0:05:14.230 (+0:00:19.353)
Testsuite.K8S 08-Simple K8S Scaling0 (±0)12 (±0)0:04:35.933 (-0:00:01.461)
Testsuite.Basic 31-Multivdu Volume Multiattach0 (±0)9 (±0)0:03:18.656 (+0:00:01.573)
Testsuite.K8S 05-K8S Proxy Charms0 (-6)11 (±0)0:05:28.955 (-0:02:39.479)
Testsuite.Epa 01-Epa Sriov3 (±0)8 (±0)0:06:46.652 (+0:00:00.597)
Testsuite.Basic 28-Keep Persistent Volumes0 (±0)16 (±0)0:03:42.537 (-0:00:03.112)
Testsuite.Heal 04-Autohealing0 (±0)14 (±0)0:06:34.274 (+0:00:14.005)
Testsuite.K8S 06-K8S Secure Key Management5 (±0)12 (±0)0:09:26.572 (+0:00:19.028)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp2 (±0)7 (±0)0:15:05.275 (+0:00:17.818)
Testsuite.Basic 06-Vnf With Charm0 (-7)12 (±0)0:05:09.291 (-0:01:43.406)
Testsuite.Basic 24-Affinity Groups0 (±0)7 (±0)0:02:00.022 (+0:00:01.955)
Testsuite.Basic 11-Native Charms4 (+4)9 (±0)0:07:12.458 (+0:01:27.274)
Testsuite.Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:18.743 (-0:00:04.208)
Testsuite.Basic 25-Update Charm In Running Vnf Instance10 (+10)16 (±0)0:07:04.344 (+0:02:23.626)
Testsuite.K8S 03-Simple K8S0 (±0)8 (±0)0:03:17.893 (-0:00:03.171)