Robot Framework Test Results

Executed:20240219 23:41:34.554
Duration:5:11:16.872 (+0:04:50.023)
Status:0 critical test, 0 passed, 0 failed
603 test total (±0), 514 passed, 89 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.0031
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.0031
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.0061
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.0051
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.0041
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:06:07.7361
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.0051
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:00.0591
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0161
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:19.5841
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:06:09.2071
 Testsuite.Basic 07-Secure Key Management.Test SSH Accessno0:00:33.0211
 Testsuite.Basic 08-Disable Port Security Network Level.Instantiate Network Serviceno0:05:34.0985
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0035
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0035
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:06:09.2815
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0052
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0052
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0052
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0042
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0072
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:05:34.4492
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0052
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0062
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Check Remote File Created Via Day 2 Operationno0:00:00.0021
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Check Remote Files Created Via Day 1 Operationno0:00:00.0031
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Check Remote Folder Created Via Day 2 Operationno0:00:00.0021
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operationno0:00:00.0041
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operation on Upgraded Charmno0:00:00.0041
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Get Management Ip Addressno0:00:00.0031
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Instantiate Charm Network Serviceno0:05:38.7781
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Set NS Update Configno0:00:00.0041
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Test SSH Accessno0:00:00.0041
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Update Running VNF Instanceno0:00:00.0021
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check Vnf IPsno0:00:00.0075
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0055
 Testsuite.Basic 29-Vnf Ipv6 Profile.Get Vnf Infono0:00:00.0105
 Testsuite.Basic 29-Vnf Ipv6 Profile.Instantiate Network Serviceno0:05:34.5495
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf1 IPsno0:00:00.0075
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf2 IPsno0:00:00.0055
 Testsuite.Basic 30-Ns Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0045
 Testsuite.Basic 30-Ns Ipv6 Profile.Get Vnfs Infono0:00:00.0125
 Testsuite.Basic 30-Ns Ipv6 Profile.Instantiate Network Serviceno0:05:34.1815
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf1 Interfacesno0:00:00.0335
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf2 Interfacesno0:00:00.0045
 Testsuite.Epa 01-Epa Sriov.Check SR-IOV Interfaceno0:00:30.0175
 Testsuite.Epa 01-Epa Sriov.Get VNF IP Addressno0:00:00.0045
 Testsuite.Epa 01-Epa Sriov.Instantiate Network Serviceno0:05:02.1405
 Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-initno0:00:00.0095
 Testsuite.Hackfest Cloudinit.Get Vnf Ip Addressno0:00:00.0075
 Testsuite.Hackfest Cloudinit.Network Service Instance Testno0:05:34.4035
 Testsuite.Hackfest Cloudinit.Test SSH Accessno0:00:30.0155
 Testsuite.Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.0035
 Testsuite.Hackfest Multivdu.Network Service Instance Testno0:05:03.1565
 Testsuite.Hackfest Multivdu.Test Pingno0:00:30.0675
 Testsuite.Hackfest Multivdu.Test SSH Accessno0:00:00.0145
 Testsuite.Heal 02-Scale Vdu Healing.Check VNF After Healingno0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Get Charm VNF Infono0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Get NS Idno0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Get VIM Objectsno0:00:00.0071
 Testsuite.Heal 02-Scale Vdu Healing.Halt Charm VDUno0:00:00.0031
 Testsuite.Heal 02-Scale Vdu Healing.Heal Charm VDUno0:00:00.0041
 Testsuite.Heal 02-Scale Vdu Healing.Network Service Instance Testno0:06:10.3711
 Testsuite.Heal 02-Scale Vdu Healing.Scale Out Charm VNFno0:00:00.0061
 Testsuite.Heal 02-Scale Vdu Healing.Update VIM Objectsno0:00:00.0061
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0042
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0032
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0052
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0082
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:06:10.1642
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0082
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0042
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0032
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0052
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0082
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:06:10.9782
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.0082
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metricsno0:09:00.3195
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Serviceno0:05:04.8855
 Testsuite.Slice 01-Network Slicing.Network Slice Instance Testno0:06:11.0935
 Testsuite.Slice 01-Network Slicing.Test Middle Ns Pingno0:01:30.2055
 Testsuite.Slice 01-Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0205
 Testsuite.Slice 01-Network Slicing.Test Slice Connectivityno0:00:00.0595
 Testsuite.Slice 02-Shared Network Slicing.Network Slice First Instanceno0:06:12.2092
 Testsuite.Slice 02-Shared Network Slicing.Network Slice Second Instanceno0:06:12.0502
 Testsuite.Slice 02-Shared Network Slicing.Test First Slice Connectivityno0:00:00.0622
 Testsuite.Slice 02-Shared Network Slicing.Test Middle Ns Pingno0:01:30.2042
 Testsuite.Slice 02-Shared Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0172
 Testsuite.Slice 02-Shared Network Slicing.Test Second Slice Connectivityno0:00:03.0142

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite89 (+2)603 (±0)5:11:16.872 (+0:04:50.023)
Testsuite.Basic 12-Ns Primitives3 (±0)9 (±0)0:07:19.480 (+0:00:01.274)
Testsuite.Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:21.249 (+0:00:01.000)
Testsuite.Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:52.924 (-0:00:00.060)
Testsuite.Heal 01-Volume Vdu Healing0 (-10)16 (±0)0:07:57.505 (+0:00:38.247)
Testsuite.Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:49.063 (-0:00:00.460)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:47.025 (+0:00:00.230)
Testsuite.K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:05:02.811 (+0:00:00.174)
Testsuite.Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:03:02.312 (+0:00:13.878)
Testsuite.Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:01:47.450 (+0:00:45.124)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance0 (±0)16 (±0)0:04:24.235 (+0:00:00.689)
Testsuite.Basic 30-Ns Ipv6 Profile7 (±0)12 (±0)0:06:34.633 (+0:00:31.372)
Testsuite.K8S 09-Pebble Charm K8S0 (±0)8 (±0)0:02:59.514 (-0:00:00.606)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:14.301 (+0:00:01.263)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:12.373 (-0:00:00.382)
Testsuite.Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:04.316 (+0:00:00.751)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling8 (±0)18 (±0)0:06:22.902 (+0:00:02.605)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:12:37.556 (+0:00:42.159)
Testsuite.Hackfest Cloudinit4 (±0)9 (±0)0:07:22.988 (+0:00:50.831)
Testsuite.Basic 22-Cross Model Relations0 (±0)10 (±0)0:08:26.475 (-0:00:32.353)
Testsuite.Basic 14-Vnf Relations0 (±0)6 (±0)0:04:47.738 (-0:00:01.438)
Testsuite.Hackfest Multivdu4 (±0)9 (±0)0:06:37.535 (+0:00:05.628)
Testsuite.Basic 08-Disable Port Security Network Level1 (±0)9 (±0)0:08:00.512 (+0:00:15.088)
Testsuite.Fail 01-Insufficient Resources0 (±0)6 (±0)0:05:47.937 (+0:00:02.977)
Testsuite.Slice 02-Shared Network Slicing6 (±0)20 (±0)0:17:29.338 (+0:00:30.769)
Testsuite.Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:09:12.425 (+0:00:00.271)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:01:46.177 (-0:00:00.119)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:01:01.997 (+0:00:00.469)
Testsuite.Basic 07-Secure Key Management5 (+5)12 (±0)0:08:06.908 (+0:04:17.294)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)15 (±0)0:14:22.592 (-0:05:01.142)
Testsuite.Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:50.566 (+0:00:00.351)
Testsuite.Heal 03-Multiple Healing0 (-10)16 (±0)0:16:01.204 (+0:08:39.856)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:16.344 (-0:00:00.529)
Testsuite.Heal 02-Scale Vdu Healing9 (+9)16 (±0)0:07:22.052 (-0:07:53.556)
Testsuite.Basic 29-Vnf Ipv6 Profile4 (±0)9 (±0)0:06:34.690 (+0:00:44.174)
Testsuite.Slice 01-Network Slicing4 (±0)13 (±0)0:09:58.677 (-0:00:00.462)
Testsuite.Basic 13-Ns Relations0 (±0)8 (±0)0:04:54.641 (+0:00:34.268)
Testsuite.Basic 26-Secure Helm Execution Environment0 (±0)11 (±0)0:03:03.100 (+0:00:35.134)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.706 (+0:00:01.174)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:23.544 (-0:00:00.372)
Testsuite.Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.553 (-0:00:00.021)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:17.646 (-0:00:01.511)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:47.852 (-0:00:01.195)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms6 (±0)11 (±0)0:08:08.105 (+0:00:00.877)
Testsuite.K8S 08-Simple K8S Scaling0 (±0)12 (±0)0:04:20.752 (-0:00:16.890)
Testsuite.Basic 31-Multivdu Volume Multiattach0 (±0)9 (±0)0:03:16.566 (-0:00:00.334)
Testsuite.K8S 05-K8S Proxy Charms6 (±0)11 (±0)0:08:05.630 (+0:00:00.231)
Testsuite.Epa 01-Epa Sriov3 (±0)8 (±0)0:06:13.717 (-0:00:00.806)
Testsuite.Basic 28-Keep Persistent Volumes0 (±0)16 (±0)0:03:45.126 (+0:00:33.993)
Testsuite.Heal 04-Autohealing0 (±0)14 (±0)0:06:03.248 (-0:00:32.005)
Testsuite.K8S 06-K8S Secure Key Management0 (-5)12 (±0)0:05:28.007 (-0:03:39.883)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp2 (±0)7 (±0)0:14:48.837 (+0:00:01.487)
Testsuite.Basic 06-Vnf With Charm7 (+7)12 (±0)0:06:50.224 (+0:01:41.191)
Testsuite.Basic 24-Affinity Groups0 (±0)7 (±0)0:01:59.806 (+0:00:00.713)
Testsuite.Basic 11-Native Charms0 (-4)9 (±0)0:05:28.947 (-0:01:23.142)
Testsuite.Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:18.858 (+0:00:01.067)
Testsuite.Basic 25-Update Charm In Running Vnf Instance10 (+10)16 (±0)0:06:45.681 (+0:02:16.752)
Testsuite.K8S 03-Simple K8S0 (±0)8 (±0)0:03:21.250 (+0:00:03.920)