Robot Framework Test Results

Executed:20240216 23:40:48.894
Duration:5:10:45.379 (+0:08:49.397)
Status:0 critical test, 0 passed, 0 failed
603 test total (±0), 524 passed, 79 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.0021
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.0021
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.0141
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.0041
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.0061
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:06:10.1151
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.0041
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:00.0632
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0162
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:19.5332
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:06:11.7802
 Testsuite.Basic 07-Secure Key Management.Test SSH Accessno0:00:33.0212
 Testsuite.Basic 08-Disable Port Security Network Level.Instantiate Network Serviceno0:05:34.0152
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0052
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0052
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:06:07.9502
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0131
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0051
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0071
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0041
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0071
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:05:02.3791
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0081
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0041
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check Vnf IPsno0:00:00.0062
 Testsuite.Basic 29-Vnf Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0062
 Testsuite.Basic 29-Vnf Ipv6 Profile.Get Vnf Infono0:00:00.0072
 Testsuite.Basic 29-Vnf Ipv6 Profile.Instantiate Network Serviceno0:05:02.4452
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf1 IPsno0:00:00.0052
 Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf2 IPsno0:00:00.0052
 Testsuite.Basic 30-Ns Ipv6 Profile.Check that ipv6 address_mode and ra_mode are setno0:00:00.0052
 Testsuite.Basic 30-Ns Ipv6 Profile.Get Vnfs Infono0:00:00.0072
 Testsuite.Basic 30-Ns Ipv6 Profile.Instantiate Network Serviceno0:05:33.2512
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf1 Interfacesno0:00:00.0062
 Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf2 Interfacesno0:00:00.0062
 Testsuite.Epa 01-Epa Sriov.Check SR-IOV Interfaceno0:00:30.0162
 Testsuite.Epa 01-Epa Sriov.Get VNF IP Addressno0:00:00.0092
 Testsuite.Epa 01-Epa Sriov.Instantiate Network Serviceno0:05:33.7972
 Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-initno0:00:00.0102
 Testsuite.Hackfest Cloudinit.Get Vnf Ip Addressno0:00:00.0082
 Testsuite.Hackfest Cloudinit.Network Service Instance Testno0:05:34.3022
 Testsuite.Hackfest Cloudinit.Test SSH Accessno0:00:30.0142
 Testsuite.Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.0032
 Testsuite.Hackfest Multivdu.Network Service Instance Testno0:05:02.2282
 Testsuite.Hackfest Multivdu.Test Pingno0:00:30.0782
 Testsuite.Hackfest Multivdu.Test SSH Accessno0:00:00.0122
 Testsuite.Heal 03-Multiple Healing.Check VNFs After Healingno0:00:00.0062
 Testsuite.Heal 03-Multiple Healing.Get Charm VNF Infono0:00:00.0052
 Testsuite.Heal 03-Multiple Healing.Get NS Idno0:00:00.0052
 Testsuite.Heal 03-Multiple Healing.Get VIM Objectsno0:00:00.0072
 Testsuite.Heal 03-Multiple Healing.Get Volume VNF Infono0:00:00.0052
 Testsuite.Heal 03-Multiple Healing.Heal VDUsno0:00:00.0042
 Testsuite.Heal 03-Multiple Healing.Network Service Instance Testno0:06:12.4592
 Testsuite.Heal 03-Multiple Healing.Scale Out Charm VNFno0:00:00.0052
 Testsuite.Heal 03-Multiple Healing.Stop VDUsno0:00:00.0042
 Testsuite.Heal 03-Multiple Healing.Update VIM Objectsno0:00:00.0062
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0032
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0022
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0042
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0072
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:06:12.5502
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0072
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:03.0152
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0172
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:19.4402
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:06:10.7482
 Testsuite.K8S 06-K8S Secure Key Management.Test SSH Accessno0:00:33.0152
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metricsno0:09:00.3062
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Serviceno0:05:03.6152
 Testsuite.Slice 01-Network Slicing.Network Slice Instance Testno0:06:10.9762
 Testsuite.Slice 01-Network Slicing.Test Middle Ns Pingno0:01:30.2112
 Testsuite.Slice 01-Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0192
 Testsuite.Slice 01-Network Slicing.Test Slice Connectivityno0:00:00.0572
 Testsuite.Slice 02-Shared Network Slicing.Network Slice First Instanceno0:06:12.0022
 Testsuite.Slice 02-Shared Network Slicing.Network Slice Second Instanceno0:05:41.2922
 Testsuite.Slice 02-Shared Network Slicing.Test First Slice Connectivityno0:00:00.0592
 Testsuite.Slice 02-Shared Network Slicing.Test Middle Ns Pingno0:01:30.1812
 Testsuite.Slice 02-Shared Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0162
 Testsuite.Slice 02-Shared Network Slicing.Test Second Slice Connectivityno0:00:03.0132

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite79 (-14)603 (±0)5:10:45.379 (+0:08:49.397)
Testsuite.Basic 12-Ns Primitives3 (±0)9 (±0)0:07:18.836 (-0:00:01.202)
Testsuite.Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:20.139 (-0:00:00.813)
Testsuite.Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:51.786 (-0:00:00.342)
Testsuite.Heal 01-Volume Vdu Healing0 (-10)16 (±0)0:07:56.653 (+0:00:25.352)
Testsuite.Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:49.120 (+0:00:00.161)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:47.233 (-0:00:03.140)
Testsuite.K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:05:04.283 (+0:00:00.429)
Testsuite.Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:03:20.719 (+0:00:33.533)
Testsuite.Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:02:02.563 (+0:00:30.126)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance0 (±0)16 (±0)0:04:28.442 (-0:00:00.583)
Testsuite.Basic 30-Ns Ipv6 Profile7 (±0)12 (±0)0:06:35.047 (+0:00:01.244)
Testsuite.K8S 09-Pebble Charm K8S0 (±0)8 (±0)0:02:59.307 (-0:00:01.317)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:13.327 (-0:00:03.041)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.610 (-0:00:00.001)
Testsuite.Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:03.469 (-0:00:01.250)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling8 (+8)18 (±0)0:05:49.990 (-0:03:33.243)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:12:10.456 (-0:00:47.165)
Testsuite.Hackfest Cloudinit4 (±0)9 (±0)0:07:06.424 (+0:00:15.893)
Testsuite.Basic 22-Cross Model Relations0 (±0)10 (±0)0:08:24.872 (-0:00:37.640)
Testsuite.Basic 14-Vnf Relations0 (±0)6 (±0)0:04:18.388 (+0:00:01.753)
Testsuite.Hackfest Multivdu4 (±0)9 (±0)0:06:32.008 (-0:00:01.057)
Testsuite.Basic 08-Disable Port Security Network Level1 (±0)9 (±0)0:07:17.074 (-0:00:01.048)
Testsuite.Fail 01-Insufficient Resources0 (±0)6 (±0)0:05:46.939 (+0:00:02.210)
Testsuite.Slice 02-Shared Network Slicing6 (±0)20 (±0)0:16:43.130 (-0:00:45.583)
Testsuite.Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:09:15.633 (+0:01:03.596)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:01:46.322 (+0:00:00.155)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:01:01.348 (-0:00:00.262)
Testsuite.Basic 07-Secure Key Management5 (±0)12 (±0)0:08:10.693 (+0:00:19.028)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)15 (±0)0:19:25.433 (+0:05:00.741)
Testsuite.Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:52.551 (+0:00:00.469)
Testsuite.Heal 03-Multiple Healing10 (±0)16 (±0)0:07:22.453 (-0:00:03.520)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:16.176 (+0:00:00.052)
Testsuite.Heal 02-Scale Vdu Healing0 (-9)16 (±0)0:15:09.162 (+0:07:46.678)
Testsuite.Basic 29-Vnf Ipv6 Profile4 (±0)9 (±0)0:05:45.631 (-0:00:31.108)
Testsuite.Slice 01-Network Slicing4 (±0)13 (±0)0:09:58.805 (-0:00:00.381)
Testsuite.Basic 13-Ns Relations0 (±0)8 (±0)0:04:21.781 (+0:00:02.345)
Testsuite.Basic 26-Secure Helm Execution Environment0 (±0)11 (±0)0:02:28.647 (-0:00:02.099)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.652 (+0:00:00.045)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:23.823 (-0:00:00.213)
Testsuite.Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.527 (+0:00:00.055)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:19.203 (+0:00:00.382)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:49.010 (+0:00:01.199)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms0 (±0)11 (±0)0:04:54.877 (-0:00:00.422)
Testsuite.K8S 08-Simple K8S Scaling0 (±0)12 (±0)0:04:37.394 (+0:00:00.408)
Testsuite.Basic 31-Multivdu Volume Multiattach0 (±0)9 (±0)0:03:17.083 (-0:00:00.463)
Testsuite.K8S 05-K8S Proxy Charms6 (±0)11 (±0)0:08:08.434 (-0:00:18.442)
Testsuite.Epa 01-Epa Sriov3 (±0)8 (±0)0:06:46.055 (+0:00:30.975)
Testsuite.Basic 28-Keep Persistent Volumes0 (±0)16 (±0)0:03:45.649 (+0:00:00.968)
Testsuite.Heal 04-Autohealing0 (±0)14 (±0)0:06:20.269 (-0:00:48.704)
Testsuite.K8S 06-K8S Secure Key Management5 (±0)12 (±0)0:09:07.544 (+0:00:00.162)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp2 (±0)7 (±0)0:14:47.457 (+0:00:00.349)
Testsuite.Basic 06-Vnf With Charm7 (+7)12 (±0)0:06:52.697 (+0:01:45.230)
Testsuite.Basic 24-Affinity Groups0 (±0)7 (±0)0:01:58.067 (-0:00:03.418)
Testsuite.Basic 11-Native Charms0 (±0)9 (±0)0:05:45.184 (+0:00:50.334)
Testsuite.Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:22.951 (+0:00:02.993)
Testsuite.Basic 25-Update Charm In Running Vnf Instance0 (-10)16 (±0)0:04:40.718 (-0:02:43.385)
Testsuite.K8S 03-Simple K8S0 (±0)8 (±0)0:03:21.064 (+0:00:02.383)