Robot Framework Test Results

Executed:20240322 23:37:58.553
Duration:4:49:58.248 (+0:42:27.958)
Status:0 critical test, 0 passed, 0 failed
603 test total (±0), 574 passed, 29 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 26-Secure Helm Execution Environment.Check Remote File Created Via Day 1 Operationno0:00:00.0041
 Testsuite.Basic 26-Secure Helm Execution Environment.Delete NS Descriptorno0:00:01.5991
 Testsuite.Basic 26-Secure Helm Execution Environment.Delete NS Instanceno0:04:14.6261
 Testsuite.Basic 26-Secure Helm Execution Environment.Delete VNF Descriptorno0:00:01.6091
 Testsuite.Basic 26-Secure Helm Execution Environment.Fail when trying to access gRPC server without TLSno0:00:00.0061
 Testsuite.Basic 26-Secure Helm Execution Environment.Get Management Ip Addressno0:00:00.0051
 Testsuite.Basic 26-Secure Helm Execution Environment.Get data from EE podno0:00:02.9601
 Testsuite.Basic 26-Secure Helm Execution Environment.Instantiate Network Serviceno0:00:40.4841
 Testsuite.Basic 26-Secure Helm Execution Environment.Test SSH Accessno0:00:00.0111
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Check Remote File Created Via Day 2 Operationno0:00:00.0031
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Check Remote Files Created Via Day 1 Operationno0:00:00.0031
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Check Remote Folder Created Via Day 2 Operationno0:00:00.0031
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Create NS Descriptorno0:00:00.7761
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Create VNF Descriptorno0:00:02.3521
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Delete NS Descriptorno0:00:01.5991
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Delete NS Instanceno0:04:01.8111
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Delete VNF Descriptorno0:00:01.6921
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Execute Day 2 Operationno0:00:00.0051
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Execute Day 2 Operation on Upgraded Helm EEno0:00:00.0081
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Get Management Ip Addressno0:00:00.0051
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Instantiate Network Serviceno0:00:40.1681
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Set NS Update Configno0:00:00.0221
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Test SSH Accessno0:00:00.0071
 Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance.Update Running VNF Instanceno0:00:00.0061
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Delete NS Descriptorno0:00:01.6201
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Delete NS Instanceno0:04:15.2981
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Delete VNF Descriptorno0:00:01.6111
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metricsno0:09:00.3091
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Serviceno0:01:13.9171

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite29 (+29)603 (±0)4:49:58.248 (+0:42:27.958)
Testsuite.Basic 12-Ns Primitives0 (±0)9 (±0)0:03:52.640 (+0:00:15.901)
Testsuite.Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:20.264 (-0:00:00.657)
Testsuite.Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:53.405 (+0:00:00.737)
Testsuite.Heal 01-Volume Vdu Healing0 (±0)16 (±0)0:07:50.791 (-0:00:28.442)
Testsuite.Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:06:42.471 (+0:04:53.749)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:47.482 (+0:00:01.050)
Testsuite.K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:05:03.821 (+0:00:03.122)
Testsuite.Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:03:20.960 (-0:00:01.482)
Testsuite.Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:01:47.293 (-0:00:29.940)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance15 (+15)16 (±0)0:11:04.805 (+0:06:41.712)
Testsuite.Basic 30-Ns Ipv6 Profile0 (±0)12 (±0)0:04:55.341 (-0:00:04.320)
Testsuite.K8S 09-Pebble Charm K8S0 (±0)8 (±0)0:02:59.141 (-0:00:00.693)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:13.206 (+0:00:00.955)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.141 (-0:00:00.497)
Testsuite.Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:04.285 (-0:00:00.462)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling0 (±0)18 (±0)0:09:19.658 (+0:00:14.700)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:12:36.527 (+0:00:02.205)
Testsuite.Hackfest Cloudinit0 (±0)9 (±0)0:02:38.163 (-0:00:01.076)
Testsuite.Basic 22-Cross Model Relations0 (±0)10 (±0)0:08:27.221 (-0:00:00.329)
Testsuite.Basic 14-Vnf Relations0 (±0)6 (±0)0:04:47.899 (-0:00:03.203)
Testsuite.Hackfest Multivdu0 (±0)9 (±0)0:02:57.575 (+0:00:00.372)
Testsuite.Basic 08-Disable Port Security Network Level0 (±0)9 (±0)0:02:41.276 (-0:00:18.133)
Testsuite.Fail 01-Insufficient Resources0 (±0)6 (±0)0:01:18.385 (+0:00:00.231)
Testsuite.Slice 02-Shared Network Slicing0 (±0)20 (±0)0:07:08.079 (+0:00:14.582)
Testsuite.Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:05:45.176 (-0:01:25.952)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:01:46.485 (+0:00:00.617)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:01:01.411 (+0:00:00.084)
Testsuite.Basic 07-Secure Key Management0 (±0)12 (±0)0:03:47.971 (-0:00:00.851)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)15 (±0)0:19:23.280 (+0:05:01.622)
Testsuite.Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:50.946 (+0:00:00.076)
Testsuite.Heal 03-Multiple Healing0 (±0)16 (±0)0:15:46.700 (-0:00:29.467)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:20.191 (-0:00:30.247)
Testsuite.Heal 02-Scale Vdu Healing0 (±0)16 (±0)0:15:18.376 (-0:00:17.321)
Testsuite.Basic 29-Vnf Ipv6 Profile0 (±0)9 (±0)0:01:54.227 (-0:00:00.542)
Testsuite.Slice 01-Network Slicing0 (±0)13 (±0)0:04:44.948 (-0:00:00.101)
Testsuite.Basic 13-Ns Relations0 (±0)8 (±0)0:04:55.591 (+0:00:01.439)
Testsuite.Basic 26-Secure Helm Execution Environment9 (+9)11 (±0)0:11:30.095 (+0:08:31.491)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:12.683 (-0:00:01.148)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:23.645 (-0:00:00.206)
Testsuite.Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.442 (-0:00:00.039)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:17.961 (-0:00:02.414)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:47.814 (-0:00:00.145)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms0 (±0)11 (±0)0:04:53.684 (-0:00:01.148)
Testsuite.K8S 08-Simple K8S Scaling0 (±0)12 (±0)0:04:32.762 (-0:00:18.334)
Testsuite.Basic 31-Multivdu Volume Multiattach0 (±0)9 (±0)0:03:16.188 (-0:00:02.272)
Testsuite.K8S 05-K8S Proxy Charms0 (±0)11 (±0)0:04:53.114 (-0:00:00.475)
Testsuite.Epa 01-Epa Sriov0 (±0)8 (±0)0:02:21.765 (+0:00:00.850)
Testsuite.Basic 28-Keep Persistent Volumes0 (±0)16 (±0)0:03:47.903 (+0:00:03.223)
Testsuite.Heal 04-Autohealing0 (±0)14 (±0)0:07:51.087 (+0:01:33.611)
Testsuite.K8S 06-K8S Secure Key Management0 (±0)12 (±0)0:05:15.321 (+0:00:21.379)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp5 (+5)7 (±0)0:21:04.796 (+0:18:45.661)
Testsuite.Basic 06-Vnf With Charm0 (±0)12 (±0)0:04:49.893 (-0:00:00.401)
Testsuite.Basic 24-Affinity Groups0 (±0)7 (±0)0:02:03.050 (+0:00:03.758)
Testsuite.Basic 11-Native Charms0 (±0)9 (±0)0:05:46.544 (+0:00:15.833)
Testsuite.Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:21.434 (+0:00:03.640)
Testsuite.Basic 25-Update Charm In Running Vnf Instance0 (±0)16 (±0)0:04:44.834 (+0:00:15.460)
Testsuite.K8S 03-Simple K8S0 (±0)8 (±0)0:03:18.832 (-0:00:19.810)