Robot Framework Test Results

Executed:20240519 11:30:22.274
Duration:8:34:39.029 (-0:03:43.773)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00319
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00219
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.00619
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.95319
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:01.96619
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.98519
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00519
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00519
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:40.79119
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.00619
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.88519
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.99719
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.83419
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:02.57619
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.88919
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.58819
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:41.90119
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00319
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.95819
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:02.93919
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:00.89619
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00719
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:09.01719
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00719
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00619
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00519
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:03.82519
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.88819
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.95619
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:09.44819
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.83419
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:04.02319
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.86019
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.93419
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.26019
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.85319
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:06.05119
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.86819
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.10019
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00419
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00519
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00419
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:02.42919
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:03.75519
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.27419
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.02919
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00719
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.26419
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.00619
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.00619
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.81119
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:07.26119
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.88019
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.84519
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:07.90519
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.98419
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.80619
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.26919
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00319
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00219
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.83519
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:04.99619
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.95919
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00619
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00819
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.38619
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00919
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.00419
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.05619
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:02.77919
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:06.95419
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.08819
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.66119
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:09.79119
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.77419
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.75319
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.00819
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:02.95019
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.33219
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.92119
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:05.45719
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.71219
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.47519
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00319
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00219
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.88419
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:06.92619
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.92319
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00419
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00319
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.15619
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00519
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.50419
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.00819
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.00819
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.14419
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.88219
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:06.58419
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.95219
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.92919
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.92419
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.86519
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.86519
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00619
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:05.79819
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.87019
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.95419
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.96019
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.21819
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.19819
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:02.19919
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.18619
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.14819
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.12519
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.22619

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite115 (±0)287 (±0)8:34:39.029 (-0:03:43.773)
Testsuite.Basic 12-Ns Primitives6 (±0)9 (±0)0:36:55.050 (-0:00:38.665)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:53.247 (+0:00:00.469)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:36:58.690 (+0:00:05.719)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:37:08.791 (+0:00:14.694)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:25.625 (+0:00:02.008)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:05:43.800 (-0:00:30.473)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:54.417 (-0:00:00.894)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:36.747 (-0:00:00.146)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:36:52.935 (-0:00:03.290)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:14.411 (-0:00:01.733)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:10.819 (-0:00:00.449)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.294 (+0:00:00.180)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:12.801 (-0:00:00.756)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:45.427 (-0:00:34.521)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:20:03.561 (+0:00:00.721)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:26.331 (-0:00:31.060)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:49.493 (+0:00:04.616)
Testsuite.Hackfest Multivdu3 (±0)9 (±0)0:20:06.607 (-0:00:16.121)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:10:50.953 (+0:00:16.731)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:46.874 (+0:00:00.077)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:49.369 (+0:00:01.258)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:47.811 (-0:00:34.939)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:33.901 (-0:00:03.563)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:08.440 (-0:00:04.022)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:03:40.345 (-0:00:32.562)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:35:52.205 (-0:00:33.609)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:45.897 (-0:00:01.674)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:37.046 (-0:00:01.775)