Robot Framework Test Results

Executed:20240324 12:29:44.388
Duration:8:36:19.134 (-0:01:45.661)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00511
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00211
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.00611
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.98011
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:02.23811
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.85711
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00611
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00511
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:41.20911
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.01211
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.87711
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.88511
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.80411
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:01.18811
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.87711
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.69911
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:40.35611
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00411
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.91211
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:04.92811
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.86411
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00711
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:40.56911
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00911
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00311
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00211
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:04.67411
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.86511
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.89611
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:09.12211
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.84011
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:04.24211
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.94711
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.84911
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.34411
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.89011
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:04.22511
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.88911
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.95311
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00611
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00911
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00611
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.88611
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:06.64711
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:02.05811
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.00211
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00311
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.91211
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.00611
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.00711
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.85311
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:05.96311
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.90111
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.91811
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:06.36111
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.98411
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.70911
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.31511
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00411
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00311
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.87111
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:06.16311
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.90011
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00511
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00711
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.10411
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00811
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.19111
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.99711
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:02.05611
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:06.50211
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.90011
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.75011
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:09.82511
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.71311
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.71211
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.00311
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:02.80211
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:07.71311
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.97611
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.79111
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.67811
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:05.03711
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00311
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00211
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.87511
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:07.99811
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.98411
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00511
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00611
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.51011
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00711
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.37711
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.00811
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.00711
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.19711
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.86411
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:06.75111
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.89811
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.76411
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:02.48111
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.86111
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.84811
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00611
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:05.21311
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.91411
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.88811
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.93911
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.19511
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.10111
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:02.26011
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.11911
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.13411
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.06611
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.16711

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite115 (±0)287 (±0)8:36:19.134 (-0:01:45.661)
Testsuite.Basic 12-Ns Primitives6 (±0)9 (±0)0:36:58.650 (-0:00:58.525)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:52.225 (-0:00:01.527)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:37:08.929 (+0:00:02.932)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:37:14.188 (+0:00:55.723)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:24.645 (+0:00:00.550)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:06:15.439 (+0:00:33.529)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:53.311 (+0:00:04.024)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:35.947 (+0:00:01.413)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:36:55.143 (-0:00:12.458)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.454 (-0:00:01.252)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:13.080 (+0:00:02.184)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.237 (+0:00:00.949)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:14.958 (+0:00:02.162)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:51.653 (-0:00:08.335)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:20:02.696 (+0:00:02.146)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:25.379 (-0:00:32.379)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:42.532 (-0:00:12.295)
Testsuite.Hackfest Multivdu3 (±0)9 (±0)0:20:22.022 (+0:00:03.466)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:11:06.641 (-0:01:16.375)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:47.663 (+0:00:06.598)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:48.280 (+0:00:00.441)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:43.566 (+0:00:01.939)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:39.461 (+0:00:07.462)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:09.680 (-0:00:31.743)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:03:38.219 (+0:00:17.024)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:36:10.806 (-0:00:12.492)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:47.414 (-0:00:00.057)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:35.782 (-0:00:00.764)