Robot Framework Test Results

Executed:20231217 12:31:49.041
Duration:8:38:04.478 (+0:20:52.549)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 170 passed, 117 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.0022
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.0022
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.0022
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.8812
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:05.6402
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.8782
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.0042
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.0022
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:41.1262
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.0052
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.9052
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.8802
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.9142
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:05.9482
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.9472
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.7382
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:41.2362
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0032
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.9822
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:07.3492
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:02.0182
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0092
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:41.1432
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.0072
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0062
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0062
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:07.2332
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.8852
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:02.0592
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:40.8052
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.8912
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:07.9532
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:02.0202
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.9952
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.5412
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.8822
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:05.9442
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.9921
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.3552
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0062
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0062
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0072
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:02.0802
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:01.6642
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:02.0642
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0022
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0042
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.5862
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0082
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0072
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.8852
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:09.2172
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.9732
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.8612
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:09.6312
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.9442
 Testsuite.K8S 02-K8Scluster Creation.Add K8s Cluster To OSMno0:00:37.7432
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.7782
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:05.6452
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0042
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0032
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:02.0192
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:07.9262
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.9442
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0052
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0072
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.8402
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0082
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.0422
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.0012
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.9302
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:09.4452
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.9972
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.9592
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:41.0532
 Testsuite.K8S 07-Dummy Helm.Add K8s Cluster To OSMno0:00:37.6512
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:03.3632
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.7162
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.0102
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:02.8672
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.5592
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.7672
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.8512
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.9592
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.5702
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0032
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0032
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.9222
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:08.4032
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.1042
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0052
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0072
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:02:12.6802
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.0072
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.7002
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.0072
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.0032
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.7272
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.8982
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:09.7602
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:02.0432
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.8502
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.9992
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:01.9142
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.9222
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.0062
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:05.5942
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.8562
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.9902
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.0482
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.2372
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.2072
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:01.2012
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.2682
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.1251
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.0481
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.0991

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite117 (-1)287 (±0)8:38:04.478 (+0:20:52.549)
Testsuite.Basic 12-Ns Primitives6 (±0)9 (±0)0:37:33.206 (-0:00:00.015)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:53.100 (-0:00:00.972)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:36:59.294 (+0:00:01.302)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (+3)15 (±0)0:36:58.835 (+0:12:35.996)
Testsuite.K8S 07-Dummy Helm1 (±0)10 (±0)0:02:43.884 (+0:00:01.576)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:05:43.110 (+0:00:01.655)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:38:07.103 (+0:00:16.119)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:36.397 (+0:00:01.372)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:37:05.384 (+0:02:17.203)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.633 (+0:00:00.328)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:11.364 (-0:00:00.490)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.820 (-0:00:00.229)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.325 (+0:00:01.015)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:49.815 (-0:00:00.968)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:19:48.593 (-0:00:21.987)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:25.612 (+0:00:32.186)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:46.715 (+0:00:01.197)
Testsuite.Hackfest Multivdu3 (-4)9 (±0)0:21:14.720 (+0:02:19.385)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:10:00.905 (+0:01:36.487)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:36:56.206 (+0:01:06.820)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:49.509 (+0:00:00.074)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:49.545 (+0:00:00.201)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:37:14.692 (+0:00:35.904)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:13.157 (+0:00:02.363)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:03:22.281 (-0:00:18.229)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:36:17.128 (+0:00:03.646)
Testsuite.K8S 02-K8Scluster Creation1 (±0)4 (±0)0:00:52.685 (+0:00:00.344)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:36.304 (+0:00:00.266)