Robot Framework Test Results

Executed:20240505 11:29:52.851
Duration:8:36:54.590 (+0:04:39.878)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00324
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00324
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.00824
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.92024
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:02.58524
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.91124
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00524
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00524
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:40.52124
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.00724
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.89824
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.85224
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.87524
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:17.40224
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.87124
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.65324
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:02:13.03124
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00424
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.86624
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:03.50924
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.88424
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00724
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:09.58324
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00724
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00724
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00624
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:05.57624
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.86024
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.87224
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:08.77624
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.87824
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:05.03324
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.91424
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.91124
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.63324
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.85824
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:07.07424
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.91021
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:08.35824
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00624
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00624
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00624
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.95324
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:06.33624
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.90124
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.00424
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00824
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.86724
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.00724
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.00624
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.86624
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:04.65224
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.93424
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:02.64724
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:06.07824
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.28824
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.71124
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.92124
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00324
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00324
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:02.03024
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:06.01424
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.02324
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00424
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.01024
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.03424
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00824
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.08524
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.95524
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.88624
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:05.88824
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.93324
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:05.04324
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:40.75624
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.77924
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.76324
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.00924
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:03.42224
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.23424
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.94024
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.86424
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.70624
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.90024
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00424
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00324
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.96224
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:05.05624
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.97024
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00524
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00724
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.13824
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00924
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.44524
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.00724
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.00924
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.92024
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.93624
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:06.09324
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.06124
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.70424
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.93324
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.88522
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.84522
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00622
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:06.34722
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.79522
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.91722
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:02.04322
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.23022
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.28822
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:02.25222
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.17622
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.14821
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.08721
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.21421

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite115 (-6)287 (±0)8:36:54.590 (+0:04:39.878)
Testsuite.Basic 12-Ns Primitives6 (±0)9 (±0)0:36:58.765 (+0:00:01.957)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:54.348 (+0:00:00.148)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:37:42.955 (+0:00:34.677)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:36:51.342 (+0:01:20.659)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:28.983 (+0:00:03.880)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:06:17.123 (+0:00:30.858)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:52.654 (-0:00:05.959)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:36.375 (-0:00:00.161)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:36:59.080 (+0:00:02.347)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:16.110 (+0:00:00.480)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:11.169 (-0:00:03.537)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.616 (+0:00:00.051)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:12.488 (-0:00:01.955)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:51.001 (+0:00:02.694)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:19:45.693 (-0:00:17.991)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:26.824 (+0:00:02.035)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:49.877 (+0:00:01.279)
Testsuite.Hackfest Multivdu3 (-4)9 (±0)0:20:21.595 (+0:00:56.528)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (-2)12 (±0)0:10:35.955 (+0:01:20.837)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:46.252 (-0:00:00.810)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:49.111 (-0:00:06.397)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:44.634 (-0:00:01.794)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:37:11.019 (+0:00:32.065)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:24.706 (-0:00:12.938)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:03:58.210 (+0:00:16.568)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:35:54.913 (-0:00:18.057)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:47.791 (+0:00:01.331)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:37.856 (+0:00:01.063)