Robot Framework Test Results

Executed:20240521 14:45:59.680
Duration:8:36:15.948 (+0:01:36.919)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 168 passed, 119 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00322
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00222
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.00722
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.95022
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:08.59422
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.86422
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00422
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00522
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:10.44322
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.00722
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.99122
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.96122
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:02.17722
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:07.94622
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.50622
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.71822
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:10.09422
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00322
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.93122
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:09.98022
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:02.00822
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00622
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:10.41322
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00722
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00722
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00622
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:11.13822
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.89622
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.90122
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:41.14622
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.88022
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:08.91322
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.90722
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.92522
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.75322
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.95322
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:12.25222
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:00.98922
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.86522
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00322
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00422
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00622
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.85622
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:12.79222
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.95722
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.00422
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00822
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.77922
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.00722
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.00422
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.88722
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:11.82022
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.92622
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.91122
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:10.08722
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.95122
 Testsuite.Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.0041
 Testsuite.Hackfest Multivdu.Network Service Instance Testno0:01:41.3161
 Testsuite.Hackfest Multivdu.Test Pingno0:00:30.0901
 Testsuite.Hackfest Multivdu.Test SSH Accessno0:00:00.0151
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.85122
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.39022
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00322
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00222
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.89522
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:12.41722
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.88922
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00422
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00722
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:10.95522
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00822
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.14622
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.52722
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.98222
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:13.36922
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:02.02222
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:05.07422
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:10.87522
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.74022
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.81522
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.00922
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:03.12822
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.35322
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.77122
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.88122
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.94622
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.72122
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00422
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00322
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.93122
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:15.04622
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.95922
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00622
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00822
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.38622
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00822
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.83622
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.00822
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.00522
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.61922
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:02.02522
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:15.77722
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.95922
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:05.01322
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.98122
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:01.93622
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.90122
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00622
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:06.77122
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.86922
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.97522
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:02.03822
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.21722
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.22622
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:01.24422
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.19322
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.13122
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.02722
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.05422

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite119 (+4)287 (±0)8:36:15.948 (+0:01:36.919)
Testsuite.Basic 12-Ns Primitives6 (±0)9 (±0)0:37:54.199 (+0:00:59.149)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:57.127 (+0:00:03.880)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:36:36.206 (-0:00:22.484)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:36:22.005 (-0:00:46.786)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:25.625 (±0)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:05:30.694 (-0:00:13.106)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:38:08.916 (+0:00:14.499)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:38.160 (+0:00:01.413)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:37:11.620 (+0:00:18.685)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:14.007 (-0:00:00.404)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:11.787 (+0:00:00.968)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.319 (+0:00:00.025)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.968 (+0:00:01.167)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:36:03.517 (+0:00:18.090)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:19:53.617 (-0:00:09.944)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:59.913 (+0:00:33.582)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:36:03.503 (+0:00:14.010)
Testsuite.Hackfest Multivdu7 (+4)9 (±0)0:19:13.153 (-0:00:53.454)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:11:27.468 (+0:00:36.515)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:59.744 (+0:00:12.870)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:48.913 (-0:00:00.456)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:36:00.932 (+0:00:13.121)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:55.079 (+0:00:21.178)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:35:53.337 (-0:00:15.103)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:03:41.661 (+0:00:01.316)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:35:58.318 (+0:00:06.113)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:47.532 (+0:00:01.635)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:37.479 (+0:00:00.433)