Robot Framework Test Results

Executed:20240407 11:30:13.373
Duration:8:37:24.839 (+0:41:57.647)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00413
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00213
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.00713
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.89113
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:02.05313
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.99313
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00513
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00413
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:41.88713
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.00613
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.93713
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.86013
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.84013
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:01.43013
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.88313
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.77813
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:41.05313
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00413
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.89213
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:03.57313
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.87513
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00713
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:40.91513
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00713
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00613
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00513
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:03.74013
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.86913
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.89713
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:09.77813
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.88613
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:03.44813
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.94813
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.93013
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:08.82213
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.90713
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:03.05613
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:02.44513
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.24513
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00513
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00613
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00613
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.86413
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:05.44513
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.90613
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.00413
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00813
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.34513
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.00713
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.00613
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.93713
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:05.47013
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.93213
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.92713
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:09.87713
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.91613
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.52713
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.46013
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00313
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00213
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.84913
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:08.37713
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.88213
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00513
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00713
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.38113
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00813
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.09413
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.98213
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.95713
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:11.47013
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.90113
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.81513
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:10.05113
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.79513
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.72413
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.00613
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:03.35013
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.15213
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.91013
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:05.09613
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.88213
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.33413
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00313
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00313
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.88813
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:12.16013
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.91813
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00513
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00613
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.62513
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00813
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.61813
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.00813
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.00913
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.44713
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:02.01413
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:11.53813
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.09113
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.74913
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.99413
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.85313
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.91713
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00213
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:05.26213
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.92813
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.95913
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.96113
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.17613
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.14413
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:03.36313
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.25613
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.14413
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.11513
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.18113

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite115 (-6)287 (±0)8:37:24.839 (+0:41:57.647)
Testsuite.Basic 12-Ns Primitives6 (-2)9 (±0)0:36:55.888 (+0:36:22.484)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:54.800 (+0:00:01.967)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:36:54.323 (+0:00:32.324)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:37:12.072 (+0:00:51.767)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:22.864 (-0:00:01.615)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:05:43.730 (+0:00:01.639)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:58.308 (+0:00:06.264)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:37.635 (+0:00:01.779)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:36:59.624 (+0:00:04.808)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:15.981 (+0:00:02.776)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:11.474 (-0:00:01.069)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.294 (+0:00:00.282)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.134 (-0:00:01.516)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:51.299 (+0:00:01.693)
Testsuite.Hackfest Cloudinit3 (-4)9 (±0)0:20:01.940 (+0:00:38.708)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:57.075 (-0:00:00.675)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:45.971 (+0:00:02.750)
Testsuite.Hackfest Multivdu3 (±0)9 (±0)0:20:24.110 (-0:00:25.727)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:10:52.484 (+0:00:35.789)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:54.521 (+0:00:07.504)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:49.131 (+0:00:01.006)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:48.930 (+0:00:07.844)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:43.942 (+0:00:06.428)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:25.673 (+0:00:46.257)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:04:26.429 (+0:01:35.229)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:36:11.949 (+0:00:17.000)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:46.936 (-0:00:00.575)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:37.180 (+0:00:02.517)