Robot Framework Test Results

Executed:20240310 12:29:25.566
Duration:8:37:59.011 (-0:00:15.564)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.0029
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.0039
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.0049
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.8399
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:16.7579
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.9149
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.0059
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.0049
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:40.7069
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.0049
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.9329
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.8669
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.8359
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:16.6899
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.9249
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.7199
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:40.6299
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0029
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.8659
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:04.0289
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.9239
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0029
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:40.6919
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.0039
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0059
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0059
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:03.4309
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.8569
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.9879
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:40.7579
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.9049
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:02.3999
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.9489
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:02.0799
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.9999
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.8649
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:05.3839
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.8879
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.1589
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0059
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0069
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0059
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.8299
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:02.1679
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.9019
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0049
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0079
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.2109
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0069
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0069
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.9769
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:03.1849
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.9229
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.8989
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:04.0139
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:02.0759
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.7069
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.0769
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0039
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0039
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.8389
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:03.1279
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.9389
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0049
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0059
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.3239
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0079
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.0299
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.0589
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.8729
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:03.6959
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.9449
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.8379
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:09.2259
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.7779
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.7549
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.0069
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:03.7279
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.2879
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.7489
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.8149
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:05.0709
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:05.1829
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0039
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0039
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.9849
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:05.9439
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:00.9009
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0059
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0079
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.2479
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.0089
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:38.4509
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.0089
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.0089
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.0139
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.8869
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:05.7019
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.9029
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.7639
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.9239
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.8679
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.8989
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.0029
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:06.0509
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.8499
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.9399
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.9499
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.2009
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.1789
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:02.1549
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.2669
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.1349
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:01.9769
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.0449

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite115 (±0)287 (±0)8:37:59.011 (-0:00:15.564)
Testsuite.Basic 12-Ns Primitives6 (±0)9 (±0)0:37:29.080 (-0:00:09.863)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:52.648 (+0:00:01.147)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:37:22.181 (+0:00:00.844)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:36:52.217 (-0:00:16.937)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:23.870 (+0:00:00.869)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:06:14.300 (-0:00:46.038)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:48.445 (+0:00:02.328)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:34.002 (-0:00:00.284)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:36:50.526 (-0:00:13.280)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.089 (-0:00:00.060)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:10.293 (-0:00:00.341)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:26.152 (-0:00:00.876)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:14.109 (+0:00:00.368)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:43.260 (+0:00:00.360)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:19:42.018 (-0:01:21.855)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:58.087 (+0:01:02.610)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:41.266 (+0:00:01.213)
Testsuite.Hackfest Multivdu3 (±0)9 (±0)0:21:35.184 (+0:01:19.063)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:11:23.088 (+0:00:35.029)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:39.997 (-0:00:07.842)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:47.655 (+0:00:01.315)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:40.367 (-0:00:05.621)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:32.332 (-0:00:01.580)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:35.540 (+0:00:31.408)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:03:22.160 (-0:00:32.481)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:36:24.512 (-0:00:14.035)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:46.511 (+0:00:00.034)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:35.964 (-0:00:01.081)