Robot Framework Test Results

Executed:20240630 11:31:05.314
Duration:7:22:26.661 (-1:13:49.287)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 153 passed, 134 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 05-Instantiation Parameters In Cloud Init.Get Management Ip Addressesno0:00:00.0061
 Testsuite.Basic 05-Instantiation Parameters In Cloud Init.Instantiate Cloudinit Network Service Using Instantiation Parametersno0:00:38.1021
 Testsuite.Basic 05-Instantiation Parameters In Cloud Init.Test SSH Access With The New Passwordno0:00:00.0061
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00326
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00226
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.01226
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.91326
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:05.32026
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.92026
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00526
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00626
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:02:12.77426
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.00826
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.90326
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.88026
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.97526
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:04.95726
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:02.11726
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.80526
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:41.24226
 Testsuite.Basic 09-Manual Vdu Scaling.Check Vdus After Scaling Inno0:00:01.8211
 Testsuite.Basic 09-Manual Vdu Scaling.Instantiate Scaling Network Serviceno0:00:37.8941
 Testsuite.Basic 09-Manual Vdu Scaling.Perform Manual Vdu Scale Inno0:00:04.9601
 Testsuite.Basic 09-Manual Vdu Scaling.Perform Manual Vdu Scale Outno0:00:20.5871
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00326
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.92226
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:07.06126
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.99326
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00726
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:41.10826
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00726
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00626
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00526
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:00:01.85626
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.77526
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.79426
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:00:01.88126
 Testsuite.Basic 12-Ns Primitives.Upload Nsdno0:00:02.7111
 Testsuite.Basic 12-Ns Primitives.Upload Vnfdsno0:00:02.3181
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.92526
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:09.43126
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.95826
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.96326
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:41.20426
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.99826
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:07.33726
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.99326
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:41.55126
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00826
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00526
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00626
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.93826
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:08.03226
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.96026
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.00426
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00926
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:41.77126
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.01426
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.00626
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.94726
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:09.93926
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.98426
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:02.02226
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:07.93826
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:00.96326
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.90226
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.51126
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00426
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00326
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:02.00426
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:07.81626
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.96326
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00526
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00826
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:02:11.81026
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00826
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:03.18026
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.14226
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.97026
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:09.64126
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.93926
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.97526
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:40.93126
 Testsuite.K8S 07-Dummy Helm.Delete VIMno0:01:14.1881
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.83926
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:02.74826
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.00526
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:03.77426
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:07.17426
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:05.05426
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.86726
 Testsuite.K8S 09-Pebble Charm K8S.Create Simple K8s Descriptorno0:00:02.5521
 Testsuite.K8S 09-Pebble Charm K8S.Create Simple K8s VNF Descriptorno0:00:01.1531
 Testsuite.K8S 09-Pebble Charm K8S.Delete NS Descriptor Testno0:00:01.8321
 Testsuite.K8S 09-Pebble Charm K8S.Delete NS K8s Instance Testno0:00:01.8991
 Testsuite.K8S 09-Pebble Charm K8S.Delete VNF Descriptor Testno0:00:01.8311
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:01.92826
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:00.86326
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00426
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00326
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:02.02326
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:11.29226
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.96426
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00526
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00726
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:02:12.84726
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00826
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.97026
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.01026
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.01026
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:00:00.90826
 Testsuite.K8S 12-Openldap Helm Day-2.Create Package For OpenLDAP CNFno0:00:02.2031
 Testsuite.K8S 12-Openldap Helm Day-2.Create Package For OpenLDAP NSno0:00:01.4671
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.88026
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:00:01.84626
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.89426
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:01.88726
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Rollback Operationno0:00:01.9091
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Upgrade Operationno0:00:01.9151
 Testsuite.K8S 12-Openldap Helm Day-2.Get Ns Idno0:00:01.8701
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:00.00426
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Rollback Operation over first KDUno0:00:00.0051
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Rollback Operation over second KDUno0:00:00.0061
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.00926
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.00826
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00326
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:01:09.24326
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.92926
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:20.65726
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:21.07126
 Testsuite.K8S 13-Two Helm Kdu.Get Vnf Idno0:00:01.9921
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.13826
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.11526
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.12726

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite134 (+15)287 (±0)7:22:26.661 (-1:13:49.287)
Testsuite.Basic 12-Ns Primitives8 (+2)9 (±0)0:00:26.671 (-0:37:27.528)
Testsuite.K8S 13-Two Helm Kdu10 (-1)18 (±0)0:03:36.225 (+0:00:39.098)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:37:03.710 (+0:00:27.504)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:37:09.244 (+0:00:47.239)
Testsuite.K8S 07-Dummy Helm1 (+1)10 (±0)0:04:03.636 (+0:01:38.011)
Testsuite.Basic 09-Manual Vdu Scaling4 (+4)13 (±0)0:01:53.626 (-0:03:37.068)
Testsuite.K8S 12-Openldap Helm Day-214 (+5)15 (±0)0:01:14.108 (-0:36:54.808)
Testsuite.K8S 09-Pebble Charm K8S7 (+5)8 (±0)0:00:23.757 (-0:00:14.403)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:37:39.600 (+0:00:27.980)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:14.101 (+0:00:00.094)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:13.550 (+0:00:01.763)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.233 (-0:00:00.086)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.536 (-0:00:00.432)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:36:29.540 (+0:00:26.023)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:19:51.665 (-0:00:01.952)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init3 (+3)8 (±0)0:01:19.107 (-0:03:40.806)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:36:25.797 (+0:00:22.294)
Testsuite.Hackfest Multivdu3 (-4)9 (±0)0:19:49.328 (+0:00:36.175)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:10:19.610 (-0:01:07.858)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:36:56.756 (+0:00:57.012)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:51.846 (+0:00:02.933)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:36:56.924 (+0:00:55.992)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:37:20.730 (+0:00:25.651)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:47.455 (+0:00:54.118)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:03:55.277 (+0:00:13.616)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:36:18.823 (+0:00:20.505)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:47.400 (-0:00:00.132)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:37.279 (-0:00:00.200)