Robot Framework Test Results

Executed:20240512 11:31:59.313
Duration:8:38:22.802 (+0:01:28.212)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00218
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00318
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.00718
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.79218
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:03.48618
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.86418
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00418
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00618
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:40.70218
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.00718
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.03718
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.86718
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:02.31518
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:01.90618
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:00.98418
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.69018
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:40.68518
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00518
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.85418
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:03.80518
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.85218
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00918
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:40.50018
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00918
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00518
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00518
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:05.33518
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.86518
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.91918
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:40.75418
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.83218
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:03.62918
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:02.67118
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:00.95618
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:10.78018
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:02.04318
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:03.31718
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.09518
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.07218
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00518
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00518
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00618
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.88318
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:03.93918
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.92918
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.00418
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00918
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:40.64218
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.00718
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.00618
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.85018
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:05.97718
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.87818
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.86518
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:05.50618
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.96718
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.64418
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.19518
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00318
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00218
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.90818
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:09.87618
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:02.19618
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00618
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00618
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:40.77718
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00818
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.00018
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.99818
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.90218
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:07.59218
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.91218
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.74818
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:09.29818
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.72018
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.95018
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.00818
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:02.91218
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.44418
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.80718
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.75118
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:05.01818
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.28818
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00318
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00318
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.91618
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:07.32218
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.99618
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00418
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00818
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.34318
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00818
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.94518
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.00718
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.00918
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.01418
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.87518
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:07.79018
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.97118
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.98718
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.91618
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:01.90818
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.84718
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00618
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:07.01918
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.99018
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.99318
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.20218
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.21918
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.14618
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:01.21918
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.18718
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.14618
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.15618
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.15418

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite115 (±0)287 (±0)8:38:22.802 (+0:01:28.212)
Testsuite.Basic 12-Ns Primitives6 (±0)9 (±0)0:37:33.715 (+0:00:34.950)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:52.778 (-0:00:01.570)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:36:52.971 (-0:00:49.984)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:36:54.097 (+0:00:02.755)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:23.617 (-0:00:05.366)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:06:14.273 (-0:00:02.850)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:55.311 (+0:00:02.657)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:36.893 (+0:00:00.518)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:36:56.225 (-0:00:02.855)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:16.144 (+0:00:00.034)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:11.268 (+0:00:00.099)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.114 (-0:00:00.502)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.557 (+0:00:01.069)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:36:19.948 (+0:00:28.947)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:20:02.840 (+0:00:17.147)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:57.391 (+0:00:30.567)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:44.877 (-0:00:05.000)
Testsuite.Hackfest Multivdu3 (±0)9 (±0)0:20:22.728 (+0:00:01.133)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:10:34.222 (-0:00:01.733)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:46.797 (+0:00:00.545)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:48.111 (-0:00:01.000)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:36:22.750 (+0:00:38.116)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:37.464 (-0:00:33.555)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:12.462 (-0:00:12.244)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:04:12.907 (+0:00:14.697)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:36:25.814 (+0:00:30.901)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:47.571 (-0:00:00.220)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:38.821 (+0:00:00.965)