Robot Framework Test Results

Executed:20240428 11:31:01.955
Duration:8:32:14.712 (-0:01:26.784)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 166 passed, 121 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00322
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00322
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.00722
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.83122
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:17.86222
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.82722
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00422
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00622
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:40.91622
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.00522
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.87522
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.84922
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.80322
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:01.18522
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.86022
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.80222
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:41.17122
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00322
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:02.13422
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:03.89922
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:00.89922
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00622
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:40.69322
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00822
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00622
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00522
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:04.40922
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.85822
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.92922
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:09.33222
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.85022
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:05.82222
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.93622
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.88322
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.37822
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:02.02122
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:05.28722
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:00.90020
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.54722
 Testsuite.Basic 16-Advanced Onboarding And Scaling.Check Vdus After Scaling Inno0:00:02.3331
 Testsuite.Basic 16-Advanced Onboarding And Scaling.Perform Manual Vdu Scale Inno0:01:25.6091
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00622
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00422
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00722
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:02.13522
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:04.89422
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.19122
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.00222
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00322
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.35322
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.00922
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.00422
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.83822
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:07.31522
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:02.04422
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.94822
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:05.69322
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.89322
 Testsuite.Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.0041
 Testsuite.Hackfest Multivdu.Network Service Instance Testno0:01:41.5511
 Testsuite.Hackfest Multivdu.Test Pingno0:00:30.0791
 Testsuite.Hackfest Multivdu.Test SSH Accessno0:00:00.0131
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.62322
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.48122
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00222
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00122
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.84422
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:06.25622
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.99422
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00322
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00222
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:10.47922
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00422
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.25622
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.17822
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.91222
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:07.99222
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.91022
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.62422
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:08.93922
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:02.87522
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:02.13522
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.01022
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:02.99722
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:08.90922
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.62222
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:05.77822
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.66822
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.44522
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00222
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00222
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.87022
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:05.99022
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.89822
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00422
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00322
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.40822
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00422
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.72322
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.00722
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.00722
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.14922
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.87222
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:07.43522
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.92522
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:06.27822
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.90222
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:01.87921
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.90621
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00721
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:05.58321
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.91621
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.96221
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.94821
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.48421
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.17521
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:01.20421
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.27821
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.14620
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.11420
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.12120

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite121 (+6)287 (±0)8:32:14.712 (-0:01:26.784)
Testsuite.Basic 12-Ns Primitives6 (±0)9 (±0)0:36:56.808 (-0:00:04.958)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:54.200 (+0:00:00.330)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:37:08.278 (-0:00:03.581)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:35:30.683 (-0:00:49.680)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:25.103 (+0:00:00.399)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:05:46.265 (+0:00:34.400)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:58.613 (+0:00:01.858)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:36.536 (+0:00:00.971)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:36:56.733 (-0:00:01.622)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:15.630 (+0:00:01.949)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:14.706 (+0:00:03.162)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.565 (+0:00:00.769)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:14.443 (+0:00:01.043)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:48.307 (-0:00:00.282)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:20:03.684 (-0:00:00.872)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:24.789 (-0:00:00.439)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:48.598 (+0:00:03.753)
Testsuite.Hackfest Multivdu7 (+4)9 (±0)0:19:25.067 (-0:00:52.615)
Testsuite.Basic 16-Advanced Onboarding And Scaling2 (+2)12 (±0)0:09:15.118 (+0:00:00.883)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:47.062 (+0:00:01.789)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:55.508 (+0:00:06.530)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:46.428 (-0:00:33.481)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:38.954 (+0:00:01.938)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:37.644 (+0:00:12.988)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:03:41.642 (+0:00:00.125)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:36:12.970 (-0:00:12.895)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:46.460 (+0:00:00.484)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:36.793 (+0:00:00.285)