Robot Framework Test Results

Executed:20240331 11:29:34.450
Duration:7:55:27.192 (-0:40:51.942)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 166 passed, 121 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00312
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00212
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.00612
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.82612
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:01.92712
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.84612
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00412
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00512
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:09.03612
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.00612
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.96612
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.88012
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.84112
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:02.28012
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.84312
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.60112
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:09.12512
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00312
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.93012
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:03.72412
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.89612
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00712
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:09.94812
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00712
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00612
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00412
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:00:01.74912
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.77612
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:04.60212
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:00:00.72212
 Testsuite.Basic 12-Ns Primitives.Upload Nsdno0:00:06.0361
 Testsuite.Basic 12-Ns Primitives.Upload Vnfdsno0:00:04.3531
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:02.46512
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:06.90712
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:00.90612
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.85512
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.50012
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.83612
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:05.44012
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.93312
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.06412
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00512
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00512
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00612
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.82912
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:05.23812
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.90912
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.00312
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00612
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.35912
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.00612
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.00712
 Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-initno0:00:00.0131
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.84512
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:04.38012
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.98012
 Testsuite.Hackfest Cloudinit.Get Vnf Ip Addressno0:00:00.0081
 Testsuite.Hackfest Cloudinit.Network Service Instance Testno0:01:40.9061
 Testsuite.Hackfest Cloudinit.Test SSH Accessno0:00:30.0241
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.85312
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:04.45612
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.92012
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.71012
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.11412
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00312
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00312
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.88012
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:04.01112
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.93112
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00512
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00712
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.06912
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00712
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.22212
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.14812
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.88312
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:06.03312
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:02.02612
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.59412
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:09.58012
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.75612
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.74512
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.04912
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:03.17012
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.24412
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.71412
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.79012
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.56312
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.12812
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00412
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00212
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.83112
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:08.58012
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.88112
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00512
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00612
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:08.87012
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00812
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.51512
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.00412
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.01212
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:08.80812
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.86612
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:07.76912
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.97412
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.86112
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.95012
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.87712
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.84412
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00512
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:06.33512
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.81012
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.87212
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.90012
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.15612
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.17812
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:02.20412
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.37812
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.15212
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.04012
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.08612

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite121 (+6)287 (±0)7:55:27.192 (-0:40:51.942)
Testsuite.Basic 12-Ns Primitives8 (+2)9 (±0)0:00:33.404 (-0:36:25.246)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:52.833 (+0:00:00.608)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:36:21.999 (-0:00:46.930)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:36:20.305 (-0:00:53.883)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:24.479 (-0:00:00.166)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:05:42.091 (-0:00:33.348)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:52.044 (-0:00:01.267)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:35.856 (-0:00:00.091)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:36:54.816 (-0:00:00.327)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.205 (-0:00:00.249)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:12.543 (-0:00:00.537)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.012 (-0:00:00.225)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:14.650 (-0:00:00.308)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:49.606 (-0:00:02.047)
Testsuite.Hackfest Cloudinit7 (+4)9 (±0)0:19:23.232 (-0:00:39.464)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:57.750 (+0:00:32.371)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:43.221 (+0:00:00.689)
Testsuite.Hackfest Multivdu3 (±0)9 (±0)0:20:49.837 (+0:00:27.815)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:10:16.695 (-0:00:49.946)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:47.017 (-0:00:00.646)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:48.125 (-0:00:00.155)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:41.086 (-0:00:02.480)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:37.514 (-0:00:01.947)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:35:39.416 (-0:00:30.264)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:02:51.200 (-0:00:47.019)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:35:54.949 (-0:00:15.857)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:47.511 (+0:00:00.097)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:34.663 (-0:00:01.119)