Robot Framework Test Results

Executed:20240414 11:31:10.928
Duration:8:33:41.496 (-0:03:43.343)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.00314
 Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.00214
 Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.00714
 Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.91414
 Testsuite.Basic 06-Vnf With Charm.Delete NS Instanceno0:16:01.23414
 Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.93314
 Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.00414
 Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.00514
 Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:41.41814
 Testsuite.Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.00614
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.87814
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.87614
 Testsuite.Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.89714
 Testsuite.Basic 07-Secure Key Management.Delete NS Instanceno0:16:02.62514
 Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.85214
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.59314
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:40.61814
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00414
 Testsuite.Basic 11-Native Charms.Delete NS Descriptorno0:00:01.85414
 Testsuite.Basic 11-Native Charms.Delete NS Instanceno0:16:03.80014
 Testsuite.Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.85414
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.00714
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:40.79114
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.00814
 Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.00614
 Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.00514
 Testsuite.Basic 12-Ns Primitives.Delete NSno0:16:06.22414
 Testsuite.Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.87714
 Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.88014
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:01:09.48814
 Testsuite.Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.86214
 Testsuite.Basic 13-Ns Relations.Delete NS Instanceno0:16:03.89714
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.97414
 Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.89714
 Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.25214
 Testsuite.Basic 14-Vnf Relations.Delete NS Descriptorno0:00:02.00514
 Testsuite.Basic 14-Vnf Relations.Delete NS Instanceno0:16:02.89314
 Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.07514
 Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.75614
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.00614
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.00314
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.00614
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.86414
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:06.22114
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.89814
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.00414
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.00814
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.14514
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.00714
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.02914
 Testsuite.Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.91614
 Testsuite.Hackfest Cloudinit.Delete NS Instance Testno0:16:05.29814
 Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.92614
 Testsuite.Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.88014
 Testsuite.Hackfest Multivdu.Delete NS Instance Testno0:16:03.73014
 Testsuite.Hackfest Multivdu.Delete VNF Descriptor Testno0:00:02.00814
 Testsuite.K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.89114
 Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.18814
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00314
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00214
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.94014
 Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:06.53914
 Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.96514
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00414
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00614
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:41.64414
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.00814
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.02714
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.00614
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.84814
 Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:06.06214
 Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.91414
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.76714
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:09.20614
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.79614
 Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.71414
 Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.00814
 Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:03.57814
 Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.30914
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.90914
 Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.65214
 Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.79214
 Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.38614
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.00414
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.00214
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.86414
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:07.34714
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.91514
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.00514
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.00914
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.79614
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.00914
 Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.88714
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.00714
 Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.00614
 Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.36214
 Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:02.13614
 Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:06.53414
 Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.18714
 Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.91614
 Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:02.06114
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:01.49614
 Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.88814
 Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.00214
 Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:06.05214
 Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.83114
 Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.94914
 Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:02.02914
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.41614
 Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.17714
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:02.23814
 Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.24914
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.14614
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.17514
 Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.16114

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite115 (±0)287 (±0)8:33:41.496 (-0:03:43.343)
Testsuite.Basic 12-Ns Primitives6 (±0)9 (±0)0:37:01.766 (+0:00:05.878)
Testsuite.K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:53.870 (-0:00:00.930)
Testsuite.Basic 07-Secure Key Management7 (±0)12 (±0)0:37:11.859 (+0:00:17.536)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:36:20.363 (-0:00:51.709)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:24.704 (+0:00:01.840)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:05:11.865 (-0:00:31.865)
Testsuite.K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:56.755 (-0:00:01.553)
Testsuite.K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:35.565 (-0:00:02.070)
Testsuite.Basic 13-Ns Relations5 (±0)8 (±0)0:36:58.355 (-0:00:01.269)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.681 (-0:00:02.300)
Testsuite.K8S 04-Openldap Helm0 (±0)12 (±0)0:03:11.544 (+0:00:00.070)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:26.796 (-0:00:00.498)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.400 (+0:00:00.266)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:48.589 (-0:00:02.710)
Testsuite.Hackfest Cloudinit3 (±0)9 (±0)0:20:04.556 (+0:00:02.616)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:25.228 (-0:00:31.847)
Testsuite.Basic 14-Vnf Relations4 (±0)6 (±0)0:35:44.845 (-0:00:01.126)
Testsuite.Hackfest Multivdu3 (±0)9 (±0)0:20:17.682 (-0:00:06.428)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:09:14.235 (-0:01:38.249)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:45.273 (-0:00:09.248)
Testsuite.K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:48.978 (-0:00:00.153)
Testsuite.K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:36:19.909 (+0:00:30.979)
Testsuite.K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:37.016 (-0:00:06.926)
Testsuite.Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:24.656 (-0:00:01.017)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:03:41.517 (-0:00:44.912)
Testsuite.Basic 11-Native Charms7 (±0)9 (±0)0:36:25.865 (+0:00:13.916)
Testsuite.K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:45.976 (-0:00:00.960)
Testsuite.K8S 03-Simple K8S2 (±0)8 (±0)0:00:36.508 (-0:00:00.672)