TEST SUITE:Testsuite
Description:
Duration:8:36:09.214 (-0:01:18.104)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Report File:report.html
Log File:log.html

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.0023
 Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.0023
 Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.0043
 Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.9023
 Basic 06-Vnf With Charm.Delete NS Instanceno0:16:17.4123
 Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.8853
 Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.0053
 Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.0033
 Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:40.7863
 Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.0043
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.8893
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.8783
 Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.9323
 Basic 07-Secure Key Management.Delete NS Instanceno0:16:15.9183
 Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.9983
 Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.8043
 Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:40.7373
 Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0053
 Basic 11-Native Charms.Delete NS Descriptorno0:00:01.8283
 Basic 11-Native Charms.Delete NS Instanceno0:16:17.7513
 Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.8323
 Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0093
 Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:40.7223
 Basic 11-Native Charms.Test SSH Accessno0:00:00.0083
 Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0063
 Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0053
 Basic 12-Ns Primitives.Delete NSno0:16:18.3083
 Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.8163
 Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.8703
 Basic 12-Ns Primitives.Instantiate NSno0:01:09.2773
 Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.9533
 Basic 13-Ns Relations.Delete NS Instanceno0:16:18.3823
 Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:00.9623
 Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.9163
 Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.0933
 Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.9713
 Basic 14-Vnf Relations.Delete NS Instanceno0:16:18.3463
 Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.9373
 Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.3283
 Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0053
 Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0053
 Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0063
 Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.8383
 Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:02.1703
 Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.8983
 Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0043
 Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0093
 Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.2483
 Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0073
 Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0063
 Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.8553
 Hackfest Cloudinit.Delete NS Instance Testno0:16:02.8343
 Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.9433
 Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.9813
 Hackfest Multivdu.Delete NS Instance Testno0:16:03.3443
 Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.9413
 K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.7003
 K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.1593
 K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0033
 K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0023
 K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.8853
 K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:03.1963
 K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.9893
 K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0043
 K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0043
 K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.0483
 K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0063
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.1043
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.0683
 K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.8933
 K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:04.0423
 K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.9733
 K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.9213
 K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:09.4033
 K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:02.4483
 K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.6723
 K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.0043
 K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:04.0413
 K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:08.4273
 K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:05.3113
 K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:05.0963
 K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.9753
 K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.4533
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0043
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0033
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.8793
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:03.8553
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.9493
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0053
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0083
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.2383
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.0093
 K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:38.4553
 K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.0083
 K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.0063
 K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.3803
 K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.9063
 K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:05.6523
 K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.9293
 K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.7023
 K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.9683
 K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.8383
 K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.8423
 K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.0053
 K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:06.2623
 K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.8613
 K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.9503
 K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.9663
 K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.1293
 K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.1683
 K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:02.1483
 K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.1443
 Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.1403
 Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.2393
 Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.1773

Nested Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Basic 12-Ns Primitives6 (±0)9 (±0)0:37:24.607 (+0:00:02.361)
K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:52.510 (+0:00:00.019)
Basic 07-Secure Key Management7 (±0)12 (±0)0:37:20.312 (+0:00:11.457)
Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:36:19.551 (-0:00:53.253)
K8S 07-Dummy Helm0 (±0)10 (±0)0:02:27.546 (+0:00:03.232)
Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:05:41.840 (-0:00:31.843)
K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:48.080 (+0:00:01.567)
K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:36.105 (+0:00:02.093)
Basic 13-Ns Relations5 (±0)8 (±0)0:37:20.290 (+0:00:03.811)
Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:12.964 (-0:00:00.432)
K8S 04-Openldap Helm0 (±0)12 (±0)0:03:12.567 (-0:00:00.139)
Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.564 (+0:00:00.611)
Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:14.023 (+0:00:01.849)
Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:58.001 (-0:00:47.969)
Hackfest Cloudinit3 (±0)9 (±0)0:20:00.138 (-0:00:32.047)
Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:27.048 (+0:00:02.057)
Basic 14-Vnf Relations4 (±0)6 (±0)0:36:10.733 (+0:00:00.301)
Hackfest Multivdu3 (±0)9 (±0)0:20:18.645 (-0:00:02.028)
Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:09:56.592 (+0:00:45.384)
K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:46.077 (+0:00:06.759)
K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:55.459 (+0:00:07.185)
K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:37.345 (-0:00:10.921)
K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:31.549 (-0:00:00.691)
Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:35.969 (+0:00:12.636)
Hackfest Basic0 (±0)9 (±0)0:03:54.610 (-0:00:00.192)
Basic 11-Native Charms7 (±0)9 (±0)0:36:37.396 (+0:00:00.415)
K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:46.531 (-0:00:00.078)
K8S 03-Simple K8S2 (±0)8 (±0)0:00:35.006 (-0:00:00.235)