TEST SUITE:Testsuite
Description:
Duration:8:35:07.814 (-0:06:45.818)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Report File:report.html
Log File:log.html

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.0045
 Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.0035
 Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.0075
 Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.8535
 Basic 06-Vnf With Charm.Delete NS Instanceno0:16:16.8505
 Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.8725
 Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.0075
 Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.0045
 Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:40.8665
 Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.0065
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.9375
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.9145
 Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.8705
 Basic 07-Secure Key Management.Delete NS Instanceno0:16:15.3335
 Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.8625
 Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.6125
 Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:40.6115
 Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0035
 Basic 11-Native Charms.Delete NS Descriptorno0:00:01.8675
 Basic 11-Native Charms.Delete NS Instanceno0:16:17.9225
 Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.8715
 Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0055
 Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:40.6185
 Basic 11-Native Charms.Test SSH Accessno0:00:00.0065
 Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0075
 Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0045
 Basic 12-Ns Primitives.Delete NSno0:16:17.7145
 Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.8555
 Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.9235
 Basic 12-Ns Primitives.Instantiate NSno0:01:41.4735
 Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.8875
 Basic 13-Ns Relations.Delete NS Instanceno0:16:17.4075
 Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.8895
 Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.9785
 Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.0935
 Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.8285
 Basic 14-Vnf Relations.Delete NS Instanceno0:16:18.2355
 Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.8765
 Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:08.9915
 Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0045
 Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0055
 Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0065
 Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.8565
 Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:02.2505
 Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.9045
 Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0065
 Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0125
 Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.3015
 Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0075
 Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0075
 Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.8915
 Hackfest Cloudinit.Delete NS Instance Testno0:16:03.2775
 Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.9495
 Hackfest Multivdu.Delete NS Descriptor Testno0:00:01.9345
 Hackfest Multivdu.Delete NS Instance Testno0:16:03.0255
 Hackfest Multivdu.Delete VNF Descriptor Testno0:00:01.9105
 K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.7995
 K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.1425
 K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0075
 K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0035
 K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.8525
 K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:02.3335
 K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.9715
 K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0085
 K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0065
 K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:08.9875
 K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0135
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.0085
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.9925
 K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.9145
 K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:03.1645
 K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.9365
 K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.8165
 K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:09.1065
 K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.6985
 K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.7545
 K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.0035
 K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:03.3185
 K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.1935
 K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.7415
 K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.7025
 K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.8385
 K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:06.3785
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0035
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0025
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.8685
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:03.8165
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.9685
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0055
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0085
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.1715
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.0085
 K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.5575
 K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.0095
 K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.0105
 K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.1415
 K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.8645
 K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:05.1115
 K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.8905
 K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.7025
 K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.9525
 K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.8735
 K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.8655
 K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.0025
 K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:06.4485
 K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.8295
 K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.8925
 K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.9775
 K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.1175
 K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.1765
 K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:02.1415
 K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.1845
 Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.1345
 Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:01.9745
 Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.0385

Nested Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Basic 12-Ns Primitives6 (±0)9 (±0)0:37:57.277 (-0:00:28.669)
K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:52.957 (-0:00:00.186)
Basic 07-Secure Key Management7 (±0)12 (±0)0:37:20.395 (-0:00:01.859)
Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:35:45.593 (-0:00:53.845)
K8S 07-Dummy Helm0 (±0)10 (±0)0:02:23.625 (+0:00:00.444)
Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:05:41.271 (-0:00:00.131)
K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:46.148 (-0:00:01.919)
K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:34.569 (-0:00:02.030)
Basic 13-Ns Relations5 (±0)8 (±0)0:37:01.394 (-0:00:37.271)
Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.154 (-0:00:00.100)
K8S 04-Openldap Helm0 (±0)12 (±0)0:03:10.670 (-0:00:00.209)
Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:26.741 (-0:00:00.386)
Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:14.355 (+0:00:00.162)
Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:57.752 (-0:00:47.493)
Hackfest Cloudinit3 (±0)9 (±0)0:19:59.583 (+0:00:01.071)
Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:04:26.169 (-0:00:31.087)
Basic 14-Vnf Relations4 (±0)6 (±0)0:36:10.710 (-0:01:01.022)
Hackfest Multivdu3 (±0)9 (±0)0:20:16.771 (+0:00:00.129)
Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:10:14.636 (-0:00:49.520)
K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:38.678 (-0:00:04.667)
K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:46.827 (-0:00:01.619)
K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:36.226 (-0:00:38.297)
K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:33.670 (-0:00:30.237)
Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:35.981 (-0:00:00.669)
Hackfest Basic0 (±0)9 (±0)0:03:22.282 (-0:00:16.561)
Basic 11-Native Charms7 (±0)9 (±0)0:36:37.900 (-0:00:00.962)
K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:46.338 (-0:00:00.072)
K8S 03-Simple K8S2 (±0)8 (±0)0:00:36.014 (+0:00:01.180)