TEST SUITE:Testsuite
Description:
Duration:8:38:14.575 (+0:03:06.761)
Status:0 critical test, 0 passed, 0 failed
287 test total (±0), 172 passed, 115 failed
Report File:report.html
Log File:log.html

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operationsno0:00:00.0036
 Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operationsno0:00:00.0026
 Basic 06-Vnf With Charm.Check VNF Charm Application Nameno0:00:00.0056
 Basic 06-Vnf With Charm.Delete NS Descriptorno0:00:01.8416
 Basic 06-Vnf With Charm.Delete NS Instanceno0:16:16.4606
 Basic 06-Vnf With Charm.Delete VNF Descriptorno0:00:01.8546
 Basic 06-Vnf With Charm.Execute Day 2 Operationsno0:00:00.0046
 Basic 06-Vnf With Charm.Get Management Ip Addressesno0:00:00.0056
 Basic 06-Vnf With Charm.Instantiate Charm Network Serviceno0:01:09.2546
 Basic 06-Vnf With Charm.Test SSH Accessno0:00:00.0056
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:01.9956
 Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:01.9006
 Basic 07-Secure Key Management.Delete NS Descriptorno0:00:01.9056
 Basic 07-Secure Key Management.Delete NS Instanceno0:16:16.1996
 Basic 07-Secure Key Management.Delete VNF Descriptorno0:00:01.8926
 Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:04.5946
 Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:01:40.7696
 Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0026
 Basic 11-Native Charms.Delete NS Descriptorno0:00:01.8566
 Basic 11-Native Charms.Delete NS Instanceno0:16:17.7186
 Basic 11-Native Charms.Delete VNF Descriptorno0:00:01.9296
 Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0066
 Basic 11-Native Charms.Instantiate Charm Network Serviceno0:01:40.7626
 Basic 11-Native Charms.Test SSH Accessno0:00:00.0076
 Basic 12-Ns Primitives.Check NS Charm Application Nameno0:00:00.0066
 Basic 12-Ns Primitives.Check VDU Charm Application Nameno0:00:00.0056
 Basic 12-Ns Primitives.Delete NSno0:16:18.4656
 Basic 12-Ns Primitives.Delete NS Descriptorno0:00:01.9786
 Basic 12-Ns Primitives.Delete VNF Descriptorsno0:00:01.8846
 Basic 12-Ns Primitives.Instantiate NSno0:01:41.4556
 Basic 13-Ns Relations.Delete NS Descriptorno0:00:01.9376
 Basic 13-Ns Relations.Delete NS Instanceno0:16:02.2956
 Basic 13-Ns Relations.Delete VNF Descriptor Providesno0:00:01.0116
 Basic 13-Ns Relations.Delete VNF Descriptor Requiresno0:00:01.9446
 Basic 13-Ns Relations.Instantiate Charm Network Serviceno0:01:09.2106
 Basic 14-Vnf Relations.Delete NS Descriptorno0:00:01.8856
 Basic 14-Vnf Relations.Delete NS Instanceno0:16:03.8746
 Basic 14-Vnf Relations.Delete VNF Descriptorno0:00:01.9246
 Basic 14-Vnf Relations.Instantiate Charm Network Serviceno0:01:09.1046
 Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0036
 Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0046
 Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0046
 Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptorno0:00:01.8116
 Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instanceno0:16:03.0656
 Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptorno0:00:01.8866
 Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0066
 Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0096
 Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:01:09.1976
 Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0046
 Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0056
 Hackfest Cloudinit.Delete NS Descriptor Testno0:00:01.8266
 Hackfest Cloudinit.Delete NS Instance Testno0:16:04.5286
 Hackfest Cloudinit.Delete VNF Descriptor Testno0:00:01.9156
 Hackfest Multivdu.Delete NS Descriptor Testno0:00:02.0636
 Hackfest Multivdu.Delete NS Instance Testno0:16:03.7096
 Hackfest Multivdu.Delete VNF Descriptor Testno0:00:00.9806
 K8S 03-Simple K8S.Execute Day 2 Operationsno0:00:04.7126
 K8S 03-Simple K8S.Network Service K8s Instance Testno0:00:06.2006
 K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0046
 K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0036
 K8S 05-K8S Proxy Charms.Delete NS Descriptorno0:00:01.8926
 K8S 05-K8S Proxy Charms.Delete NS Instanceno0:16:09.7206
 K8S 05-K8S Proxy Charms.Delete VNF Descriptorno0:00:01.9036
 K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0046
 K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0066
 K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.1436
 K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0086
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:02.0086
 K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:02.1656
 K8S 06-K8S Secure Key Management.Delete NS Descriptorno0:00:01.9496
 K8S 06-K8S Secure Key Management.Delete NS Instanceno0:16:03.5456
 K8S 06-K8S Secure Key Management.Delete VNF Descriptorno0:00:01.8946
 K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:04.6346
 K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:01:09.4836
 K8S 08-Simple K8S Scaling.Check Scale Count After Scale Inno0:00:01.7576
 K8S 08-Simple K8S Scaling.Check Scale Count After Scale Outno0:00:01.7416
 K8S 08-Simple K8S Scaling.Get KDU Model Nameno0:00:00.0046
 K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Outno0:00:02.8186
 K8S 08-Simple K8S Scaling.Network Service K8s Instance Testno0:00:06.2486
 K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Inno0:00:04.6086
 K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Outno0:00:04.7676
 K8S 09-Pebble Charm K8S.Execute Day 2 Operationsno0:00:04.7916
 K8S 09-Pebble Charm K8S.Network Service K8s Instance Testno0:00:05.2756
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0036
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0036
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptorno0:00:01.9306
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instanceno0:16:12.6916
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptorno0:00:01.9196
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0056
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0056
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:01:09.2126
 K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.0086
 K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSMno0:00:37.4996
 K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operationno0:00:00.0036
 K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operationno0:00:00.0086
 K8S 12-Openldap Helm Day-2.Create Network Service Instanceno0:01:09.1086
 K8S 12-Openldap Helm Day-2.Delete NS Descriptor Testno0:00:01.8796
 K8S 12-Openldap Helm Day-2.Delete Network Service Instanceno0:16:04.3336
 K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Testno0:00:01.9646
 K8S 12-Openldap Helm Day-2.Execute Day 2 Operationsno0:00:04.8786
 K8S 12-Openldap Helm Day-2.Get Vnf Idno0:00:01.9186
 K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDUno0:00:00.8056
 K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDUno0:00:00.8656
 K8S 13-Two Helm Kdu.Create Helm OCI Repono0:00:00.0056
 K8S 13-Two Helm Kdu.Create Network Service Instanceno0:00:05.3376
 K8S 13-Two Helm Kdu.Delete Helm OCI Repono0:00:01.7906
 K8S 13-Two Helm Kdu.Delete NS Descriptor Testno0:00:01.8876
 K8S 13-Two Helm Kdu.Delete VNF Descriptor Testno0:00:01.9626
 K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDUno0:00:02.1656
 K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDUno0:00:02.1756
 K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDUno0:00:02.2086
 K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDUno0:00:02.1386
 Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-timeno0:00:00.1326
 Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scalingno0:14:02.0226
 Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Thresholdno0:14:02.0886

Nested Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Basic 12-Ns Primitives6 (±0)9 (±0)0:37:38.943 (-0:00:18.334)
K8S 13-Two Helm Kdu11 (±0)18 (±0)0:02:51.501 (-0:00:01.456)
Basic 07-Secure Key Management7 (±0)12 (±0)0:37:21.337 (+0:00:00.942)
Sa 02-Vnf With Vim Metrics And Autoscaling3 (±0)15 (±0)0:37:09.154 (+0:01:23.561)
K8S 07-Dummy Helm0 (±0)10 (±0)0:02:23.001 (-0:00:00.624)
Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:07:00.338 (+0:01:19.067)
K8S 12-Openldap Helm Day-29 (±0)15 (±0)0:37:46.117 (-0:00:00.031)
K8S 09-Pebble Charm K8S2 (±0)8 (±0)0:00:34.286 (-0:00:00.283)
Basic 13-Ns Relations5 (±0)8 (±0)0:37:03.806 (+0:00:02.412)
Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.149 (-0:00:00.005)
K8S 04-Openldap Helm0 (±0)12 (±0)0:03:10.634 (-0:00:00.036)
Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:27.028 (+0:00:00.287)
Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:13.741 (-0:00:00.614)
Basic 20-Manual Native Charm Vdu Scaling11 (±0)18 (±0)0:35:42.900 (-0:00:14.852)
Hackfest Cloudinit3 (±0)9 (±0)0:21:03.873 (+0:01:04.290)
Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:03:55.477 (-0:00:30.692)
Basic 14-Vnf Relations4 (±0)6 (±0)0:35:40.053 (-0:00:30.657)
Hackfest Multivdu3 (±0)9 (±0)0:20:16.121 (-0:00:00.650)
Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:10:48.059 (+0:00:33.423)
K8S 10-Sol004 Sol007 With K8S Proxy Charms9 (±0)11 (±0)0:35:47.839 (+0:00:09.161)
K8S 08-Simple K8S Scaling7 (±0)12 (±0)0:00:46.340 (-0:00:00.487)
K8S 05-K8S Proxy Charms9 (±0)11 (±0)0:35:45.988 (+0:00:09.762)
K8S 06-K8S Secure Key Management7 (±0)12 (±0)0:36:33.912 (+0:00:00.242)
Basic 06-Vnf With Charm10 (±0)12 (±0)0:36:04.132 (-0:00:31.849)
Hackfest Basic0 (±0)9 (±0)0:03:54.641 (+0:00:32.359)
Basic 11-Native Charms7 (±0)9 (±0)0:36:38.547 (+0:00:00.647)
K8S 02-K8Scluster Creation0 (±0)4 (±0)0:00:46.477 (+0:00:00.139)
K8S 03-Simple K8S2 (±0)8 (±0)0:00:37.045 (+0:00:01.031)