Robot Framework Test Results

Executed:20240218 01:38:27.376
Duration:4:12:34.805 (-0:12:56.077)
Status:0 critical test, 0 passed, 0 failed
530 test total (±0), 436 passed, 94 failed
Results:report.html
log.html
Original result files

Test Result Trend



Show bigger image

Duration Trend


Show bigger image

Failed Test Cases

NameCrit.DurationAge
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:00.0433
 Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0253
 Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operationsno0:00:19.7053
 Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Serviceno0:06:09.1523
 Testsuite.Basic 07-Secure Key Management.Test SSH Accessno0:00:33.0283
 Testsuite.Basic 08-Disable Port Security Network Level.Instantiate Network Serviceno0:05:02.3333
 Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0053
 Testsuite.Basic 11-Native Charms.Get Management Ip Addressesno0:00:00.0113
 Testsuite.Basic 11-Native Charms.Instantiate Charm Network Serviceno0:06:12.7173
 Testsuite.Basic 11-Native Charms.Test SSH Accessno0:00:00.0153
 Testsuite.Basic 12-Ns Primitives.Instantiate NSno0:06:16.7423
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Outno0:00:00.0071
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Outno0:00:00.0051
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling Inno0:00:00.0051
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Outno0:00:00.0041
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Idno0:00:00.0071
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Serviceno0:05:32.9131
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Inno0:00:00.0061
 Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Outno0:00:00.0061
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Check Remote File Created Via Day 2 Operationno0:00:00.0022
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Check Remote Files Created Via Day 1 Operationno0:00:00.0032
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Check Remote Folder Created Via Day 2 Operationno0:00:00.0032
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operationno0:00:00.0052
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Execute Day 2 Operation on Upgraded Charmno0:00:00.0072
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Get Management Ip Addressno0:00:00.0022
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Instantiate Charm Network Serviceno0:06:08.0762
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Set NS Update Configno0:00:00.0052
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Test SSH Accessno0:00:00.0052
 Testsuite.Basic 25-Update Charm In Running Vnf Instance.Update Running VNF Instanceno0:00:00.0072
 Testsuite.Epa 01-Epa Sriov.Check SR-IOV Interfaceno0:00:30.0213
 Testsuite.Epa 01-Epa Sriov.Get VNF IP Addressno0:00:00.0083
 Testsuite.Epa 01-Epa Sriov.Instantiate Network Serviceno0:05:34.3653
 Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-initno0:00:00.0073
 Testsuite.Hackfest Cloudinit.Get Vnf Ip Addressno0:00:00.0043
 Testsuite.Hackfest Cloudinit.Network Service Instance Testno0:05:01.8173
 Testsuite.Hackfest Cloudinit.Test SSH Accessno0:00:30.0083
 Testsuite.Hackfest Multivdu.Get Vnf Ip Addressno0:00:00.0073
 Testsuite.Hackfest Multivdu.Network Service Instance Testno0:05:01.8593
 Testsuite.Hackfest Multivdu.Test Pingno0:00:30.1633
 Testsuite.Hackfest Multivdu.Test SSH Accessno0:00:00.0163
 Testsuite.Heal 01-Volume Vdu Healing.Check VDU Disksno0:00:00.0073
 Testsuite.Heal 01-Volume Vdu Healing.Check VNF After Healingno0:00:00.0093
 Testsuite.Heal 01-Volume Vdu Healing.Delete Persistent Volume VDUno0:00:00.0063
 Testsuite.Heal 01-Volume Vdu Healing.Get NS Idno0:00:00.0053
 Testsuite.Heal 01-Volume Vdu Healing.Get VIM Objectsno0:00:00.0063
 Testsuite.Heal 01-Volume Vdu Healing.Get Volume VNF Infono0:00:00.0053
 Testsuite.Heal 01-Volume Vdu Healing.Get Volumes Infono0:00:01.6593
 Testsuite.Heal 01-Volume Vdu Healing.Heal Persistent Volume VDUno0:00:00.0053
 Testsuite.Heal 01-Volume Vdu Healing.Network Service Instance Testno0:05:02.7393
 Testsuite.Heal 01-Volume Vdu Healing.Update VIM Objectsno0:00:00.0083
 Testsuite.Heal 02-Scale Vdu Healing.Check VNF After Healingno0:00:00.0073
 Testsuite.Heal 02-Scale Vdu Healing.Get Charm VNF Infono0:00:00.0053
 Testsuite.Heal 02-Scale Vdu Healing.Get NS Idno0:00:00.0063
 Testsuite.Heal 02-Scale Vdu Healing.Get VIM Objectsno0:00:00.0073
 Testsuite.Heal 02-Scale Vdu Healing.Halt Charm VDUno0:00:00.0043
 Testsuite.Heal 02-Scale Vdu Healing.Heal Charm VDUno0:00:00.0043
 Testsuite.Heal 02-Scale Vdu Healing.Network Service Instance Testno0:05:02.6913
 Testsuite.Heal 02-Scale Vdu Healing.Scale Out Charm VNFno0:00:00.0063
 Testsuite.Heal 02-Scale Vdu Healing.Update VIM Objectsno0:00:00.0063
 Testsuite.Heal 03-Multiple Healing.Check VNFs After Healingno0:00:00.0072
 Testsuite.Heal 03-Multiple Healing.Get Charm VNF Infono0:00:00.0062
 Testsuite.Heal 03-Multiple Healing.Get NS Idno0:00:00.0062
 Testsuite.Heal 03-Multiple Healing.Get VIM Objectsno0:00:00.0072
 Testsuite.Heal 03-Multiple Healing.Get Volume VNF Infono0:00:00.0052
 Testsuite.Heal 03-Multiple Healing.Heal VDUsno0:00:00.0062
 Testsuite.Heal 03-Multiple Healing.Network Service Instance Testno0:05:33.0372
 Testsuite.Heal 03-Multiple Healing.Scale Out Charm VNFno0:00:00.0062
 Testsuite.Heal 03-Multiple Healing.Stop VDUsno0:00:00.0042
 Testsuite.Heal 03-Multiple Healing.Update VIM Objectsno0:00:00.0062
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0033
 Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0033
 Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0053
 Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0043
 Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Serviceno0:06:12.4963
 Testsuite.K8S 05-K8S Proxy Charms.Test SSH Accessno0:00:00.0053
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operationsno0:00:03.0182
 Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operationsno0:00:03.0172
 Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operationsno0:00:19.7182
 Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Serviceno0:06:10.5122
 Testsuite.K8S 06-K8S Secure Key Management.Test SSH Accessno0:00:33.0262
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operationsno0:00:00.0031
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operationsno0:00:00.0031
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operationsno0:00:00.0041
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addressesno0:00:00.0071
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Serviceno0:06:10.4611
 Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Accessno0:00:00.0061
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metricsno0:09:00.3373
 Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Serviceno0:05:34.3233
 Testsuite.Slice 02-Shared Network Slicing.Network Slice First Instanceno0:06:11.7062
 Testsuite.Slice 02-Shared Network Slicing.Network Slice Second Instanceno0:01:06.3202
 Testsuite.Slice 02-Shared Network Slicing.Test First Slice Connectivityno0:00:00.0512
 Testsuite.Slice 02-Shared Network Slicing.Test Middle Ns Pingno0:01:30.2212
 Testsuite.Slice 02-Shared Network Slicing.Test Middle Vnf SSH Accessno0:00:33.0172
 Testsuite.Slice 02-Shared Network Slicing.Test Second Slice Connectivityno0:00:03.0282

Test Suites

NameFailed tests (diff)Total tests (diff)Duration (diff)
Testsuite94 (+4)530 (±0)4:12:34.805 (-0:12:56.077)
Testsuite.Basic 12-Ns Primitives1 (±0)7 (±0)0:07:32.672 (+0:00:06.939)
Testsuite.Basic 21-Support Of Volumes0 (±0)10 (±0)0:02:20.743 (+0:00:00.017)
Testsuite.Basic 19-Vnf Ip Profile0 (±0)8 (±0)0:01:52.906 (-0:00:00.321)
Testsuite.Heal 01-Volume Vdu Healing10 (±0)16 (±0)0:06:15.593 (-0:00:30.419)
Testsuite.Sol003 01-Vnf-Lifecycle-Management0 (±0)10 (±0)0:01:49.982 (+0:00:00.066)
Testsuite.K8S 07-Dummy Helm0 (±0)10 (±0)0:02:50.008 (+0:00:02.626)
Testsuite.K8S 12-Openldap Helm Day-20 (±0)15 (±0)0:05:03.777 (+0:00:00.017)
Testsuite.Epa 04-Epa Underlay Sriov0 (±0)9 (±0)0:03:20.005 (-0:00:00.707)
Testsuite.Basic 01-Crud Operations On Vim Targets0 (±0)4 (±0)0:01:17.711 (+0:00:05.302)
Testsuite.K8S 09-Pebble Charm K8S0 (±0)10 (±0)0:04:46.043 (+0:00:01.131)
Testsuite.K8S 04-Openldap Helm0 (±0)14 (±0)0:04:12.359 (+0:00:02.267)
Testsuite.Basic 17-Delete Vnf Package0 (±0)5 (±0)0:00:12.867 (-0:00:00.060)
Testsuite.Quotas 01-Quota Enforcement0 (±0)14 (±0)0:01:04.422 (+0:00:00.628)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling8 (+8)18 (±0)0:06:20.707 (-0:02:31.016)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs0 (±0)16 (±0)0:07:09.045 (+0:00:55.746)
Testsuite.Hackfest Cloudinit4 (±0)9 (±0)0:06:32.086 (-0:00:31.030)
Testsuite.Basic 22-Cross Model Relations0 (±0)10 (±0)0:08:27.290 (+0:00:02.008)
Testsuite.Basic 14-Vnf Relations0 (±0)6 (±0)0:04:48.960 (+0:00:00.794)
Testsuite.Hackfest Multivdu4 (±0)9 (±0)0:06:56.958 (+0:00:23.006)
Testsuite.Basic 08-Disable Port Security Network Level1 (±0)9 (±0)0:06:30.100 (-0:00:46.456)
Testsuite.Fail 01-Insufficient Resources0 (±0)6 (±0)0:05:46.686 (-0:00:00.275)
Testsuite.Slice 02-Shared Network Slicing6 (±0)20 (±0)0:12:10.212 (-0:05:20.346)
Testsuite.Sa 01-Vnf With Vim Metrics0 (±0)7 (±0)0:05:12.069 (+0:00:00.990)
Testsuite.Hackfest Basic0 (±0)9 (±0)0:01:46.642 (-0:00:00.384)
Testsuite.K8S 02-K8Scluster Creation0 (±0)2 (±0)0:00:55.706 (+0:00:00.105)
Testsuite.Basic 07-Secure Key Management5 (±0)12 (±0)0:08:11.435 (+0:00:17.373)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling0 (±0)13 (±0)0:08:20.902 (+0:00:00.130)
Testsuite.Basic 18-Ns Ip Profile0 (±0)13 (±0)0:03:51.172 (-0:00:00.920)
Testsuite.Heal 03-Multiple Healing10 (±0)16 (±0)0:06:43.652 (+0:00:30.755)
Testsuite.Basic 09-Manual Vdu Scaling0 (±0)13 (±0)0:02:17.485 (-0:00:00.967)
Testsuite.Heal 02-Scale Vdu Healing9 (±0)15 (±0)0:06:12.299 (-0:00:31.293)
Testsuite.Slice 01-Network Slicing0 (-4)13 (±0)0:04:46.349 (-0:05:14.308)
Testsuite.Basic 13-Ns Relations0 (±0)8 (±0)0:04:57.054 (+0:00:02.488)
Testsuite.Basic 23-Sol004 Sol007 Packages0 (±0)5 (±0)0:00:13.093 (-0:00:01.020)
Testsuite.Basic 15-Rbac Configurations0 (±0)7 (±0)0:00:22.778 (+0:00:00.049)
Testsuite.Epa 03-Crud Operations On Sdnc0 (±0)3 (±0)0:01:05.616 (+0:00:00.018)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init0 (±0)8 (±0)0:02:18.789 (-0:00:00.631)
Testsuite.Basic 16-Advanced Onboarding And Scaling0 (±0)12 (±0)0:02:48.879 (-0:00:00.352)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms6 (+6)11 (±0)0:08:06.834 (+0:02:38.080)
Testsuite.K8S 08-Simple K8S Scaling0 (±0)14 (±0)0:06:03.418 (-0:00:02.332)
Testsuite.K8S 05-K8S Proxy Charms6 (±0)11 (±0)0:08:08.378 (+0:00:02.184)
Testsuite.Epa 01-Epa Sriov3 (±0)8 (±0)0:06:46.206 (-0:00:02.014)
Testsuite.Heal 04-Autohealing0 (±0)14 (±0)0:05:02.173 (-0:00:16.204)
Testsuite.K8S 06-K8S Secure Key Management5 (±0)12 (±0)0:09:10.675 (+0:00:04.924)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp2 (±0)7 (±0)0:15:19.139 (-0:00:16.076)
Testsuite.Basic 06-Vnf With Charm0 (-6)11 (±0)0:04:46.860 (-0:02:03.435)
Testsuite.Basic 24-Affinity Groups0 (±0)7 (±0)0:02:00.343 (-0:00:00.147)
Testsuite.Basic 11-Native Charms4 (±0)9 (±0)0:06:58.541 (+0:00:01.403)
Testsuite.Epa 02-Additional Capabilities0 (±0)9 (±0)0:01:19.343 (+0:00:00.537)
Testsuite.Basic 25-Update Charm In Running Vnf Instance10 (±0)16 (±0)0:06:55.323 (-0:00:01.942)
Testsuite.K8S 03-Simple K8S0 (±0)10 (±0)0:04:32.292 (-0:00:02.994)