Robot Framework Test Results

Executed:	20240225 02:36:13.761
Duration:	3:16:20.503 (-0:11:18.164)
Status:	0 critical test, 0 passed, 0 failed 451 test total (±0), 403 passed, 48 failed
Results:	report.html log.html Original result files

Test Result Trend

Zoom to changes

Show only failed

Show only critical

Max builds

Show bigger image

Duration Trend

Show bigger image

Failed Test Cases

Name	Crit.	Duration	Age
Testsuite.Basic 08-Disable Port Security Network Level.Instantiate Network Service Loading...	no	0:05:01.805	10
Testsuite.Basic 29-Vnf Ipv6 Profile.Check That Ipv6 Address_mode And Ra_mode Are Set Loading...	no	0:00:00.005	10
Testsuite.Basic 29-Vnf Ipv6 Profile.Check Vnf IPs Loading...	no	0:00:00.006	10
Testsuite.Basic 29-Vnf Ipv6 Profile.Get Vnf Info Loading...	no	0:00:00.007	10
Testsuite.Basic 29-Vnf Ipv6 Profile.Instantiate Network Service Loading...	no	0:05:37.258	10
Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf1 IPs Loading...	no	0:00:00.006	2
Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf2 IPs Loading...	no	0:00:00.006	2
Testsuite.Basic 30-Ns Ipv6 Profile.Check that ipv6 address_mode and ra_mode are set Loading...	no	0:00:00.004	2
Testsuite.Basic 30-Ns Ipv6 Profile.Get Vnfs Info Loading...	no	0:00:00.014	2
Testsuite.Basic 30-Ns Ipv6 Profile.Instantiate Network Service Loading...	no	0:05:33.623	2
Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf1 Interfaces Loading...	no	0:00:00.004	2
Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf2 Interfaces Loading...	no	0:00:00.004	2
Testsuite.Epa 01-Epa Sriov.Check SR-IOV Interface Loading...	no	0:00:30.020	10
Testsuite.Epa 01-Epa Sriov.Get VNF IP Address Loading...	no	0:00:00.007	10
Testsuite.Epa 01-Epa Sriov.Instantiate Network Service Loading...	no	0:05:33.881	10
Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-init Loading...	no	0:00:00.010	10
Testsuite.Hackfest Cloudinit.Get Vnf Ip Address Loading...	no	0:00:00.007	10
Testsuite.Hackfest Cloudinit.Network Service Instance Test Loading...	no	0:05:03.005	10
Testsuite.Hackfest Cloudinit.Test SSH Access Loading...	no	0:00:30.010	10
Testsuite.Hackfest Multivdu.Get Vnf Ip Address Loading...	no	0:00:00.013	10
Testsuite.Hackfest Multivdu.Network Service Instance Test Loading...	no	0:05:34.619	10
Testsuite.Hackfest Multivdu.Test Ping Loading...	no	0:00:30.094	10
Testsuite.Hackfest Multivdu.Test SSH Access Loading...	no	0:00:00.014	10
Testsuite.Heal 02-Scale Vdu Healing.Check VNF After Healing Loading...	no	0:00:00.007	53
Testsuite.Heal 02-Scale Vdu Healing.Get Manual Scale VNF Info Loading...	no	0:00:00.005	1
Testsuite.Heal 02-Scale Vdu Healing.Get NS Id Loading...	no	0:00:00.006	1
Testsuite.Heal 02-Scale Vdu Healing.Get VIM Objects Loading...	no	0:00:00.007	1
Testsuite.Heal 02-Scale Vdu Healing.Halt Manual Scale VDU Loading...	no	0:00:00.003	1
Testsuite.Heal 02-Scale Vdu Healing.Heal Manual Scale VDU Loading...	no	0:00:00.006	1
Testsuite.Heal 02-Scale Vdu Healing.Network Service Instance Test Loading...	no	0:06:14.161	1
Testsuite.Heal 02-Scale Vdu Healing.Scale Out Manual Scale VNF Loading...	no	0:00:00.004	1
Testsuite.Heal 02-Scale Vdu Healing.Update VIM Objects Loading...	no	0:00:00.007	1
Testsuite.Heal 03-Multiple Healing.Check VNFs After Healing Loading...	no	0:00:00.006	53
Testsuite.Heal 03-Multiple Healing.Get Manual Scale VNF Info Loading...	no	0:00:00.006	6
Testsuite.Heal 03-Multiple Healing.Get NS Id Loading...	no	0:00:00.009	6
Testsuite.Heal 03-Multiple Healing.Get VIM Objects Loading...	no	0:00:00.008	6
Testsuite.Heal 03-Multiple Healing.Get Volume VNF Info Loading...	no	0:00:00.005	6
Testsuite.Heal 03-Multiple Healing.Heal VDUs Loading...	no	0:00:00.005	6
Testsuite.Heal 03-Multiple Healing.Network Service Instance Test Loading...	no	0:06:13.774	6
Testsuite.Heal 03-Multiple Healing.Scale Out Manual Scale VNF Loading...	no	0:00:00.007	6
Testsuite.Heal 03-Multiple Healing.Stop VDUs Loading...	no	0:00:00.005	6
Testsuite.Heal 03-Multiple Healing.Update VIM Objects Loading...	no	0:00:00.006	6
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metrics Loading...	no	0:09:00.297	9
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Service Loading...	no	0:05:02.169	9
Testsuite.Slice 01-Network Slicing.Network Slice Instance Test Loading...	no	0:06:11.507	7
Testsuite.Slice 01-Network Slicing.Test Middle Ns Ping Loading...	no	0:01:30.186	7
Testsuite.Slice 01-Network Slicing.Test Middle Vnf SSH Access Loading...	no	0:00:33.022	7
Testsuite.Slice 01-Network Slicing.Test Slice Connectivity Loading...	no	0:00:00.058	7

Test Suites

Name	Failed tests (diff)	Total tests (diff)	Duration (diff)
Testsuite	48 (+2)	451 (±0)	3:16:20.503 (-0:11:18.164)
Testsuite.Basic 21-Support Of Volumes	0 (±0)	10 (±0)	0:02:22.934 (-0:00:02.385)
Testsuite.Basic 19-Vnf Ip Profile	0 (±0)	8 (±0)	0:02:09.815 (+0:00:14.041)
Testsuite.K8S 13-Two Helm Kdu	0 (±0)	18 (±0)	0:04:59.256 (-0:00:03.452)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling	0 (±0)	15 (±0)	0:14:24.286 (-0:03:59.592)
Testsuite.Basic 18-Ns Ip Profile	0 (±0)	13 (±0)	0:03:55.598 (+0:00:02.248)
Testsuite.Heal 01-Volume Vdu Healing	0 (±0)	16 (±0)	0:04:48.343 (-0:00:05.937)
Testsuite.Sol003 01-Vnf-Lifecycle-Management	0 (±0)	10 (±0)	0:01:49.899 (-0:00:00.583)
Testsuite.Heal 03-Multiple Healing	10 (±0)	16 (±0)	0:07:22.395 (-0:00:01.583)
Testsuite.K8S 07-Dummy Helm	0 (±0)	10 (±0)	0:02:46.473 (+0:00:00.132)
Testsuite.Sol003 02-Dualstack Ip Vnfm	0 (±0)	9 (±0)	0:01:06.275 (-0:00:01.531)
Testsuite.Basic 09-Manual Vdu Scaling	0 (±0)	13 (±0)	0:02:17.627 (-0:00:02.082)
Testsuite.Heal 02-Scale Vdu Healing	9 (+8)	16 (±0)	0:07:27.735 (+0:02:27.780)
Testsuite.Epa 04-Epa Underlay Sriov	0 (±0)	9 (±0)	0:02:53.749 (+0:00:00.596)
Testsuite.Basic 01-Crud Operations On Vim Targets	0 (±0)	4 (±0)	0:00:54.079 (-0:00:00.033)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance	0 (±0)	16 (±0)	0:04:20.079 (-0:00:04.781)
Testsuite.Basic 29-Vnf Ipv6 Profile	4 (±0)	9 (±0)	0:06:37.917 (+0:00:15.270)
Testsuite.Basic 30-Ns Ipv6 Profile	7 (±0)	12 (±0)	0:07:11.323 (+0:00:11.918)
Testsuite.Slice 01-Network Slicing	4 (±0)	13 (±0)	0:09:59.328 (-0:00:01.897)
Testsuite.Basic 23-Sol004 Sol007 Packages	0 (±0)	5 (±0)	0:00:13.678 (+0:00:00.187)
Testsuite.K8S 04-Openldap Helm	0 (±0)	12 (±0)	0:03:14.204 (-0:00:00.263)
Testsuite.Basic 15-Rbac Configurations	0 (±0)	7 (±0)	0:00:24.128 (-0:00:00.128)
Testsuite.Basic 17-Delete Vnf Package	0 (±0)	5 (±0)	0:00:13.579 (+0:00:00.064)
Testsuite.Quotas 01-Quota Enforcement	0 (±0)	14 (±0)	0:01:06.869 (+0:00:00.450)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs	0 (±0)	16 (±0)	0:12:35.720 (-0:00:17.417)
Testsuite.Hackfest Cloudinit	4 (±0)	9 (±0)	0:06:51.708 (-0:00:01.048)
Testsuite.Epa 03-Crud Operations On Sdnc	0 (±0)	3 (±0)	0:01:09.294 (-0:00:00.258)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init	0 (±0)	8 (±0)	0:02:19.034 (-0:00:03.071)
Testsuite.Hackfest Multivdu	4 (±0)	9 (±0)	0:07:06.509 (+0:00:08.414)
Testsuite.Basic 16-Advanced Onboarding And Scaling	0 (±0)	12 (±0)	0:02:15.709 (-0:00:36.163)
Testsuite.Basic 31-Multivdu Volume Multiattach	0 (±0)	9 (±0)	0:03:19.251 (+0:00:01.108)
Testsuite.Lcmop 01-Cancel Operation Basic	0 (±0)	9 (±0)	0:00:47.397 (-0:00:03.180)
Testsuite.Basic 08-Disable Port Security Network Level	1 (±0)	9 (±0)	0:07:41.140 (-0:00:00.372)
Testsuite.Fail 01-Insufficient Resources	0 (±0)	6 (±0)	0:05:48.190 (-0:00:04.044)
Testsuite.Epa 01-Epa Sriov	3 (±0)	8 (±0)	0:06:45.788 (+0:00:09.577)
Testsuite.Basic 28-Keep Persistent Volumes	0 (±0)	16 (±0)	0:03:45.647 (-0:00:01.152)
Testsuite.Slice 02-Shared Network Slicing	0 (-6)	20 (±0)	0:06:53.494 (-0:10:19.662)
Testsuite.Sa 01-Vnf With Vim Metrics	0 (±0)	7 (±0)	0:07:11.961 (-0:00:02.895)
Testsuite.Heal 04-Autohealing	0 (±0)	14 (±0)	0:08:10.113 (+0:01:01.541)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp	2 (±0)	7 (±0)	0:14:48.431 (-0:00:00.191)
Testsuite.Basic 24-Affinity Groups	0 (±0)	7 (±0)	0:02:01.246 (-0:00:01.752)
Testsuite.Hackfest Basic	0 (±0)	9 (±0)	0:01:47.663 (+0:00:01.064)
Testsuite.Epa 02-Additional Capabilities	0 (±0)	9 (±0)	0:01:22.400 (+0:00:03.001)
Testsuite.K8S 02-K8Scluster Creation	0 (±0)	4 (±0)	0:01:00.054 (-0:00:00.077)