Robot Framework Test Results

Executed:	20240218 02:38:20.272
Duration:	3:19:27.564 (-0:07:51.698)
Status:	0 critical test, 0 passed, 0 failed 451 test total (±0), 410 passed, 41 failed
Results:	report.html log.html Original result files

Test Result Trend

Zoom to changes

Show only failed

Show only critical

Max builds

Show bigger image

Duration Trend

Show bigger image

Failed Test Cases

Name	Crit.	Duration	Age
Testsuite.Basic 08-Disable Port Security Network Level.Instantiate Network Service Loading...	no	0:05:04.576	3
Testsuite.Basic 29-Vnf Ipv6 Profile.Check That Ipv6 Address_mode And Ra_mode Are Set Loading...	no	0:00:00.006	3
Testsuite.Basic 29-Vnf Ipv6 Profile.Check Vnf IPs Loading...	no	0:00:00.006	3
Testsuite.Basic 29-Vnf Ipv6 Profile.Get Vnf Info Loading...	no	0:00:00.008	3
Testsuite.Basic 29-Vnf Ipv6 Profile.Instantiate Network Service Loading...	no	0:05:03.296	3
Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf1 IPs Loading...	no	0:00:00.005	2
Testsuite.Basic 30-Ns Ipv6 Profile.Check Vnf2 IPs Loading...	no	0:00:00.004	2
Testsuite.Basic 30-Ns Ipv6 Profile.Check that ipv6 address_mode and ra_mode are set Loading...	no	0:00:00.003	2
Testsuite.Basic 30-Ns Ipv6 Profile.Get Vnfs Info Loading...	no	0:00:00.016	2
Testsuite.Basic 30-Ns Ipv6 Profile.Instantiate Network Service Loading...	no	0:05:01.965	2
Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf1 Interfaces Loading...	no	0:00:00.004	2
Testsuite.Basic 30-Ns Ipv6 Profile.Verify Vnf2 Interfaces Loading...	no	0:00:00.004	2
Testsuite.Epa 01-Epa Sriov.Check SR-IOV Interface Loading...	no	0:00:30.018	3
Testsuite.Epa 01-Epa Sriov.Get VNF IP Address Loading...	no	0:00:00.006	3
Testsuite.Epa 01-Epa Sriov.Instantiate Network Service Loading...	no	0:05:02.944	3
Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-init Loading...	no	0:00:00.010	3
Testsuite.Hackfest Cloudinit.Get Vnf Ip Address Loading...	no	0:00:00.007	3
Testsuite.Hackfest Cloudinit.Network Service Instance Test Loading...	no	0:05:02.474	3
Testsuite.Hackfest Cloudinit.Test SSH Access Loading...	no	0:00:30.014	3
Testsuite.Hackfest Multivdu.Get Vnf Ip Address Loading...	no	0:00:00.007	3
Testsuite.Hackfest Multivdu.Network Service Instance Test Loading...	no	0:05:02.709	3
Testsuite.Hackfest Multivdu.Test Ping Loading...	no	0:00:30.099	3
Testsuite.Hackfest Multivdu.Test SSH Access Loading...	no	0:00:00.013	3
Testsuite.Heal 02-Scale Vdu Healing.Check VNF After Healing Loading...	no	0:00:00.006	46
Testsuite.Heal 02-Scale Vdu Healing.Get Manual Scale VNF Info Loading...	no	0:00:00.006	3
Testsuite.Heal 02-Scale Vdu Healing.Get NS Id Loading...	no	0:00:00.009	3
Testsuite.Heal 02-Scale Vdu Healing.Get VIM Objects Loading...	no	0:00:00.008	3
Testsuite.Heal 02-Scale Vdu Healing.Halt Manual Scale VDU Loading...	no	0:00:00.003	3
Testsuite.Heal 02-Scale Vdu Healing.Heal Manual Scale VDU Loading...	no	0:00:00.004	3
Testsuite.Heal 02-Scale Vdu Healing.Network Service Instance Test Loading...	no	0:06:14.022	3
Testsuite.Heal 02-Scale Vdu Healing.Scale Out Manual Scale VNF Loading...	no	0:00:00.007	3
Testsuite.Heal 02-Scale Vdu Healing.Update VIM Objects Loading...	no	0:00:00.006	3
Testsuite.Heal 03-Multiple Healing.Check VNFs After Healing Loading...	no	0:00:10.701	46
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metrics Loading...	no	0:09:00.314	2
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Service Loading...	no	0:05:02.282	2
Testsuite.Slice 02-Shared Network Slicing.Network Slice First Instance Loading...	no	0:06:11.567	2
Testsuite.Slice 02-Shared Network Slicing.Network Slice Second Instance Loading...	no	0:06:12.245	2
Testsuite.Slice 02-Shared Network Slicing.Test First Slice Connectivity Loading...	no	0:00:00.070	2
Testsuite.Slice 02-Shared Network Slicing.Test Middle Ns Ping Loading...	no	0:01:30.180	2
Testsuite.Slice 02-Shared Network Slicing.Test Middle Vnf SSH Access Loading...	no	0:00:33.012	2
Testsuite.Slice 02-Shared Network Slicing.Test Second Slice Connectivity Loading...	no	0:00:03.011	2

Test Suites

Name	Failed tests (diff)	Total tests (diff)	Duration (diff)
Testsuite	41 (-14)	451 (±0)	3:19:27.564 (-0:07:51.698)
Testsuite.Basic 21-Support Of Volumes	0 (±0)	10 (±0)	0:02:23.162 (-0:00:02.329)
Testsuite.Basic 19-Vnf Ip Profile	0 (±0)	8 (±0)	0:01:53.803 (-0:00:02.126)
Testsuite.K8S 13-Two Helm Kdu	0 (±0)	18 (±0)	0:04:59.440 (-0:00:17.391)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling	0 (±0)	15 (±0)	0:14:23.803 (+0:01:00.664)
Testsuite.Basic 18-Ns Ip Profile	0 (±0)	13 (±0)	0:03:19.856 (-0:00:36.276)
Testsuite.Heal 01-Volume Vdu Healing	0 (-10)	16 (±0)	0:04:48.205 (-0:02:39.726)
Testsuite.Sol003 01-Vnf-Lifecycle-Management	0 (±0)	10 (±0)	0:01:49.931 (+0:00:00.356)
Testsuite.Heal 03-Multiple Healing	1 (±0)	16 (±0)	0:05:29.266 (-0:00:03.387)
Testsuite.K8S 07-Dummy Helm	0 (±0)	10 (±0)	0:02:46.290 (+0:00:00.177)
Testsuite.Sol003 02-Dualstack Ip Vnfm	0 (±0)	9 (±0)	0:01:07.636 (+0:00:01.122)
Testsuite.Basic 09-Manual Vdu Scaling	0 (±0)	13 (±0)	0:02:19.774 (+0:00:01.560)
Testsuite.Heal 02-Scale Vdu Healing	9 (±0)	16 (±0)	0:07:28.147 (-0:00:00.795)
Testsuite.Epa 04-Epa Underlay Sriov	0 (±0)	9 (±0)	0:02:51.963 (-0:00:03.011)
Testsuite.Basic 01-Crud Operations On Vim Targets	0 (±0)	4 (±0)	0:00:38.986 (-0:00:15.209)
Testsuite.Basic 27-Update Helm Ee In Running Vnf Instance	0 (±0)	16 (±0)	0:04:22.597 (-0:00:02.679)
Testsuite.Basic 29-Vnf Ipv6 Profile	4 (±0)	9 (±0)	0:07:00.165 (+0:00:38.925)
Testsuite.Basic 30-Ns Ipv6 Profile	7 (±0)	12 (±0)	0:06:57.938 (-0:00:18.237)
Testsuite.Slice 01-Network Slicing	0 (-4)	13 (±0)	0:04:47.219 (-0:05:14.131)
Testsuite.Basic 23-Sol004 Sol007 Packages	0 (±0)	5 (±0)	0:00:12.645 (-0:00:00.627)
Testsuite.K8S 04-Openldap Helm	0 (±0)	12 (±0)	0:03:15.469 (+0:00:00.490)
Testsuite.Basic 15-Rbac Configurations	0 (±0)	7 (±0)	0:00:24.062 (-0:00:00.010)
Testsuite.Basic 17-Delete Vnf Package	0 (±0)	5 (±0)	0:00:13.315 (+0:00:00.753)
Testsuite.Quotas 01-Quota Enforcement	0 (±0)	14 (±0)	0:01:05.273 (-0:00:01.927)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs	0 (±0)	16 (±0)	0:11:56.564 (-0:00:57.566)
Testsuite.Hackfest Cloudinit	4 (±0)	9 (±0)	0:06:51.567 (-0:00:02.441)
Testsuite.Epa 03-Crud Operations On Sdnc	0 (±0)	3 (±0)	0:01:09.905 (+0:00:00.078)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init	0 (±0)	8 (±0)	0:02:22.096 (+0:00:02.349)
Testsuite.Hackfest Multivdu	4 (±0)	9 (±0)	0:06:53.778 (+0:00:00.693)
Testsuite.Basic 16-Advanced Onboarding And Scaling	0 (±0)	12 (±0)	0:02:16.812 (-0:00:34.245)
Testsuite.Basic 31-Multivdu Volume Multiattach	0 (±0)	9 (±0)	0:03:19.025 (+0:00:01.766)
Testsuite.Lcmop 01-Cancel Operation Basic	0 (±0)	9 (±0)	0:01:53.281 (+0:01:05.156)
Testsuite.Basic 08-Disable Port Security Network Level	1 (±0)	9 (±0)	0:07:45.406 (-0:00:24.649)
Testsuite.Fail 01-Insufficient Resources	0 (±0)	6 (±0)	0:05:49.810 (-0:00:00.887)
Testsuite.Epa 01-Epa Sriov	3 (±0)	8 (±0)	0:06:36.519 (+0:00:03.445)
Testsuite.Basic 28-Keep Persistent Volumes	0 (±0)	16 (±0)	0:03:46.477 (+0:00:33.456)
Testsuite.Slice 02-Shared Network Slicing	6 (±0)	20 (±0)	0:17:30.499 (+0:00:15.877)
Testsuite.Sa 01-Vnf With Vim Metrics	0 (±0)	7 (±0)	0:09:13.832 (+0:01:00.804)
Testsuite.Heal 04-Autohealing	0 (±0)	14 (±0)	0:06:22.873 (-0:01:02.307)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp	2 (±0)	7 (±0)	0:14:47.140 (-0:00:01.950)
Testsuite.Basic 24-Affinity Groups	0 (±0)	7 (±0)	0:01:59.451 (-0:00:02.169)
Testsuite.Hackfest Basic	0 (±0)	9 (±0)	0:01:49.736 (+0:00:01.639)
Testsuite.Epa 02-Additional Capabilities	0 (±0)	9 (±0)	0:01:23.068 (+0:00:02.367)
Testsuite.K8S 02-K8Scluster Creation	0 (±0)	4 (±0)	0:01:00.557 (+0:00:00.670)