Robot Framework Test Results

Executed:	20240222 01:38:15.106
Duration:	4:23:06.622 (-0:11:10.809)
Status:	0 critical test, 0 passed, 0 failed 530 test total (±0), 449 passed, 81 failed
Results:	report.html log.html Original result files

Test Result Trend

Zoom to changes

Show only failed

Show only critical

Max builds

Show bigger image

Duration Trend

Show bigger image

Failed Test Cases

Name	Crit.	Duration	Age
Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.003	1
Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:00.003	1
Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operations Loading...	no	0:00:00.003	1
Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addresses Loading...	no	0:00:00.004	1
Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Service Loading...	no	0:06:07.799	1
Testsuite.Basic 06-Vnf With Charm.Test SSH Access Loading...	no	0:00:00.005	1
Testsuite.Basic 08-Disable Port Security Network Level.Instantiate Network Service Loading...	no	0:05:33.436	7
Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.016	3
Testsuite.Basic 11-Native Charms.Get Management Ip Addresses Loading...	no	0:00:00.006	3
Testsuite.Basic 11-Native Charms.Instantiate Charm Network Service Loading...	no	0:06:10.406	3
Testsuite.Basic 11-Native Charms.Test SSH Access Loading...	no	0:00:00.008	3
Testsuite.Basic 12-Ns Primitives.Instantiate NS Loading...	no	0:06:14.837	7
Testsuite.Epa 01-Epa Sriov.Check SR-IOV Interface Loading...	no	0:00:30.028	7
Testsuite.Epa 01-Epa Sriov.Get VNF IP Address Loading...	no	0:00:00.006	7
Testsuite.Epa 01-Epa Sriov.Instantiate Network Service Loading...	no	0:05:32.508	7
Testsuite.Hackfest Cloudinit.Check Remote File Injected Via Cloud-init Loading...	no	0:00:00.009	7
Testsuite.Hackfest Cloudinit.Get Vnf Ip Address Loading...	no	0:00:00.006	7
Testsuite.Hackfest Cloudinit.Network Service Instance Test Loading...	no	0:05:33.905	7
Testsuite.Hackfest Cloudinit.Test SSH Access Loading...	no	0:00:30.018	7
Testsuite.Hackfest Multivdu.Get Vnf Ip Address Loading...	no	0:00:00.007	7
Testsuite.Hackfest Multivdu.Network Service Instance Test Loading...	no	0:05:32.366	7
Testsuite.Hackfest Multivdu.Test Ping Loading...	no	0:00:30.166	7
Testsuite.Hackfest Multivdu.Test SSH Access Loading...	no	0:00:00.011	7
Testsuite.Heal 01-Volume Vdu Healing.Check VDU Disks Loading...	no	0:00:00.006	3
Testsuite.Heal 01-Volume Vdu Healing.Check VNF After Healing Loading...	no	0:00:00.010	3
Testsuite.Heal 01-Volume Vdu Healing.Delete Persistent Volume VDU Loading...	no	0:00:00.004	3
Testsuite.Heal 01-Volume Vdu Healing.Get NS Id Loading...	no	0:00:00.007	3
Testsuite.Heal 01-Volume Vdu Healing.Get VIM Objects Loading...	no	0:00:00.007	3
Testsuite.Heal 01-Volume Vdu Healing.Get Volume VNF Info Loading...	no	0:00:00.006	3
Testsuite.Heal 01-Volume Vdu Healing.Get Volumes Info Loading...	no	0:00:01.644	3
Testsuite.Heal 01-Volume Vdu Healing.Heal Persistent Volume VDU Loading...	no	0:00:00.005	3
Testsuite.Heal 01-Volume Vdu Healing.Network Service Instance Test Loading...	no	0:05:03.486	3
Testsuite.Heal 01-Volume Vdu Healing.Update VIM Objects Loading...	no	0:00:00.009	3
Testsuite.Heal 02-Scale Vdu Healing.Check VNF After Healing Loading...	no	0:00:00.006	7
Testsuite.Heal 02-Scale Vdu Healing.Get Charm VNF Info Loading...	no	0:00:00.005	7
Testsuite.Heal 02-Scale Vdu Healing.Get NS Id Loading...	no	0:00:00.005	7
Testsuite.Heal 02-Scale Vdu Healing.Get VIM Objects Loading...	no	0:00:00.007	7
Testsuite.Heal 02-Scale Vdu Healing.Halt Charm VDU Loading...	no	0:00:00.004	7
Testsuite.Heal 02-Scale Vdu Healing.Heal Charm VDU Loading...	no	0:00:00.004	7
Testsuite.Heal 02-Scale Vdu Healing.Network Service Instance Test Loading...	no	0:05:32.289	7
Testsuite.Heal 02-Scale Vdu Healing.Scale Out Charm VNF Loading...	no	0:00:00.004	7
Testsuite.Heal 02-Scale Vdu Healing.Update VIM Objects Loading...	no	0:00:00.007	7
Testsuite.Heal 03-Multiple Healing.Check VNFs After Healing Loading...	no	0:00:00.006	1
Testsuite.Heal 03-Multiple Healing.Get Charm VNF Info Loading...	no	0:00:00.004	1
Testsuite.Heal 03-Multiple Healing.Get NS Id Loading...	no	0:00:00.006	1
Testsuite.Heal 03-Multiple Healing.Get VIM Objects Loading...	no	0:00:00.006	1
Testsuite.Heal 03-Multiple Healing.Get Volume VNF Info Loading...	no	0:00:00.006	1
Testsuite.Heal 03-Multiple Healing.Heal VDUs Loading...	no	0:00:00.004	1
Testsuite.Heal 03-Multiple Healing.Network Service Instance Test Loading...	no	0:05:32.937	1
Testsuite.Heal 03-Multiple Healing.Scale Out Charm VNF Loading...	no	0:00:00.006	1
Testsuite.Heal 03-Multiple Healing.Stop VDUs Loading...	no	0:00:00.003	1
Testsuite.Heal 03-Multiple Healing.Update VIM Objects Loading...	no	0:00:00.006	1
Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.003	2
Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:00.003	2
Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operations Loading...	no	0:00:00.004	2
Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addresses Loading...	no	0:00:00.007	2
Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Service Loading...	no	0:06:10.716	2
Testsuite.K8S 05-K8S Proxy Charms.Test SSH Access Loading...	no	0:00:00.006	2
Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.051	6
Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:03.015	6
Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operations Loading...	no	0:00:19.599	6
Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Service Loading...	no	0:06:09.395	6
Testsuite.K8S 06-K8S Secure Key Management.Test SSH Access Loading...	no	0:00:33.027	6
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.003	3
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:00.004	3
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operations Loading...	no	0:00:00.006	3
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addresses Loading...	no	0:00:00.006	3
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Service Loading...	no	0:06:07.736	3
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Access Loading...	no	0:00:00.007	3
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Get VNF SNMP Metrics Loading...	no	0:09:00.327	7
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp.Instantiate Network Service Loading...	no	0:05:33.465	7
Testsuite.Slice 01-Network Slicing.Network Slice Instance Test Loading...	no	0:06:11.449	2
Testsuite.Slice 01-Network Slicing.Test Middle Ns Ping Loading...	no	0:01:30.209	2
Testsuite.Slice 01-Network Slicing.Test Middle Vnf SSH Access Loading...	no	0:00:33.025	2
Testsuite.Slice 01-Network Slicing.Test Slice Connectivity Loading...	no	0:00:00.075	2
Testsuite.Slice 02-Shared Network Slicing.Network Slice First Instance Loading...	no	0:06:11.556	6
Testsuite.Slice 02-Shared Network Slicing.Network Slice Second Instance Loading...	no	0:06:12.396	6
Testsuite.Slice 02-Shared Network Slicing.Test First Slice Connectivity Loading...	no	0:00:00.062	6
Testsuite.Slice 02-Shared Network Slicing.Test Middle Ns Ping Loading...	no	0:01:30.217	6
Testsuite.Slice 02-Shared Network Slicing.Test Middle Vnf SSH Access Loading...	no	0:00:33.016	6
Testsuite.Slice 02-Shared Network Slicing.Test Second Slice Connectivity Loading...	no	0:00:03.018	6

Test Suites

Name	Failed tests (diff)	Total tests (diff)	Duration (diff)
Testsuite	81 (-7)	530 (±0)	4:23:06.622 (-0:11:10.809)
Testsuite.Basic 12-Ns Primitives	1 (±0)	7 (±0)	0:07:29.738 (+0:00:13.425)
Testsuite.Basic 21-Support Of Volumes	0 (±0)	10 (±0)	0:02:21.881 (+0:00:00.156)
Testsuite.Basic 19-Vnf Ip Profile	0 (±0)	8 (±0)	0:01:51.708 (-0:00:00.720)
Testsuite.Heal 01-Volume Vdu Healing	10 (±0)	16 (±0)	0:06:15.398 (-0:00:02.348)
Testsuite.Sol003 01-Vnf-Lifecycle-Management	0 (±0)	10 (±0)	0:01:50.052 (+0:00:00.036)
Testsuite.K8S 07-Dummy Helm	0 (±0)	10 (±0)	0:02:46.924 (-0:00:02.158)
Testsuite.K8S 12-Openldap Helm Day-2	0 (±0)	15 (±0)	0:05:03.506 (+0:00:01.364)
Testsuite.Epa 04-Epa Underlay Sriov	0 (±0)	9 (±0)	0:03:20.268 (-0:00:00.863)
Testsuite.Basic 01-Crud Operations On Vim Targets	0 (±0)	4 (±0)	0:01:16.949 (+0:00:29.261)
Testsuite.K8S 09-Pebble Charm K8S	0 (±0)	10 (±0)	0:04:47.049 (+0:00:17.786)
Testsuite.K8S 04-Openldap Helm	0 (±0)	14 (±0)	0:04:09.983 (-0:00:03.012)
Testsuite.Basic 17-Delete Vnf Package	0 (±0)	5 (±0)	0:00:12.808 (-0:00:01.030)
Testsuite.Quotas 01-Quota Enforcement	0 (±0)	14 (±0)	0:01:03.459 (-0:00:00.719)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling	0 (-8)	18 (±0)	0:09:03.841 (+0:02:40.962)
Testsuite.Sa 07-Alarms From Sa-Related Vnfs	0 (±0)	16 (±0)	0:06:09.602 (-0:00:00.843)
Testsuite.Hackfest Cloudinit	4 (±0)	9 (±0)	0:07:03.812 (-0:00:00.006)
Testsuite.Basic 22-Cross Model Relations	0 (±0)	10 (±0)	0:08:25.602 (-0:00:00.130)
Testsuite.Basic 14-Vnf Relations	0 (±0)	6 (±0)	0:04:48.994 (-0:00:02.545)
Testsuite.Hackfest Multivdu	4 (±0)	9 (±0)	0:07:05.289 (+0:00:00.589)
Testsuite.Basic 08-Disable Port Security Network Level	1 (±0)	9 (±0)	0:07:30.668 (+0:00:14.480)
Testsuite.Fail 01-Insufficient Resources	0 (±0)	6 (±0)	0:05:44.403 (-0:00:00.248)
Testsuite.Slice 02-Shared Network Slicing	6 (±0)	20 (±0)	0:17:31.328 (-0:00:01.225)
Testsuite.Sa 01-Vnf With Vim Metrics	0 (±0)	7 (±0)	0:03:11.159 (-0:02:01.866)
Testsuite.Hackfest Basic	0 (±0)	9 (±0)	0:01:46.471 (+0:00:00.190)
Testsuite.K8S 02-K8Scluster Creation	0 (±0)	2 (±0)	0:00:55.242 (-0:00:00.284)
Testsuite.Basic 07-Secure Key Management	0 (-5)	12 (±0)	0:03:48.081 (-0:04:01.317)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling	0 (±0)	13 (±0)	0:11:21.238 (+0:01:00.750)
Testsuite.Basic 18-Ns Ip Profile	0 (±0)	13 (±0)	0:03:17.001 (-0:00:34.720)
Testsuite.Heal 03-Multiple Healing	10 (+10)	16 (±0)	0:06:43.221 (-0:09:02.691)
Testsuite.Basic 09-Manual Vdu Scaling	0 (±0)	13 (±0)	0:02:16.685 (-0:00:00.761)
Testsuite.Heal 02-Scale Vdu Healing	9 (±0)	15 (±0)	0:06:42.028 (-0:00:02.921)
Testsuite.Slice 01-Network Slicing	4 (±0)	13 (±0)	0:10:00.147 (-0:00:00.026)
Testsuite.Basic 13-Ns Relations	0 (±0)	8 (±0)	0:04:54.483 (+0:00:00.160)
Testsuite.Basic 23-Sol004 Sol007 Packages	0 (±0)	5 (±0)	0:00:13.177 (+0:00:00.257)
Testsuite.Basic 15-Rbac Configurations	0 (±0)	7 (±0)	0:00:22.964 (+0:00:00.214)
Testsuite.Epa 03-Crud Operations On Sdnc	0 (±0)	3 (±0)	0:01:05.753 (-0:00:00.032)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init	0 (±0)	8 (±0)	0:02:17.713 (-0:00:01.794)
Testsuite.Basic 16-Advanced Onboarding And Scaling	0 (±0)	12 (±0)	0:02:47.891 (-0:00:02.428)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms	6 (±0)	11 (±0)	0:08:02.919 (-0:00:03.367)
Testsuite.K8S 08-Simple K8S Scaling	0 (±0)	14 (±0)	0:06:01.912 (+0:00:17.179)
Testsuite.K8S 05-K8S Proxy Charms	6 (±0)	11 (±0)	0:08:06.583 (-0:00:19.498)
Testsuite.Epa 01-Epa Sriov	3 (±0)	8 (±0)	0:06:43.551 (-0:00:01.595)
Testsuite.Heal 04-Autohealing	0 (±0)	14 (±0)	0:05:20.457 (+0:00:18.872)
Testsuite.K8S 06-K8S Secure Key Management	5 (±0)	12 (±0)	0:09:04.293 (+0:00:00.076)
Testsuite.Sa 08-Vnf With Vnf Indicators Snmp	2 (±0)	7 (±0)	0:15:33.931 (+0:00:17.157)
Testsuite.Basic 06-Vnf With Charm	6 (+6)	11 (±0)	0:07:10.203 (+0:02:22.599)
Testsuite.Basic 24-Affinity Groups	0 (±0)	7 (±0)	0:01:59.067 (-0:00:01.446)
Testsuite.Basic 11-Native Charms	4 (±0)	9 (±0)	0:06:55.664 (-0:00:21.694)
Testsuite.Epa 02-Additional Capabilities	0 (±0)	9 (±0)	0:01:18.468 (+0:00:01.067)
Testsuite.Basic 25-Update Charm In Running Vnf Instance	0 (-10)	16 (±0)	0:04:43.137 (-0:02:30.230)
Testsuite.K8S 03-Simple K8S	0 (±0)	10 (±0)	0:04:29.691 (-0:00:04.872)