Robot Framework Test Results

Executed:	20231231 12:32:48.429
Duration:	8:38:27.208 (+0:04:20.458)
Status:	0 critical test, 0 passed, 0 failed 287 test total (±0), 172 passed, 115 failed
Results:	report.html log.html Original result files

Test Result Trend

Zoom to changes

Show only failed

Show only critical

Max builds

Show bigger image

Duration Trend

Show bigger image

Failed Test Cases

Name	Crit.	Duration	Age
Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.002	4
Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:00.003	4
Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Name Loading...	no	0:00:00.005	4
Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptor Loading...	no	0:00:01.854	4
Testsuite.Basic 06-Vnf With Charm.Delete NS Instance Loading...	no	0:16:04.714	4
Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptor Loading...	no	0:00:01.867	4
Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operations Loading...	no	0:00:00.004	4
Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addresses Loading...	no	0:00:00.003	4
Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Service Loading...	no	0:01:41.619	4
Testsuite.Basic 06-Vnf With Charm.Test SSH Access Loading...	no	0:00:00.005	4
Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:01.911	4
Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:01.920	4
Testsuite.Basic 07-Secure Key Management.Delete NS Descriptor Loading...	no	0:00:01.900	4
Testsuite.Basic 07-Secure Key Management.Delete NS Instance Loading...	no	0:16:04.929	4
Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptor Loading...	no	0:00:01.972	4
Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operations Loading...	no	0:00:04.733	4
Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Service Loading...	no	0:01:40.977	4
Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.003	4
Testsuite.Basic 11-Native Charms.Delete NS Descriptor Loading...	no	0:00:01.918	4
Testsuite.Basic 11-Native Charms.Delete NS Instance Loading...	no	0:16:06.372	4
Testsuite.Basic 11-Native Charms.Delete VNF Descriptor Loading...	no	0:00:01.020	4
Testsuite.Basic 11-Native Charms.Get Management Ip Addresses Loading...	no	0:00:00.003	4
Testsuite.Basic 11-Native Charms.Instantiate Charm Network Service Loading...	no	0:01:09.523	4
Testsuite.Basic 11-Native Charms.Test SSH Access Loading...	no	0:00:00.004	4
Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Name Loading...	no	0:00:00.006	4
Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Name Loading...	no	0:00:00.005	4
Testsuite.Basic 12-Ns Primitives.Delete NS Loading...	no	0:16:06.715	4
Testsuite.Basic 12-Ns Primitives.Delete NS Descriptor Loading...	no	0:00:01.904	4
Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptors Loading...	no	0:00:01.929	4
Testsuite.Basic 12-Ns Primitives.Instantiate NS Loading...	no	0:02:12.280	4
Testsuite.Basic 13-Ns Relations.Delete NS Descriptor Loading...	no	0:00:01.916	4
Testsuite.Basic 13-Ns Relations.Delete NS Instance Loading...	no	0:16:05.881	4
Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Provides Loading...	no	0:00:02.001	4
Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requires Loading...	no	0:00:00.915	4
Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Service Loading...	no	0:01:09.534	4
Testsuite.Basic 14-Vnf Relations.Delete NS Descriptor Loading...	no	0:00:01.912	4
Testsuite.Basic 14-Vnf Relations.Delete NS Instance Loading...	no	0:16:06.271	4
Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptor Loading...	no	0:00:01.982	3
Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Service Loading...	no	0:01:09.504	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Out Loading...	no	0:00:00.005	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Out Loading...	no	0:00:00.005	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling In Loading...	no	0:00:00.008	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptor Loading...	no	0:00:01.891	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instance Loading...	no	0:16:06.769	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptor Loading...	no	0:00:01.980	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Out Loading...	no	0:00:00.004	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Id Loading...	no	0:00:00.009	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Service Loading...	no	0:01:41.231	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale In Loading...	no	0:00:00.011	4
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Out Loading...	no	0:00:00.008	4
Testsuite.Hackfest Cloudinit.Delete NS Descriptor Test Loading...	no	0:00:01.894	4
Testsuite.Hackfest Cloudinit.Delete NS Instance Test Loading...	no	0:16:07.279	4
Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Test Loading...	no	0:00:01.970	4
Testsuite.Hackfest Multivdu.Delete NS Descriptor Test Loading...	no	0:00:01.931	4
Testsuite.Hackfest Multivdu.Delete NS Instance Test Loading...	no	0:16:07.650	4
Testsuite.Hackfest Multivdu.Delete VNF Descriptor Test Loading...	no	0:00:01.972	4
Testsuite.K8S 03-Simple K8S.Execute Day 2 Operations Loading...	no	0:00:04.786	4
Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Test Loading...	no	0:00:06.660	4
Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.003	4
Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:00.002	4
Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptor Loading...	no	0:00:01.935	4
Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instance Loading...	no	0:16:15.855	4
Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptor Loading...	no	0:00:02.015	4
Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operations Loading...	no	0:00:00.003	4
Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addresses Loading...	no	0:00:00.003	4
Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Service Loading...	no	0:01:09.702	4
Testsuite.K8S 05-K8S Proxy Charms.Test SSH Access Loading...	no	0:00:00.004	4
Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:02.063	4
Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:02.005	4
Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptor Loading...	no	0:00:01.905	4
Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instance Loading...	no	0:16:07.907	4
Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptor Loading...	no	0:00:02.008	4
Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operations Loading...	no	0:00:04.901	4
Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Service Loading...	no	0:01:09.514	4
Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale In Loading...	no	0:00:01.837	4
Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Out Loading...	no	0:00:01.711	4
Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Name Loading...	no	0:00:00.007	4
Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Out Loading...	no	0:00:03.031	4
Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Test Loading...	no	0:00:06.391	4
Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale In Loading...	no	0:00:04.821	4
Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Out Loading...	no	0:00:05.038	4
Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operations Loading...	no	0:00:04.971	4
Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Test Loading...	no	0:00:06.769	4
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.003	4
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:00.002	4
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptor Loading...	no	0:00:01.946	4
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instance Loading...	no	0:16:08.159	4
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptor Loading...	no	0:00:02.002	4
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operations Loading...	no	0:00:00.004	4
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addresses Loading...	no	0:00:00.003	4
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Service Loading...	no	0:01:09.562	4
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Access Loading...	no	0:00:00.004	4
Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSM Loading...	no	0:00:37.758	4
Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operation Loading...	no	0:00:00.009	4
Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operation Loading...	no	0:00:00.008	4
Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instance Loading...	no	0:01:09.629	4
Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Test Loading...	no	0:00:01.987	4
Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instance Loading...	no	0:16:08.745	4
Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Test Loading...	no	0:00:01.945	4
Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operations Loading...	no	0:00:04.746	4
Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Id Loading...	no	0:00:01.974	4
Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDU Loading...	no	0:00:01.900	4
Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDU Loading...	no	0:00:00.941	4
Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repo Loading...	no	0:00:00.005	4
Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instance Loading...	no	0:00:06.648	4
Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repo Loading...	no	0:00:01.906	4
Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Test Loading...	no	0:00:01.966	4
Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Test Loading...	no	0:00:01.935	4
Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDU Loading...	no	0:00:02.238	4
Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDU Loading...	no	0:00:02.201	4
Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDU Loading...	no	0:00:01.199	4
Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDU Loading...	no	0:00:02.295	4
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-time Loading...	no	0:00:00.124	3
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scaling Loading...	no	0:14:01.719	3
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Threshold Loading...	no	0:14:01.858	3

Test Suites

Name	Failed tests (diff)	Total tests (diff)	Duration (diff)
Testsuite	115 (±0)	287 (±0)	8:38:27.208 (+0:04:20.458)
Testsuite.Basic 12-Ns Primitives	6 (±0)	9 (±0)	0:38:02.707 (+0:01:02.693)
Testsuite.K8S 13-Two Helm Kdu	11 (±0)	18 (±0)	0:02:54.632 (+0:00:03.173)
Testsuite.Basic 07-Secure Key Management	7 (±0)	12 (±0)	0:37:04.540 (+0:00:08.307)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling	3 (±0)	15 (±0)	0:37:03.402 (+0:00:11.213)
Testsuite.K8S 07-Dummy Helm	0 (±0)	10 (±0)	0:02:25.644 (+0:00:01.623)
Testsuite.Basic 09-Manual Vdu Scaling	0 (±0)	13 (±0)	0:06:15.864 (+0:01:05.386)
Testsuite.K8S 12-Openldap Helm Day-2	9 (±0)	15 (±0)	0:37:57.843 (+0:00:01.970)
Testsuite.K8S 09-Pebble Charm K8S	2 (±0)	8 (±0)	0:00:36.907 (+0:00:01.372)
Testsuite.Basic 13-Ns Relations	5 (±0)	8 (±0)	0:36:59.388 (-0:00:01.161)
Testsuite.Basic 23-Sol004 Sol007 Packages	0 (±0)	5 (±0)	0:00:13.591 (+0:00:00.502)
Testsuite.K8S 04-Openldap Helm	0 (±0)	12 (±0)	0:03:10.941 (+0:00:01.006)
Testsuite.Basic 15-Rbac Configurations	0 (±0)	7 (±0)	0:00:25.893 (-0:00:00.328)
Testsuite.Basic 17-Delete Vnf Package	0 (±0)	5 (±0)	0:00:13.340 (-0:00:00.009)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling	11 (±0)	18 (±0)	0:36:24.180 (+0:00:35.553)
Testsuite.Hackfest Cloudinit	3 (±0)	9 (±0)	0:20:21.176 (+0:00:12.355)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init	0 (±0)	8 (±0)	0:04:26.671 (-0:00:00.442)
Testsuite.Basic 14-Vnf Relations	4 (±0)	6 (±0)	0:35:50.134 (+0:00:03.142)
Testsuite.Hackfest Multivdu	3 (±0)	9 (±0)	0:20:23.019 (+0:00:18.006)
Testsuite.Basic 16-Advanced Onboarding And Scaling	0 (±0)	12 (±0)	0:11:09.432 (+0:00:51.138)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms	9 (±0)	11 (±0)	0:35:48.168 (+0:00:01.578)
Testsuite.K8S 08-Simple K8S Scaling	7 (±0)	12 (±0)	0:00:47.429 (-0:00:00.698)
Testsuite.K8S 05-K8S Proxy Charms	9 (±0)	11 (±0)	0:35:58.086 (-0:00:20.747)
Testsuite.K8S 06-K8S Secure Key Management	7 (±0)	12 (±0)	0:36:39.524 (+0:00:01.934)
Testsuite.Basic 06-Vnf With Charm	10 (±0)	12 (±0)	0:36:13.464 (+0:00:01.098)
Testsuite.Hackfest Basic	0 (±0)	9 (±0)	0:03:55.553 (+0:00:00.650)
Testsuite.Basic 11-Native Charms	7 (±0)	9 (±0)	0:35:42.310 (+0:00:01.074)
Testsuite.K8S 02-K8Scluster Creation	0 (±0)	4 (±0)	0:00:46.907 (+0:00:00.040)
Testsuite.K8S 03-Simple K8S	2 (±0)	8 (±0)	0:00:36.332 (+0:00:00.026)