Robot Framework Test Results

Executed:	20240505 11:29:52.851
Duration:	8:36:54.590 (+0:04:39.878)
Status:	0 critical test, 0 passed, 0 failed 287 test total (±0), 172 passed, 115 failed
Results:	report.html log.html Original result files

Test Result Trend

Zoom to changes

Show only failed

Show only critical

Max builds

Show bigger image

Duration Trend

Show bigger image

Failed Test Cases

Name	Crit.	Duration	Age
Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.003	17
Testsuite.Basic 06-Vnf With Charm.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:00.003	17
Testsuite.Basic 06-Vnf With Charm.Check VNF Charm Application Name Loading...	no	0:00:00.008	17
Testsuite.Basic 06-Vnf With Charm.Delete NS Descriptor Loading...	no	0:00:01.920	17
Testsuite.Basic 06-Vnf With Charm.Delete NS Instance Loading...	no	0:16:02.585	17
Testsuite.Basic 06-Vnf With Charm.Delete VNF Descriptor Loading...	no	0:00:01.911	17
Testsuite.Basic 06-Vnf With Charm.Execute Day 2 Operations Loading...	no	0:00:00.005	17
Testsuite.Basic 06-Vnf With Charm.Get Management Ip Addresses Loading...	no	0:00:00.005	17
Testsuite.Basic 06-Vnf With Charm.Instantiate Charm Network Service Loading...	no	0:01:40.521	17
Testsuite.Basic 06-Vnf With Charm.Test SSH Access Loading...	no	0:00:00.007	17
Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:01.898	17
Testsuite.Basic 07-Secure Key Management.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:01.852	17
Testsuite.Basic 07-Secure Key Management.Delete NS Descriptor Loading...	no	0:00:01.875	17
Testsuite.Basic 07-Secure Key Management.Delete NS Instance Loading...	no	0:16:17.402	17
Testsuite.Basic 07-Secure Key Management.Delete VNF Descriptor Loading...	no	0:00:01.871	17
Testsuite.Basic 07-Secure Key Management.Execute Day 2 Operations Loading...	no	0:00:04.653	17
Testsuite.Basic 07-Secure Key Management.Instantiate Nopasswd Charm Network Service Loading...	no	0:02:13.031	17
Testsuite.Basic 11-Native Charms.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.004	17
Testsuite.Basic 11-Native Charms.Delete NS Descriptor Loading...	no	0:00:01.866	17
Testsuite.Basic 11-Native Charms.Delete NS Instance Loading...	no	0:16:03.509	17
Testsuite.Basic 11-Native Charms.Delete VNF Descriptor Loading...	no	0:00:01.884	17
Testsuite.Basic 11-Native Charms.Get Management Ip Addresses Loading...	no	0:00:00.007	17
Testsuite.Basic 11-Native Charms.Instantiate Charm Network Service Loading...	no	0:01:09.583	17
Testsuite.Basic 11-Native Charms.Test SSH Access Loading...	no	0:00:00.007	17
Testsuite.Basic 12-Ns Primitives.Check NS Charm Application Name Loading...	no	0:00:00.007	17
Testsuite.Basic 12-Ns Primitives.Check VDU Charm Application Name Loading...	no	0:00:00.006	17
Testsuite.Basic 12-Ns Primitives.Delete NS Loading...	no	0:16:05.576	17
Testsuite.Basic 12-Ns Primitives.Delete NS Descriptor Loading...	no	0:00:01.860	17
Testsuite.Basic 12-Ns Primitives.Delete VNF Descriptors Loading...	no	0:00:01.872	17
Testsuite.Basic 12-Ns Primitives.Instantiate NS Loading...	no	0:01:08.776	17
Testsuite.Basic 13-Ns Relations.Delete NS Descriptor Loading...	no	0:00:01.878	17
Testsuite.Basic 13-Ns Relations.Delete NS Instance Loading...	no	0:16:05.033	17
Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Provides Loading...	no	0:00:01.914	17
Testsuite.Basic 13-Ns Relations.Delete VNF Descriptor Requires Loading...	no	0:00:01.911	17
Testsuite.Basic 13-Ns Relations.Instantiate Charm Network Service Loading...	no	0:01:09.633	17
Testsuite.Basic 14-Vnf Relations.Delete NS Descriptor Loading...	no	0:00:01.858	17
Testsuite.Basic 14-Vnf Relations.Delete NS Instance Loading...	no	0:16:07.074	17
Testsuite.Basic 14-Vnf Relations.Delete VNF Descriptor Loading...	no	0:00:01.910	17
Testsuite.Basic 14-Vnf Relations.Instantiate Charm Network Service Loading...	no	0:01:08.358	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Number of Duplicated Application Name After Scale Out Loading...	no	0:00:00.006	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scale Out Loading...	no	0:00:00.006	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Check Vdus After Scaling In Loading...	no	0:00:00.006	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Descriptor Loading...	no	0:00:01.953	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete NS Instance Loading...	no	0:16:06.336	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Delete VNF Descriptor Loading...	no	0:00:01.901	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vdus Before Scale Out Loading...	no	0:00:00.004	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Get Vnf Id Loading...	no	0:00:00.008	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Instantiate Network Service Loading...	no	0:01:09.867	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale In Loading...	no	0:00:00.007	17
Testsuite.Basic 20-Manual Native Charm Vdu Scaling.Perform Manual Vdu Scale Out Loading...	no	0:00:00.006	17
Testsuite.Hackfest Cloudinit.Delete NS Descriptor Test Loading...	no	0:00:01.866	17
Testsuite.Hackfest Cloudinit.Delete NS Instance Test Loading...	no	0:16:04.652	17
Testsuite.Hackfest Cloudinit.Delete VNF Descriptor Test Loading...	no	0:00:01.934	17
Testsuite.Hackfest Multivdu.Delete NS Descriptor Test Loading...	no	0:00:02.647	17
Testsuite.Hackfest Multivdu.Delete NS Instance Test Loading...	no	0:16:06.078	17
Testsuite.Hackfest Multivdu.Delete VNF Descriptor Test Loading...	no	0:00:01.288	17
Testsuite.K8S 03-Simple K8S.Execute Day 2 Operations Loading...	no	0:00:04.711	17
Testsuite.K8S 03-Simple K8S.Network Service K8s Instance Test Loading...	no	0:00:06.921	17
Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.003	17
Testsuite.K8S 05-K8S Proxy Charms.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:00.003	17
Testsuite.K8S 05-K8S Proxy Charms.Delete NS Descriptor Loading...	no	0:00:02.030	17
Testsuite.K8S 05-K8S Proxy Charms.Delete NS Instance Loading...	no	0:16:06.014	17
Testsuite.K8S 05-K8S Proxy Charms.Delete VNF Descriptor Loading...	no	0:00:01.023	17
Testsuite.K8S 05-K8S Proxy Charms.Execute Day 2 Operations Loading...	no	0:00:00.004	17
Testsuite.K8S 05-K8S Proxy Charms.Get Management Ip Addresses Loading...	no	0:00:00.010	17
Testsuite.K8S 05-K8S Proxy Charms.Instantiate Charm Network Service Loading...	no	0:01:09.034	17
Testsuite.K8S 05-K8S Proxy Charms.Test SSH Access Loading...	no	0:00:00.008	17
Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:02.085	17
Testsuite.K8S 06-K8S Secure Key Management.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:02.955	17
Testsuite.K8S 06-K8S Secure Key Management.Delete NS Descriptor Loading...	no	0:00:01.886	17
Testsuite.K8S 06-K8S Secure Key Management.Delete NS Instance Loading...	no	0:16:05.888	17
Testsuite.K8S 06-K8S Secure Key Management.Delete VNF Descriptor Loading...	no	0:00:01.933	17
Testsuite.K8S 06-K8S Secure Key Management.Execute Day 2 Operations Loading...	no	0:00:05.043	17
Testsuite.K8S 06-K8S Secure Key Management.Instantiate Charm Network Service Loading...	no	0:01:40.756	17
Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale In Loading...	no	0:00:01.779	17
Testsuite.K8S 08-Simple K8S Scaling.Check Scale Count After Scale Out Loading...	no	0:00:01.763	17
Testsuite.K8S 08-Simple K8S Scaling.Get KDU Model Name Loading...	no	0:00:00.009	17
Testsuite.K8S 08-Simple K8S Scaling.Get Scale Count Before Scale Out Loading...	no	0:00:03.422	17
Testsuite.K8S 08-Simple K8S Scaling.Network Service K8s Instance Test Loading...	no	0:00:06.234	17
Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale In Loading...	no	0:00:04.940	17
Testsuite.K8S 08-Simple K8S Scaling.Perform Manual KDU Scale Out Loading...	no	0:00:04.864	17
Testsuite.K8S 09-Pebble Charm K8S.Execute Day 2 Operations Loading...	no	0:00:04.706	17
Testsuite.K8S 09-Pebble Charm K8S.Network Service K8s Instance Test Loading...	no	0:00:06.900	17
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 1 Operations Loading...	no	0:00:00.004	17
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Check Remote Files Created Via Day 2 Operations Loading...	no	0:00:00.003	17
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Descriptor Loading...	no	0:00:01.962	17
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete NS Instance Loading...	no	0:16:05.056	17
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Delete VNF Descriptor Loading...	no	0:00:01.970	17
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Execute Day 2 Operations Loading...	no	0:00:00.005	17
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Get Management Ip Addresses Loading...	no	0:00:00.007	17
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Instantiate Charm Network Service Loading...	no	0:01:09.138	17
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms.Test SSH Access Loading...	no	0:00:00.009	17
Testsuite.K8S 12-Openldap Helm Day-2.Add K8s Cluster To OSM Loading...	no	0:00:37.445	17
Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Rollback Operation Loading...	no	0:00:00.007	17
Testsuite.K8S 12-Openldap Helm Day-2.Check Replicas After Upgrade Operation Loading...	no	0:00:00.009	17
Testsuite.K8S 12-Openldap Helm Day-2.Create Network Service Instance Loading...	no	0:01:09.920	17
Testsuite.K8S 12-Openldap Helm Day-2.Delete NS Descriptor Test Loading...	no	0:00:01.936	17
Testsuite.K8S 12-Openldap Helm Day-2.Delete Network Service Instance Loading...	no	0:16:06.093	17
Testsuite.K8S 12-Openldap Helm Day-2.Delete VNF Descriptor Test Loading...	no	0:00:01.061	17
Testsuite.K8S 12-Openldap Helm Day-2.Execute Day 2 Operations Loading...	no	0:00:04.704	17
Testsuite.K8S 12-Openldap Helm Day-2.Get Vnf Id Loading...	no	0:00:01.933	17
Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over first KDU Loading...	no	0:00:00.885	17
Testsuite.K8S 13-Two Helm Kdu.Check Replicas After Upgrade Operation over second KDU Loading...	no	0:00:00.845	17
Testsuite.K8S 13-Two Helm Kdu.Create Helm OCI Repo Loading...	no	0:00:00.006	17
Testsuite.K8S 13-Two Helm Kdu.Create Network Service Instance Loading...	no	0:00:06.347	17
Testsuite.K8S 13-Two Helm Kdu.Delete Helm OCI Repo Loading...	no	0:00:01.795	17
Testsuite.K8S 13-Two Helm Kdu.Delete NS Descriptor Test Loading...	no	0:00:01.917	17
Testsuite.K8S 13-Two Helm Kdu.Delete VNF Descriptor Test Loading...	no	0:00:02.043	17
Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over first KDU Loading...	no	0:00:02.230	17
Testsuite.K8S 13-Two Helm Kdu.Execute Rollback Operation over second KDU Loading...	no	0:00:02.288	17
Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over first KDU Loading...	no	0:00:02.252	17
Testsuite.K8S 13-Two Helm Kdu.Execute Upgrade Operation over second KDU Loading...	no	0:00:02.176	17
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Check VIM-based Metric Exceeds Threshold After Threshold-time Loading...	no	0:00:00.148	17
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Get VNF VIM-based Metric Before Auto-scaling Loading...	no	0:14:02.087	17
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling.Wait VIM-based Metric To Exceed Threshold Loading...	no	0:14:02.214	17

Test Suites

Name	Failed tests (diff)	Total tests (diff)	Duration (diff)
Testsuite	115 (-6)	287 (±0)	8:36:54.590 (+0:04:39.878)
Testsuite.Basic 12-Ns Primitives	6 (±0)	9 (±0)	0:36:58.765 (+0:00:01.957)
Testsuite.K8S 13-Two Helm Kdu	11 (±0)	18 (±0)	0:02:54.348 (+0:00:00.148)
Testsuite.Basic 07-Secure Key Management	7 (±0)	12 (±0)	0:37:42.955 (+0:00:34.677)
Testsuite.Sa 02-Vnf With Vim Metrics And Autoscaling	3 (±0)	15 (±0)	0:36:51.342 (+0:01:20.659)
Testsuite.K8S 07-Dummy Helm	0 (±0)	10 (±0)	0:02:28.983 (+0:00:03.880)
Testsuite.Basic 09-Manual Vdu Scaling	0 (±0)	13 (±0)	0:06:17.123 (+0:00:30.858)
Testsuite.K8S 12-Openldap Helm Day-2	9 (±0)	15 (±0)	0:37:52.654 (-0:00:05.959)
Testsuite.K8S 09-Pebble Charm K8S	2 (±0)	8 (±0)	0:00:36.375 (-0:00:00.161)
Testsuite.Basic 13-Ns Relations	5 (±0)	8 (±0)	0:36:59.080 (+0:00:02.347)
Testsuite.Basic 23-Sol004 Sol007 Packages	0 (±0)	5 (±0)	0:00:16.110 (+0:00:00.480)
Testsuite.K8S 04-Openldap Helm	0 (±0)	12 (±0)	0:03:11.169 (-0:00:03.537)
Testsuite.Basic 15-Rbac Configurations	0 (±0)	7 (±0)	0:00:27.616 (+0:00:00.051)
Testsuite.Basic 17-Delete Vnf Package	0 (±0)	5 (±0)	0:00:12.488 (-0:00:01.955)
Testsuite.Basic 20-Manual Native Charm Vdu Scaling	11 (±0)	18 (±0)	0:35:51.001 (+0:00:02.694)
Testsuite.Hackfest Cloudinit	3 (±0)	9 (±0)	0:19:45.693 (-0:00:17.991)
Testsuite.Basic 05-Instantiation Parameters In Cloud Init	0 (±0)	8 (±0)	0:04:26.824 (+0:00:02.035)
Testsuite.Basic 14-Vnf Relations	4 (±0)	6 (±0)	0:35:49.877 (+0:00:01.279)
Testsuite.Hackfest Multivdu	3 (-4)	9 (±0)	0:20:21.595 (+0:00:56.528)
Testsuite.Basic 16-Advanced Onboarding And Scaling	0 (-2)	12 (±0)	0:10:35.955 (+0:01:20.837)
Testsuite.K8S 10-Sol004 Sol007 With K8S Proxy Charms	9 (±0)	11 (±0)	0:35:46.252 (-0:00:00.810)
Testsuite.K8S 08-Simple K8S Scaling	7 (±0)	12 (±0)	0:00:49.111 (-0:00:06.397)
Testsuite.K8S 05-K8S Proxy Charms	9 (±0)	11 (±0)	0:35:44.634 (-0:00:01.794)
Testsuite.K8S 06-K8S Secure Key Management	7 (±0)	12 (±0)	0:37:11.019 (+0:00:32.065)
Testsuite.Basic 06-Vnf With Charm	10 (±0)	12 (±0)	0:36:24.706 (-0:00:12.938)
Testsuite.Hackfest Basic	0 (±0)	9 (±0)	0:03:58.210 (+0:00:16.568)
Testsuite.Basic 11-Native Charms	7 (±0)	9 (±0)	0:35:54.913 (-0:00:18.057)
Testsuite.K8S 02-K8Scluster Creation	0 (±0)	4 (±0)	0:00:47.791 (+0:00:01.331)
Testsuite.K8S 03-Simple K8S	2 (±0)	8 (±0)	0:00:37.856 (+0:00:01.063)