osm/tests.git
4 years agoAdded retries and timeout parameters for Prometheus queries 44/9944/1
aguilarherna [Wed, 4 Nov 2020 15:52:40 +0000 (16:52 +0100)]
Added retries and timeout parameters for Prometheus queries

Change-Id: I2bba94a7ac15ad5d2713a1ab379692726d174489
Signed-off-by: aguilarherna <daguilarh@indra.es>
4 years agoAdded test [k8s-06] secure key management test in a juju k8s cloud 06/9806/2
romeromonser [Wed, 7 Oct 2020 10:50:16 +0000 (12:50 +0200)]
Added test [k8s-06] secure key management test in a juju k8s cloud

Change-Id: Id4c7807d28d9c3a36afd9afdab996a2edee3e604
Signed-off-by: romeromonser <garomero@indra.es>
4 years agoFix paths in basic_12. Partially fixes bug 1207 10/9810/1
garciadeblas [Wed, 7 Oct 2020 15:33:05 +0000 (15:33 +0000)]
Fix paths in basic_12. Partially fixes bug 1207

Change-Id: I0633e6872338440dd3f892bb2714b4e5c8b68e8d
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoRemoved wrong references to juju_lib 99/9799/2
garciadeblas [Mon, 5 Oct 2020 07:58:58 +0000 (07:58 +0000)]
Removed wrong references to juju_lib

Change-Id: I4097e0897ef1b1160616dab5faa7449beb420f52
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoImproved cleanup of slice_01 and slice_02 tests 83/9783/2
garciadeblas [Fri, 2 Oct 2020 20:50:49 +0000 (20:50 +0000)]
Improved cleanup of slice_01 and slice_02 tests

Change-Id: Ib5c6b0493021b08a0f7ca3681ff58a1f65c3422a
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoFix sa_07 to delete temporary package folder created for the test 82/9782/2
garciadeblas [Fri, 2 Oct 2020 20:46:40 +0000 (20:46 +0000)]
Fix sa_07 to delete temporary package folder created for the test

Change-Id: Iffcf6af3112b577a7b5146403164c522ba44dcc6
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoRenamed Test Cleanup to Suite Cleanup; fix teardown to work properly in test suites 81/9781/2
garciadeblas [Fri, 2 Oct 2020 16:10:14 +0000 (16:10 +0000)]
Renamed Test Cleanup to Suite Cleanup; fix teardown to work properly in test suites

Change-Id: I4f8369b7f99d4d34a61f2b6ca58fa8a02feba01b
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoFix basic01 and vim_lib: success if any metric is registered in Prometheus 80/9780/2
garciadeblas [Fri, 2 Oct 2020 15:40:25 +0000 (15:40 +0000)]
Fix basic01 and vim_lib: success if any metric is registered in Prometheus

Change-Id: Ia27baf1e87f706777f8fd0e6665b91b9a695d1c7
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoFix vim config for basic-01 and basic-08: added insecure option if present in clouds... 79/9779/2
garciadeblas [Fri, 2 Oct 2020 15:01:37 +0000 (15:01 +0000)]
Fix vim config for basic-01 and basic-08: added insecure option if present in clouds.yaml

Change-Id: I90021dc72167765552841fd34b9b8f7a4d63cac8
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoFix k8scluster_lib keywords to log output of k8scluster-list 76/9776/1
garciadeblas [Thu, 1 Oct 2020 16:26:20 +0000 (16:26 +0000)]
Fix k8scluster_lib keywords to log output of k8scluster-list

Change-Id: Ie922c4e41bdcbcaf27e6cced053d319d8445007a
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoUpdated deprecated command-line osm commands: vnfd-, nsd- 72/9772/1
garciadeblas [Tue, 29 Sep 2020 15:38:47 +0000 (15:38 +0000)]
Updated deprecated command-line osm commands: vnfd-, nsd-

Change-Id: If87358c9c56d32e5b1de5fb1b4a943129224e974
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoUpdated Test Connectivity to retry ping and capture ping output 71/9771/1
garciadeblas [Fri, 25 Sep 2020 09:39:31 +0000 (09:39 +0000)]
Updated Test Connectivity to retry ping and capture ping output

Change-Id: Idf6b873db0066ea8783f5ae917ad94bcff2f6d43
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoFix K8s cluster tests to check that the k8s cluster is enabled 70/9770/1
garciadeblas [Tue, 22 Sep 2020 14:37:39 +0000 (16:37 +0200)]
Fix K8s cluster tests to check that the k8s cluster is enabled

Fixes bug 1224

Change-Id: I4f15c7f39a7396a867a38a71ba8a15c1b68f3979
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
4 years agoAdds Robot test EPA-02 with new Openstack library 54/9754/2
garciaale [Thu, 24 Sep 2020 18:04:27 +0000 (18:04 +0000)]
Adds Robot test EPA-02 with new Openstack library

Change-Id: I95c0d654e02647cebe68959ecd1e6c47546a659e
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoPoC of SOL005 Robot conformance tests into OSM's CICD 77/9677/8
Frank Bryden [Mon, 7 Sep 2020 08:45:54 +0000 (08:45 +0000)]
PoC of SOL005 Robot conformance tests into OSM's CICD

Change-Id: If8373ae545331ae9137c1c8fc3628cae5c56406d
Signed-off-by: Frank Bryden <frank.bryden@etsi.org>
4 years agoMerge v8.0 into master 27/9627/2
beierlm [Fri, 26 Jun 2020 18:57:09 +0000 (14:57 -0400)]
Merge v8.0 into master

Test contributions from master
Fix permission for devops-stages files (+x)
Adding the repository to CI/CD pipeline
Adding VIM to OSM option
Adding BRANCH_NAME variable for release tests
Adding prometheus_host env variable for ci/cd

git cherry-pick -n e1a9c5709cce246d2cca273be7d8f61b8404efea^..72556ca8d5a07199c182a586688bbebe8cf1cfad

Author: Felipe Vicens <felipe.vicens@atos.net>
Signed-off-by: beierlm <mark.beierl@canonical.com>
Adds test EPA-01 for SR-IOV

Signed-off-by: garciaale <agarcia@whitestack.com>
Retry vim-create

Sometimes it appears that the vim-create command gets issued
before LCM is properly ready, so as a workaround, this tries
a number of times to create the VIM before giving up.

Signed-off-by: beierlm <mark.beierl@canonical.com>
Fixing Logic

Breaks out of the loop once the vim is enabled

Signed-off-by: Mark Beierl <mark.beierl@canonical.com>
Added test [K8s-04] OpenLDAP

Signed-off-by: ramonsalguer <javier.ramon@telefonica.com>
==================================================================

Signed-off-by: Mark Beierl <mark.beierl@canonical.com>
Change-Id: Id436df42b735aa856e946c5c693f291bd0ba2d44

4 years agoRemoves wrong k8scluster tag on K8S-04 test, as all tests on the same file are tagged... 51/9551/1
garciaale [Wed, 5 Aug 2020 14:56:33 +0000 (10:56 -0400)]
Removes wrong k8scluster tag on K8S-04 test, as all tests on the same file are tagged as openldap only

Change-Id: I9d20bcc5cb02f46bf039fcb6c0217c93753bc700
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoAdd actions to Simple K8s test 43/9543/2
Dominik Fleischmann [Fri, 31 Jul 2020 13:17:26 +0000 (15:17 +0200)]
Add actions to Simple K8s test

This commit changes the package used for the test
k8s-03. The new package has actions included and
uses local k8s charms.

This required the additon of the upload-package
commands in the robot test libraries and the
K8s Ns Action command.

Additionally the timeout time for the k8scluster
creation has been extended, as it was to short for
some test environments.

Change-Id: I846733982a7874b3467270d1a1d1fa8a330030f8
Signed-off-by: Dominik Fleischmann <dominik.fleischmann@canonical.com>
4 years agoBasic-12 - RobotFramework 93/9493/3
calvinosanc1 [Tue, 21 Jul 2020 14:03:46 +0000 (16:03 +0200)]
Basic-12 - RobotFramework

Change-Id: I6c99f33947c07e446e7042e9b0648a148958f560
Signed-off-by: calvinosanc1 <guillermo.calvino@canonical.com>
4 years agoFix tags and Bug 1158 30/9530/1
calvinosanc1 [Wed, 29 Jul 2020 10:11:41 +0000 (12:11 +0200)]
Fix tags and Bug 1158

Change-Id: I574ffbafba991590bda7f484e9106569289431dc
Signed-off-by: calvinosanc1 <guillermo.calvino@canonical.com>
4 years agoAdds Robot test BASIC-15 for RBAC configurations 06/9506/3
garciaale [Wed, 22 Jul 2020 22:14:08 +0000 (22:14 +0000)]
Adds Robot test BASIC-15 for RBAC configurations

Change-Id: Ia907f795dc735eff64cab3027885a8363bf815d8
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoAdd Native Charm Test 17/9517/2
Dominik Fleischmann [Thu, 23 Jul 2020 11:28:01 +0000 (13:28 +0200)]
Add Native Charm Test

This commits add the following Robot test

Basic 11 - Native Charms

Additionally the packages for the Proxy Charm
Robot Test has been updated

Change-Id: Ic5b7e0e742dfcb9fccbfecd84ba24e2d83186682
Signed-off-by: Dominik Fleischmann <dominik.fleischmann@canonical.com>
4 years agoAdd Charm Relations Tests and Tags 15/9515/2
Dominik Fleischmann [Thu, 23 Jul 2020 10:25:20 +0000 (12:25 +0200)]
Add Charm Relations Tests and Tags

This commit adds Robot Tests for the following
cases:

Basic 13 NS Relations
Basic 14 VNF Relations

It also adds tags to charm tests so that they can
be executed by themselves and the charm tag to
execute all charm related tests.

Change-Id: I2ee5780a8a832c3535d1739b3effa4b57b880be2
Signed-off-by: Dominik Fleischmann <dominik.fleischmann@canonical.com>
4 years agoAdds Robot QUOTAS-01 test 63/9463/2
garciaale [Fri, 17 Jul 2020 21:24:54 +0000 (17:24 -0400)]
Adds Robot QUOTAS-01 test

Change-Id: I38d51d0beea871808046d762f8fffb9c65e5f200
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoAdds test SA-08 for VNF metrics with SNMP exporters 85/9485/2
garciaale [Mon, 20 Jul 2020 17:29:46 +0000 (13:29 -0400)]
Adds test SA-08 for VNF metrics with SNMP exporters

Change-Id: Ic77945005fec0a410c1075b1b35c7cdcead6dc37
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoAdded test [K8s-04] OpenLDAP 02/9502/3
ramonsalguer [Sun, 19 Jul 2020 19:27:59 +0000 (19:27 +0000)]
Added test [K8s-04] OpenLDAP

Change-Id: Ifca4e792287eb5de4e467bb8eddae8d4886f1dc1
Signed-off-by: ramonsalguer <javier.ramon@telefonica.com>
4 years agoAdd Robot Test for Feature 8716 K8s Proxy Charms 57/9457/4
Dominik Fleischmann [Fri, 17 Jul 2020 14:50:52 +0000 (16:50 +0200)]
Add Robot Test for Feature 8716 K8s Proxy Charms

This commit also increases the NS Delete timeout
limit from 1 minute to 3 minute.

Change-Id: Ief53a78879d4b615df97cac205291574525525bc
Signed-off-by: Dominik Fleischmann <dominik.fleischmann@canonical.com>
4 years agoRemove K8s-01 from sanity tests 58/9458/2
calvinosanc1 [Fri, 17 Jul 2020 16:36:35 +0000 (18:36 +0200)]
Remove K8s-01 from sanity tests

Change-Id: Ifda2363c8711f930d79b8350971884631ac4be82
Signed-off-by: calvinosanc1 <guillermo.calvino@canonical.com>
4 years agoAllows overriding EPA attributes to force package compatibility with specific VIMs 60/9460/4
ramonsalguer [Fri, 17 Jul 2020 18:08:52 +0000 (18:08 +0000)]
Allows overriding EPA attributes to force package compatibility with specific VIMs

Change-Id: I07056603053fe96e6ac453314e128d5a7abbbebc
Signed-off-by: ramonsalguer <javier.ramon@telefonica.com>
4 years agoAdds Robot test EPA-03 with new SDNC library 12/9412/6
garciaale [Tue, 14 Jul 2020 15:41:06 +0000 (11:41 -0400)]
Adds Robot test EPA-03 with new SDNC library

Change-Id: I316b238a9097d308c1fd0873ced65c93d1b4f415
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoClean up build directory 62/9462/1
beierlm [Fri, 17 Jul 2020 19:03:15 +0000 (15:03 -0400)]
Clean up build directory

There are transient artifacts left behind from previous
builds that can interfere with the current build.

This change deletes the contents of deb_dist to make
sure the packages are fresh with each build.

Change-Id: I127261739929f6b4ac44dc35342ce9580d9301c1
Signed-off-by: beierlm <mark.beierl@canonical.com>
4 years agoAllow Errors to be Caught 59/9459/2
beierlm [Fri, 17 Jul 2020 17:29:45 +0000 (13:29 -0400)]
Allow Errors to be Caught

The echo command at the end of the script causes Jenkins
to ignore any errors that happen during the build step.

Change-Id: I1f71051c45d38afeaa8a331e08dcc999aaafca6d
Signed-off-by: beierlm <mark.beierl@canonical.com>
4 years agoAdds Robot test BASIC-08 for disabling port security 54/9354/2
garciaale [Tue, 7 Jul 2020 21:41:24 +0000 (17:41 -0400)]
Adds Robot test BASIC-08 for disabling port security

Change-Id: Icf1b73a823de38935319e08d0046363e90b211e0
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoAdds Robot test SA-07 for alarms coming from SA-related VNFs 38/9338/2
garciaale [Mon, 6 Jul 2020 20:03:08 +0000 (16:03 -0400)]
Adds Robot test SA-07 for alarms coming from SA-related VNFs

Change-Id: I94df464e2cd6a9b16bbf2b5b7d3817839ed7abd8
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoAdding K8s01 13/9313/3
calvinosanc1 [Fri, 3 Jul 2020 15:28:12 +0000 (17:28 +0200)]
Adding K8s01

Change-Id: I0e4324e6e732e5447bdd00519e52bdc8461a601f
Signed-off-by: calvinosanc1 <guillermo.calvino@canonical.com>
4 years agoAdds test EPA-01 for SR-IOV 01/9301/2
garciaale [Thu, 2 Jul 2020 21:42:00 +0000 (17:42 -0400)]
Adds test EPA-01 for SR-IOV

Change-Id: Iaba03a617cece441ecce583001206f9e705f72bd
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoRobot test SA-02 for VIM-based metrics and auto-scaling 62/9262/2
garciaale [Wed, 1 Jul 2020 20:19:34 +0000 (16:19 -0400)]
Robot test SA-02 for VIM-based metrics and auto-scaling

Change-Id: Ia2878675b4e53d938d116e619b6c3f729d9224ef
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoRobot test SA-01 for VIM-based metrics 55/9255/2
garciaale [Wed, 1 Jul 2020 13:37:14 +0000 (09:37 -0400)]
Robot test SA-01 for VIM-based metrics

Change-Id: I6c4883cd6cd8fe82de14ee1d7909626e6b59e412
Signed-off-by: garciaale <agarcia@whitestack.com>
4 years agoVerify that the VIM was ENABLED before start the tests when using -c option 88/9288/1
Felipe Vicens [Thu, 2 Jul 2020 10:19:28 +0000 (12:19 +0200)]
Verify that the VIM was ENABLED before start the tests when using -c option

Change-Id: I84fb0a30de53040277e84fe01c67f82980d40235
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoMoving robot-systests deprecated to tests 59/9259/1
Felipe Vicens [Wed, 1 Jul 2020 16:41:38 +0000 (18:41 +0200)]
Moving robot-systests deprecated to tests

Change-Id: I9008b7e8a2fe47d2f8f50becc74d8aea50bb1c14
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoIncreasing vim_status_max_wait_time to 2min in vim_lib.robot 13/9213/1
Felipe Vicens [Sat, 27 Jun 2020 17:03:46 +0000 (19:03 +0200)]
Increasing vim_status_max_wait_time to 2min in vim_lib.robot

Change-Id: Ib71cf48cc25cacecd377413abceca65469318da3
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoFix prometheus port for inside stack tests 00/9200/1
Felipe Vicens [Fri, 26 Jun 2020 14:23:34 +0000 (16:23 +0200)]
Fix prometheus port for inside stack tests

Change-Id: Id57a6e90a209fa166605a4ad1e148fb96d88aa3b
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoAdding prometheus_host env variable for ci/cd 94/9194/1
Felipe Vicens [Fri, 26 Jun 2020 06:59:00 +0000 (08:59 +0200)]
Adding prometheus_host env variable for ci/cd

Change-Id: I40f6791481639ed16d0236e8819046cce915a117
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoRevert stackName Variable 87/9187/1
Felipe Vicens [Thu, 25 Jun 2020 19:52:06 +0000 (21:52 +0200)]
Revert stackName Variable

Adding BRANCH_NAME variable for release tests

Change-Id: Ife3e1c727997e0348ed89019b1c8912840e53fe5
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoDiscovering OSM internal NBI ip address by stackName 84/9184/2
Felipe Vicens [Thu, 25 Jun 2020 18:12:16 +0000 (20:12 +0200)]
Discovering OSM internal NBI ip address by stackName

Fix reports folders variable

Change-Id: Icf69546283f47f4ace88a72b6381fc7a7f49e87d
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoAdding VIM to OSM option 54/9154/4
Felipe Vicens [Wed, 24 Jun 2020 19:23:44 +0000 (21:23 +0200)]
Adding VIM to OSM option

Change-Id: Ifbcfeb50b451de19830e2fe9f537af0626742b4c
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoAdding the repository to CI/CD pipeline 48/9148/8
Felipe Vicens [Wed, 24 Jun 2020 13:55:57 +0000 (15:55 +0200)]
Adding the repository to CI/CD pipeline

Change-Id: I9acb3bde5872939c4435fe438717e10db3776743
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoFix permission for devops-stages files (+x) 52/9152/1
Felipe Vicens [Wed, 24 Jun 2020 17:08:15 +0000 (19:08 +0200)]
Fix permission for devops-stages files (+x)

Change-Id: I6edfeea901c3ab0e2bebf6d3ae1c027bb94f2ff1
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoAdding kubernetes tests 43/9143/1 release-v8.0-start v0.0.1
Felipe Vicens [Tue, 23 Jun 2020 13:55:08 +0000 (15:55 +0200)]
Adding kubernetes tests

Change-Id: Ibed1eadd12eef34cb9b810292913ad5bc8222b0b
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoInitial tests contributions 32/9132/4
Felipe Vicens [Mon, 22 Jun 2020 06:12:30 +0000 (08:12 +0200)]
Initial tests contributions

Dockerfile for robot tests automation
Robot-systests from devops repository
Testing tags for CI/CD
Adding charm build script

Change-Id: Ib50d8e3c66be44e946e19071b2ca229d48609ea3
Signed-off-by: Felipe Vicens <felipe.vicens@atos.net>
4 years agoInitial common files for all repos 10/9110/1
almagia [Thu, 18 Jun 2020 10:21:45 +0000 (12:21 +0200)]
Initial common files for all repos

Change-Id: Ic95db46a6a7f33b7f5e768866ac965be312dfad6
Signed-off-by: almagia <silvia.almagia@etsi.org>
4 years agoInitial empty repository
almagia [Wed, 17 Jun 2020 16:21:34 +0000 (18:21 +0200)]
Initial empty repository