The addition of the build parameter to the Artifactory search results
in what would appear to be a full index scan, taking over 2 minutes
to complete.  With this change, we still get the exact artifact
we need, however the search completes in less than 1 second.

Fixes Bug 1879

Change-Id: Ibe5987e06cac39e3651b9dbec61993c0cfb567b8
Signed-off-by: beierlm <mark.beierl@canonical.com>
(cherry picked from commit 499b442f)

Added a lockable resource semaphore around queries to artifactory
to prevent overloading the server.

Fixes Bug 1876

Change-Id: I17979e7fa5d2ed2405873e7dda588d7104741817
Signed-off-by: beierlm <mark.beierl@canonical.com>
(cherry picked from commit f83c20ab)

Updates base to Ubuntu 20.04
Updates python to 3.8
Updates pip dependencies to more recent versions
Adds apt cache to stage 2 dockerfile
Change stage 3 base image to Ubuntu 20.04 so we can use
python3.8

Fixes bug 1841

Change-Id: I442d0ecf09f033946bbbc3301fd8de54382a4195
Signed-off-by: beierlm <mark.beierl@canonical.com>

Change-Id: I867590f408bb401f7bd66785645f7d185ce6861e
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

Adds ntp to the new VM and forces a full clock sync to avoid
any drift between Jenkins and ETSI VIM

Fixes bug 1774

Change-Id: I7cec55cdedcf53f6206ee54959dea4f8f1cfeb65
Signed-off-by: beierlm <mark.beierl@canonical.com>
(cherry picked from commit b59bd0db)

Change-Id: I40af57c22e28e6b4a22d25edb8e0a0110f251093
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

This change covers:

- Feature 10892. Installation of OSM on top of Ubuntu20.04. Changes
  are mostly in full_install_osm.sh and are related to the use of new
  versions of kubeadm and docker-ce. In addition, changes in Jenkins
  groovy files have been done to indicate the base image to be used,
  either 18.04 or 20.04.
- Feature 10893. Better tracking of installation. The code for tracking
  in in common/track. There is a function track that it is called in
  the different steps of the installation.
- Feature 8460: Cleanup old code in full_install_osm.sh. The script
  full_install_osm.sh has been split in different scripts performing
  specific tasks, thus simplifying the installer: install_docker_ce.sh,
  install_juju.sh and install_kubeadm_cluster.sh.

Change-Id: I1e388ec56285337eaf34f68470aa5a9b23ff45ff
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

In this merged commit https://osm.etsi.org/gerrit/c/osm/devops/+/11149/

, a variable was left by mistake.
This commit resolves the issue.

Change-Id: Iaa91ebe5d37c3c6f9b56757f4e6268214d36eb51
Signed-off-by: aktas <emin.aktas@ulakhaberlesme.com.tr>

With the new way of the juju accces in k8s_08 testsuite,
installing juju in the container is not needed.
k8s_08 testsuite changes: https://osm.etsi.org/gerrit/c/osm/tests/+/11104



Change-Id: I7c5a59a776df23ca21b21a17728e658ad6d4e388
Signed-off-by: aktas <emin.aktas@ulakhaberlesme.com.tr>

Change-Id: I9338d4108bddfe8db212d5aad82d9d8ad1473992
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>

OpenEBS is giving us troubles again, so we need to use the --charmed option
in the installer until we can figure out how to fix the K8s installer.

Change-Id: I6dcd24f9b7c1f70d074bcd40f63fb110fb1c355b
Signed-off-by: beierlm <mark.beierl@canonical.com>

There was a typo in threshold variables.

Change-Id: Ib4cf608e0694e89f015212c6a011d4faa001d88c
Signed-off-by: aguilard <e.dah.tid@telefonica.com>

garciadeblas authored 3 years ago and Mark Beierl committed 3 years ago

Some of the tests require access to OSM instance in order
to run some commands from there. Those commands could be run
using ssh, but a private key is required to be able connect to
that OSM instance.

This change gets the private key corresponding to the public key in
OSM instance and mounts it in docker/tests so that the container can
access to OSM instance via ssh and run commands there.

Change-Id: Id12ede582d5e519afbc41647b90d192b80cf8fcf
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

aktas authored 3 years ago and Mark Beierl committed 3 years ago

* Getting Juju data from installed osm
* Bind the Juju data to robot-systest container

Change-Id: I3fedd01fe0314b59e7b9db625b3fb206ceca4353
Signed-off-by: aktas <emin.aktas@ulakhaberlesme.com.tr>

Change-Id: I1e985dc5d27f3cfe246a0e52a8e08b15155842d5
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

Do not attempt to build openvim anymore
Remove openvim and LW-UI from branch and tag scripts

Change-Id: If0026575410a372179edd6dd045ac5e04463c9a6
Signed-off-by: beierlm <mark.beierl@canonical.com>

Change-Id: I807a11f95ef3fb1976a9c52dccabcd46e2e4413d
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

garciadeblas authored 3 years ago and Mark Beierl committed 3 years ago

Change-Id: Ide5136b35f8f3965a3ef716eaad6414a6d47cc90
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

Change-Id: Ic11bdc47d0fc50f475c9b56c9628bce303d4d30a
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

Change-Id: I2355ec71ab009e7646d35e7bcaa637dcd6751fb8
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

Mark Beierl authored 3 years ago and sousaedu committed 3 years ago

With the only supported UI being the NG-UI, and approval from
the TSC, the Light UI is being completely removed from the
build process and installers.

Change-Id: I9a0c099fedcac411a0e31dce4bf64895d1092a37
Signed-off-by: beierlm <mark.beierl@canonical.com>

Move from xip.io to nip.io

Change-Id: Id861f8dac7c38786544383985a1a75cf0bce16df
Signed-off-by: David Garcia <david.garcia@canonical.com>

garciadeblas authored 4 years ago and Mark Beierl committed 3 years ago

This change adds two parameters to the stage3 Jenkinsfile in
ci_stage3_groovy:

- ROBOT_PASS_THRESHOLD: % passed Robot tests to mark the build as
  passed
- ROBOT_UNSTABLE_THRESHOLD: % passed Robot tests to mark the build
  as unstable

These two parameters are passed to robotPublisher, the class in Robot
Framework Jenkins plugin to publish test results.

Change-Id: Ia2abdf996033163572836afe88cfa0675683fcb1
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

A new option '--nocachelxdimages' has been added to
'installers/full_install_osm.sh'. If specified, the installer will
skip caching juju lxd images. The option will also skip crontab
configuration to guarantee that the images are not cached daily.

The change also modifies 'ci_stage_3.groovy' to use that option in
OSM pipeline, which will save installation time.

Change-Id: I7bfc4432d9a1c99e39440daaf559db897944bd22
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

This change will read the param ROBOT_TAG_NAME and add it as a string
param to be passed to downstream jobs, instead of a boolean param, as
it was wrongly doing.

Change-Id: I3b7042dc41cd9a270386c91fdbaa7987e23af655
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

Updates stage 3 to present osmclient and IM debian packages.
Updates installer to also install pip requirements.txt if
those files are present from the osmclient .deb package

Fixes bug 1510

Change-Id: I9ee44b265615935fee6c869c6c3c261739370183
Signed-off-by: beierlm <mark.beierl@canonical.com>

garciadeblas authored 3 years ago and Mark Beierl committed 3 years ago

This reverts commit b311476d.

This commit updates stage1 and stage3 to allow running robot
tests in stage3 by default for every commit.

The commit removes param DO_STAGE_4 since it is confusing. Only
params DO_ROBOT and ROBOT_TAG_NAME will be used. If DO_ROBOT is set
to true, robot tests will be run in stage3 for all tests containing
the tag indicated by ROBOT_TAG_NAME. The param ROBOT_TAG_NAME replaces
the previous param TEST_NAME.

MDG stage1 can specify params DO_ROBOT and ROBOT_TAG_NAME. If
specified, they will be used. Otherwise, the default for stage3 will
apply (DO_ROBOT=true, ROBOT_TAG_NAME=sanity).

Daily job, which will run stage1, can also specify params DO_ROBOT
and ROBOT_TAG_NAME. In principle, they will be set as follows:
DO_ROBOT=true, ROBOT_TAG_NAME=daily.

Stage1 job, in case of failure, will send an e-mail to OSM_MDL
mailing list reporting the failure. The mail will only be sent
if the name of the job starts with "daily-stage_4".

Change-Id: Ibe37fb588fc48297f5fea6e654f9ad64c906d9a6
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

This reverts commit 2a344a38.

Syntax error/mismatched braces

Change-Id: I23a1f8304dc45b27b9688bdf92825edb16af737f
Signed-off-by: beierlm <mark.beierl@canonical.com>

garciadeblas authored 4 years ago and Mark Beierl committed 3 years ago

This commit updates stage1 and stage3 to allow running robot
tests in stage3 by default for every commit.

The commit removes param DO_STAGE_4 since it is confusing. Only
params DO_ROBOT and ROBOT_TAG will be used. If DO_ROBOT is set
to true, robot tests will be run in stage3 for all tests containing
the tag indicated by ROBOT_TAG. The param ROBOT_TAG replaces
the previous param TEST_NAME.

MDG stage1 can specify params DO_ROBOT and ROBOT_TAG. If specified,
they will be used. Otherwise, the default for stage3 will apply
(DO_ROBOT=true, ROBOT_TAG=sanity).

Daily job, which will run stage1, can also specify params DO_ROBOT
and ROBOT_TAG. In principle, they will be set as follows:
DO_ROBOT=true, ROBOT_TAG=daily.

Stage1 job, in case of failure, will send an e-mail to OSM_MDL
mailing list reporting the failure. The mail will only be sent
if the name of the job starts with "daily-stage_4".

Change-Id: If481f2da01f4c811495504329fe7b6d7bd88c9de
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

garciadeblas authored 4 years ago and Mark Beierl committed 3 years ago

Change-Id: I6ca0579e492c1a96a3f89468f153bd280afc50e5
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

Change to use the tag of the current build to promote to the
final dockertag that is pushed to Dockerhub

Fixes bug 1501

Change-Id: I13b83afd9dad013cd51b646a6a14399c8c62cd3c
Signed-off-by: beierlm <mark.beierl@canonical.com>

Specify correct location of pre-merge software to stage.
Runs commands without -l (login) so the environment is preserved.

Change-Id: I226cdfd62bcb40f65dbe5977d1a4b78d2e5fe061
Signed-off-by: beierlm <mark.beierl@canonical.com>

garciadav authored 4 years ago and Mark Beierl committed 4 years ago

Update dockerfiles to fetch dependencies from Artifactory
.deb and using pip3 -r instead of apt to resolve all upstream
depenencies

Update stage_3 to use URLs for artifactory packages instead
of apt server for installation of packages

Change-Id: I3abb1e1314862f386fb090cb18429f4283b0273d
Signed-off-by: beierlm <mark.beierl@canonical.com>

Changes flavor to a sanity constant so we can tailor it without
needing further code changes.

Change-Id: Ife5d2e84dce09d126e7f16c660c47b629833094c
Signed-off-by: beierlm <mark.beierl@canonical.com>

Change-Id: I97ee6d03e4e3d233988b035419994e115dd57128
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

Changes snapcraft to run directly on host instead of in docker
continer.  This adds the requirement to have snapcraft installed
in the Jenkins agent, but is more reliable as the snapcraft docker
image is not the best practice anymore for building snaps.

Change-Id: I78a9d12d1c6e054f0fe886ccfe08472309100d0f
Signed-off-by: beierlm <mark.beierl@canonical.com>

garciadeblas authored 4 years ago and Mark Beierl committed 4 years ago

Change-Id: I0745dc2e4dfd94b17b2403542e2aae3023530bb8
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>

Issues a snapcraft clean to make sure there is nothing
left from any prior runs of the build.

Change-Id: I42109d8b4a750c0a4732afcf127cc407e6956ec9
Signed-off-by: beierlm <mark.beierl@canonical.com>

Update the snapcraft dockerfile to ensure we use the latest on
each build.

Fixes Bug 1409

Change-Id: I762f46b82c6a6c1924560b4cfda4cfe7a416ccb3
Signed-off-by: beierlm <mark.beierl@canonical.com>

Change-Id: I0ac9f519dcf0dbc28aa5ca14325d3d19528ee283
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>