osm/devops.git
2 years agoBug 2129: Fix logic to always delete VM 15/12415/1
Mark Beierl [Fri, 29 Jul 2022 16:46:18 +0000 (12:46 -0400)]
Bug 2129: Fix logic to always delete VM

Puts the step to extract the container logs into a try/catch block
so that the logic to delete the VM and stop the apache container
will always execute, instead of leaving them behind on error.

Fixes bug 2129

Change-Id: If252670b5374f1665f0e8b649b9fbc16c1ff2705
Signed-off-by: Mark Beierl <mark.beierl@canonical.com>
2 years agoBetter release note check 07/12307/2
beierlm [Tue, 7 Jun 2022 16:21:17 +0000 (12:21 -0400)]
Better release note check

Only checks release notes for incoming patches, not
for merge jobs.

Change-Id: I895136d5369f836ddae66cd49a2911cd4aa945cb
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoJenkins refresh 33/12333/2
Mark Beierl [Thu, 14 Jul 2022 13:37:34 +0000 (09:37 -0400)]
Jenkins refresh

Change the jenkins node label from 'docker'
to 'stage_2' as part of the Jenkins cleanup

Change-Id: Ifdba6e06053a705baadae674dbfd1faa7be57cfc
Signed-off-by: Mark Beierl <mark.beierl@canonical.com>
2 years agoRemoving deprecated files 36/12236/2
beierlm [Wed, 22 Jun 2022 14:12:29 +0000 (10:12 -0400)]
Removing deprecated files

Removing old charm files that are no longer in use

Change-Id: I4aaf35a3708f47bd04beffcba8e2fbd850e1f433
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoPrepare installer and pods for Rel TWELVE 37/12237/2 release-v12.0-start v12.0.0 v12.0.0rc1
garciadeblas [Wed, 22 Jun 2022 14:26:22 +0000 (16:26 +0200)]
Prepare installer and pods for Rel TWELVE

Change-Id: I9fa2bfe6322748b9fbd22d2348b88f8f63df0329
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoUpdate list of modules for tag creation and tag deletion 18/12218/2
garciadeblas [Tue, 21 Jun 2022 08:42:52 +0000 (10:42 +0200)]
Update list of modules for tag creation and tag deletion

Change-Id: I0e486a70512af81d554ac9a843843431c5048b10
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoBug 2080: Store Snapcraft Crdentials as Secret 14/12214/2
beierlm [Fri, 17 Jun 2022 17:18:17 +0000 (17:18 +0000)]
Bug 2080: Store Snapcraft Crdentials as Secret

Changes the credendtials used for the snapstore from being in a
file in jenkins' home directory to being a secret stored in
the Jenkins server itself.

Fixes bug 2080

Change-Id: Icb78ac46c83bdab1176c9316482f713f7bd89e4b
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoAdd Ng-UI sidecar charm 08/12208/2
David Garcia [Thu, 16 Jun 2022 10:31:16 +0000 (12:31 +0200)]
Add Ng-UI sidecar charm

- Fix nbi interface type
- Update Charm Libraries

Change-Id: I93d00b240e0f8f127411677647e04813f9ca412b
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoAdd NBI Charm Library 02/12202/2
David Garcia [Tue, 14 Jun 2022 15:43:09 +0000 (17:43 +0200)]
Add NBI Charm Library

Change-Id: I7dbfa487918b05e0bf98776db1b1cec5586beec7
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoAdd osm-nbi sidecar charm 01/12201/2
David Garcia [Mon, 13 Jun 2022 15:29:53 +0000 (17:29 +0200)]
Add osm-nbi sidecar charm

Change-Id: Ifd0b560cb94c863ade982d3e74a3f5c9f3767657
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoEnable FSMongo for RO for feature 10909 Heal operation for VDU 69/11869/4
garciadeblas [Fri, 8 Apr 2022 10:35:13 +0000 (12:35 +0200)]
Enable FSMongo for RO for feature 10909 Heal operation for VDU

Change-Id: Ie1b4d880418656a3619976c5159eec5cadd420d7
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoFix bug 2057: Update lxd-credentials file 55/12155/1
David Garcia [Wed, 1 Jun 2022 11:01:43 +0000 (13:01 +0200)]
Fix bug 2057: Update lxd-credentials file

Change-Id: I41b90c4010bf1dfe553a3d81bddf7bcef5f08b35
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoUpdate keystone version to 18.1 17/12117/1
garciadeblas [Tue, 24 May 2022 08:30:40 +0000 (10:30 +0200)]
Update keystone version to 18.1

Change-Id: I3ce790627d0a942f8df7c5b98a9afe078ffc41ab
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoMake LXD installation optional in Charmed Installer 08/12008/7
aticig [Fri, 6 May 2022 10:46:22 +0000 (13:46 +0300)]
Make LXD installation optional in Charmed Installer

By default lxd cloud is defined, with this change optionally lxd cloud is not
added by passing --small-profile parameter in charmed installer.

Change-Id: I8f3b1816c9f2f43ee6bb84c15b2ce0eda99d691b
Signed-off-by: aticig <gulsum.atici@canonical.com>
2 years agoFix password generation in charmed installer 46/11946/3
David Garcia [Wed, 27 Apr 2022 11:43:42 +0000 (13:43 +0200)]
Fix password generation in charmed installer

Replace base64 format passwords with hex. Base64 passwords can include
chars like "/" which may cause problems when using them in sed-like
commands.

Change-Id: Id522adf40e329d8169853b5614f5ff541a174f68
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoAdd tool upload-installer.sh to upload installer to FTP server 21/11921/3
garciadeblas [Fri, 22 Apr 2022 10:15:45 +0000 (12:15 +0200)]
Add tool upload-installer.sh to upload installer to FTP server

Change-Id: I62e9eaeabb915b7b8da01fe1aa65b03fdd1f8619
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoAdd checking of status of local http server used to serve deb packages 20/11920/3
garciadeblas [Fri, 22 Apr 2022 10:05:15 +0000 (12:05 +0200)]
Add checking of status of local http server used to serve deb packages

Change-Id: Ic624afeee0ec5011e21c10bd0eb110ec78888e1c
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoAdding TCP Dump 37/12037/1
beierlm [Wed, 11 May 2022 18:53:01 +0000 (14:53 -0400)]
Adding TCP Dump

Captures all network traffic (with a maximum packet size) so that if
anything happens during the initial configuration and installation
we can analyze it to determine what is happening in the network.

Change-Id: Ia941d0a8b7610e4ad3a9d1f6ef1b53ac437e6a54
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoUse juju version 2.9.29 09/12009/1
David Garcia [Fri, 6 May 2022 11:17:42 +0000 (13:17 +0200)]
Use juju version 2.9.29

Change-Id: I122eaa9c2c82ddbe00ee529ac3944cc666dc4a52
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoProper tracking of Charmed Install 81/11881/7
beierlm [Wed, 13 Apr 2022 12:19:40 +0000 (08:19 -0400)]
Proper tracking of Charmed Install

Adds installation ID to the charmed path, as well as tracking installation
completion.

Change-Id: Ieffce4d402d6d865a8acb8d8a0c213bee9355199
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoFix permissions of ca-certificates.crt in LCM Dockerfile 47/11947/2
David Garcia [Wed, 27 Apr 2022 11:46:34 +0000 (13:46 +0200)]
Fix permissions of ca-certificates.crt in LCM Dockerfile

Change-Id: Iad8d16d24ab5c6bc545e3470aec8ae05f98b4c68
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoUpdate local-build.sh to fix check of existing qhttp and provide more help 14/11914/2
garciadeblas [Fri, 22 Apr 2022 08:20:08 +0000 (10:20 +0200)]
Update local-build.sh to fix check of existing qhttp and provide more help

Change-Id: Icc23f4dd1f0eaa09b930d1403175fac2eeaf9f14
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoUpdate install_osm.sh to solve the issue with no valid OpenPGP data found 04/11904/3
garciadeblas [Wed, 20 Apr 2022 22:29:02 +0000 (00:29 +0200)]
Update install_osm.sh to solve the issue with no valid OpenPGP data found

Change-Id: Ife80b72991b27c55f2f254b2723a253172e38cc9
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoBug 1991 fixed: modified LCM charm secret name to a standardized one 91/11891/2
Pedro Escaleira [Fri, 15 Apr 2022 13:54:52 +0000 (14:54 +0100)]
Bug 1991 fixed: modified LCM charm secret name to a standardized one

Previously, the LCM charm was creating a Kubernetes secret with the name
`lcm-lcm-secret`, to save the credentials for accessing Mongo, while the
other modules' charms where using a name with the format
`<mod_name>-mongodb-secret` to do so. This modification updates the LCM charm
to create this secret in a compliant way with this name format.

Change-Id: I4d91e760e44d1703f246e605d9b70625967556c5
Signed-off-by: Pedro Escaleira <escaleira@av.it.pt>
2 years ago Fixes Bug 1993 - Substitutes NTP with Chrony 93/11893/2
João Fonseca [Fri, 15 Apr 2022 15:06:51 +0000 (16:06 +0100)]
 Fixes Bug 1993 - Substitutes NTP with Chrony

Change-Id: I36e0d8a0b5ce18c93e0831b277210d6b275fbcca
Signed-off-by: jpedrofonseca@av.it.pt <jpedrofonseca@ua.pt>
2 years agoFix bug 1563 to archive logs even if OSM Health stage fails 51/10851/9
garciadeblas [Wed, 30 Mar 2022 14:52:59 +0000 (16:52 +0200)]
Fix bug 1563 to archive logs even if OSM Health stage fails

Change-Id: I1ed08f0220673b2d5ef69291d67821060e6ad2ac
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoUpdate stage3 to move NTP to a separate stage with individual sshCommands 80/11780/2
garciadeblas [Wed, 23 Mar 2022 11:27:02 +0000 (12:27 +0100)]
Update stage3 to move NTP to a separate stage with individual sshCommands

Change-Id: I47689b3137d9c18de2f2514ec9b81b2b978208cc
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoSplit stage-build and stage-archive conveniently 79/11779/2
garciadeblas [Wed, 23 Mar 2022 11:25:27 +0000 (12:25 +0100)]
Split stage-build and stage-archive conveniently

Change-Id: Iae36bf59b76f103f4e7d609f13e1efd8914c310b
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoBug 1933: Fix ready check 86/11786/1
beierlm [Fri, 25 Mar 2022 16:23:36 +0000 (12:23 -0400)]
Bug 1933: Fix ready check

Changes to juju result in human readable output no longer
being applicable for the deployment completion check.
Changes to use json output instead.

Fixes Bug 1933

Change-Id: I65358c7f472956ed4238a5a61cceb1651d88feff
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoFixing wrong type of input in PLA charm restart policy 58/11758/5
aticig [Thu, 17 Mar 2022 11:26:50 +0000 (14:26 +0300)]
Fixing wrong type of input in PLA charm restart policy

This fix solves the problem that is "pod is not restarted,
although charm mongodb secret config has changed".

Change-Id: Ifbb8a5e0e986563f42739db7b5669f933be6c5aa
Signed-off-by: aticig <gulsum.atici@canonical.com>
2 years agoBug 1912 Update GPG Signing 59/11759/2
beierlm [Thu, 17 Mar 2022 19:42:27 +0000 (15:42 -0400)]
Bug 1912 Update GPG Signing

Update the CLI arguments for GPG signing so that it reads the passphrase
passed in via the CLI.  This is needed as the version of GPG has been updated
and no longer accepts the old CLI arguments.

Fixes bug 1912

Change-Id: I0a850b3f1641edb917624be8fd94be78667d01fd
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoUpdate exporters: migration to CharmHub 43/11743/1
David Garcia [Fri, 11 Mar 2022 15:58:35 +0000 (16:58 +0100)]
Update exporters: migration to CharmHub

Also, added kafka_endpoint config to kafka exporter

Change-Id: I24459e33841da33455b6780a4de2c808ddf30d0b
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoAdding secret overlay in Charmed installer 07/11707/6
aticig [Wed, 23 Feb 2022 21:34:52 +0000 (00:34 +0300)]
Adding secret overlay in Charmed installer

Changing hardcoded password in charmed installation.
This fix will change the default passwords used in charmed installation
for Prometheus, Mariadb and Keystone.

Change-Id: I8a722d1afbe460831da91f893dc414a4fbd9c239
Signed-off-by: aticig <gulsum.atici@canonical.com>
2 years agoRevert "Fix bug 1702 Adding non-root user to run NG-UI" 40/11740/2
beierlm [Thu, 10 Mar 2022 11:48:00 +0000 (12:48 +0100)]
Revert "Fix bug 1702 Adding non-root user to run NG-UI"

This reverts commit b147d7129db4f7cae26a31230af184c958b20683.

Reason for revert: NG-UI Container does not start up due to non-root user

nginx: [warn] the "user" directive makes sense only if the master process runs with super-user privileges, ignored in /etc/nginx/nginx.conf:1
nginx: [emerg] bind() to 0.0.0.0:80 failed (13: Permission denied)

Change-Id: Ibc44fdfe57ca576df70f12f5bb868fe9045990b8
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoBug 1903: Better SSH check 38/11738/2
beierlm [Thu, 10 Mar 2022 11:14:38 +0000 (06:14 -0500)]
Bug 1903: Better SSH check

Changes the ssh port ready check from a simple 'is the port open?' to
a full ssh login check to ensure that sshd is actually running on the
target server.

Adds timeout to ssh check

Fixes bug 1903

Change-Id: I8c3f0d8e1ac450726bc3336c00e7fbdf405fe067
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoUpdate K8s Monitoring to support Grafana 8 15/11715/2
limon [Tue, 1 Mar 2022 09:44:53 +0000 (10:44 +0100)]
Update K8s Monitoring to support Grafana 8

Change-Id: Ia109036c8cd54cfbc6af27ff2db094abf83ce9bd
Signed-off-by: limon <alimonj@indra.es>
2 years agoFix Docker Push 17/11717/1
Mark Beierl [Thu, 3 Mar 2022 14:20:19 +0000 (09:20 -0500)]
Fix Docker Push

The variables for module, moduleName, etc are not being created in local
scope, causing the final docker push to re-use the last set value for
the modules.

Change-Id: I635955e5edcc2d94a50cec7749ac87813b5ac6c7
Signed-off-by: Mark Beierl <mark.beierl@canonical.com>
2 years agoFix bug 1702 Adding non-root user to run NG-UI 98/11698/2
preethika.p [Tue, 22 Feb 2022 04:10:41 +0000 (04:10 +0000)]
Fix bug 1702 Adding non-root user to run NG-UI

Change-Id: I8b67e7fb1b0d008187833cfb8c1752a6254f4ccf
Signed-off-by: preethika.p <preethika.p@tataelxsi.co.in>
2 years agoUpdated community installer to use grafana 8.1.1 and prometheus v2.28.1 03/11703/2
garciadeblas [Tue, 22 Feb 2022 13:23:57 +0000 (14:23 +0100)]
Updated community installer to use grafana 8.1.1 and prometheus v2.28.1

Change-Id: If64a82ccd300a512e69156101ee413377aaa8f1b
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoCharmHub and new kafka and zookeeper charms 95/11695/6
David Garcia [Mon, 21 Feb 2022 10:48:11 +0000 (11:48 +0100)]
CharmHub and new kafka and zookeeper charms

- Charmed installer uses bundles published in CharmHub
- Use new zookeeper and kafka sidecar-charm
- Changes in the charms to integrate with the new Kafka

Change-Id: Ie59fe1c7c72774b317abe2433fafb28a11472b72
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoAdded parameter <to_tag> to tools/check_changes.sh 87/11687/1
garciadeblas [Thu, 17 Feb 2022 08:28:07 +0000 (09:28 +0100)]
Added parameter <to_tag> to tools/check_changes.sh

Before this commit, only the changes in a branch from a tag to the HEAD
were generated. This commit enables listing the changes in a branch from
a tag to another tag or the HEAD of the branch.

Change-Id: I389a7a06b68dc727910afd417e6a74e4d620deab
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoFix 1704 - Adding non-root user to run LCM 75/11675/1
Mark Beierl [Fri, 11 Feb 2022 13:56:32 +0000 (08:56 -0500)]
Fix 1704 - Adding non-root user to run LCM

Change-Id: Ic250be888be01b53a2e71127ddd1d2a5cc0edb03
Signed-off-by: Mark Beierl <mark.beierl@canonical.com>
2 years agoBug 1561 correction 61/11661/1
Mark Beierl [Thu, 10 Feb 2022 15:12:40 +0000 (10:12 -0500)]
Bug 1561 correction

Adjust the method of creating the map for the SSH remote target
as the previous syntax did not provide the intended results.

Change-Id: I448c8b362a6caf2779f0a032ee84f838593d2374
Signed-off-by: Mark Beierl <mark.beierl@canonical.com>
2 years agoCharmed OSM: migration to CharmHub 13/11613/8
David Garcia [Tue, 1 Feb 2022 15:39:44 +0000 (16:39 +0100)]
Charmed OSM: migration to CharmHub

Change-Id: I7dd740b0ed007360767998372f97c53b5269fdf4
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoRemove old mongo K8s manifest file and references in the installer 35/11635/1
garciadeblas [Thu, 10 Feb 2022 02:11:50 +0000 (03:11 +0100)]
Remove old mongo K8s manifest file and references in the installer

Change-Id: Ic60d3f5605fb353a3f70ae58b5836696223dfb87
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoMinor updates in install_osm.sh to avoid warnings 34/11634/1
garciadeblas [Thu, 10 Feb 2022 00:43:59 +0000 (01:43 +0100)]
Minor updates in install_osm.sh to avoid warnings

Change-Id: Id91f022f9e368315f9bd67f8d1eeea9028d17f2d
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoFix Dockerfiles to add missing apt-update before apt-install 33/11633/1
garciadeblas [Wed, 9 Feb 2022 23:49:51 +0000 (00:49 +0100)]
Fix Dockerfiles to add missing apt-update before apt-install

Change-Id: I639aed00e74c64e770566ce50de10e193e8b8d01
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoAdded script to list the changes for the next point release 10/11610/2
garciadeblas [Mon, 31 Jan 2022 23:06:42 +0000 (00:06 +0100)]
Added script to list the changes for the next point release

Change-Id: Id8ba7cc71fb7a5df78242e4f967c2536e6d65219
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoAdded tests and SOL005 to the list of repos where to create new tags 09/11609/2
garciadeblas [Mon, 31 Jan 2022 23:01:24 +0000 (00:01 +0100)]
Added tests and SOL005 to the list of repos where to create new tags

Change-Id: I3a768082f622263f405d3905fa43759e135d79d5
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoFix bug 1561 to reformat ci_stage_3.groovy with groovy linter 49/10849/10
garciadeblas [Fri, 28 Jan 2022 16:04:34 +0000 (17:04 +0100)]
Fix bug 1561 to reformat ci_stage_3.groovy with groovy linter

Change-Id: Ifd073ca75f69d083e2c63cd1e62afc8ab7a6cc47
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoRemove juju controller creation for LXD 08/11608/2
garciadeblas [Fri, 28 Jan 2022 11:22:50 +0000 (12:22 +0100)]
Remove juju controller creation for LXD

Change-Id: I0d4fa2a71296658672dfbaac1a6ef6752ef1a1de
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoBug 1841: LTS Support K8s upgrade 22/11622/8
aticig [Thu, 3 Feb 2022 13:42:39 +0000 (16:42 +0300)]
Bug 1841: LTS Support K8s upgrade

This fix changes the K8s version to 1.23 in installation scripts.

Change-Id: Id020ece215f62ac9633a5190392350dbb8da515a
Signed-off-by: aticig <gulsum.atici@canonical.com>
2 years agoMoved snapd installation sooner in the installer 94/11594/2
garciadeblas [Fri, 28 Jan 2022 10:25:18 +0000 (11:25 +0100)]
Moved snapd installation sooner in the installer

This changes moves the check of snapd package sooner in the installer,
and installs it if missing. It also modifies check_packages function
so that the output is not redirected to /dev/null. Finally, some echos
were added to know the progress of the check.

Change-Id: Iaf058d18aa906068de65e800066752ba3343dda5
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoAdd verbosity and debug mode to juju bootstrap 93/11593/2
garciadeblas [Fri, 28 Jan 2022 11:17:53 +0000 (12:17 +0100)]
Add verbosity and debug mode to juju bootstrap

Change-Id: If3533f3477776068bc7d4623bb9eca27a9085656
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoAdded ctrl_c function to trap user installation interruptions 92/11592/2
garciadeblas [Fri, 28 Jan 2022 16:15:39 +0000 (17:15 +0100)]
Added ctrl_c function to trap user installation interruptions

Change-Id: I81c8f2443557887562512a4cc3b1f3c8ecb33ae9
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoBug 1878 Speed up Artifactory search 29/11629/2
beierlm [Fri, 4 Feb 2022 16:14:33 +0000 (11:14 -0500)]
Bug 1878 Speed up Artifactory search

The addition of the build parameter to the Artifactory search results
in what would appear to be a full index scan, taking over 2 minutes
to complete.  With this change, we still get the exact artifact
we need, however the search completes in less than 1 second.

Fixes Bug 1878

Change-Id: Ibe5987e06cac39e3651b9dbec61993c0cfb567b8
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoUpdate K8s Monitoring 65/11565/4
limon [Wed, 26 Jan 2022 09:49:39 +0000 (10:49 +0100)]
Update K8s Monitoring

Change-Id: Ic4cabf02c9089ba2b00ae2d8c53ab56cbc77a2d1
Signed-off-by: limon <alimonj@indra.es>
2 years agoBug 1873: Artifactory times out 15/11615/1
beierlm [Tue, 1 Feb 2022 21:46:40 +0000 (16:46 -0500)]
Bug 1873: Artifactory times out

Added a lockable resource semaphore around queries to artifactory
to prevent overloading the server.

Fixes Bug 1873

Change-Id: I17979e7fa5d2ed2405873e7dda588d7104741817
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoFix bug 1709 - Adding non-root user to run Keystone 44/11544/4
sousaedu [Fri, 21 Jan 2022 14:01:53 +0000 (14:01 +0000)]
Fix bug 1709 - Adding non-root user to run Keystone

Change-Id: I2a9dadb36039fa3b2e61c8c055a4f86e5c3fd172
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
2 years agoFixed installation issue with kube-flannel.yml 45/11545/1
garciadeblas [Fri, 21 Jan 2022 12:57:06 +0000 (13:57 +0100)]
Fixed installation issue with kube-flannel.yml

The installation of the local K8s cluster fails when kube-flannel.yml
is not found in the temp folder. The error that we see in the installation is
"error reading [/tmp/flannel.*****]: recognized file extensions are [.json .yaml .yml]"

This commit updates the function deploy_cni_provider to remove the silent
output when getting kube-flannel.yml. In addition, it adds several retries on error.
Finally, the error message has been modified to be more explicit about the error.

Change-Id: Ic030790e60383b75ebe21c7cb4c60485836fab2e
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoRevert "Fixed installation issue with kube-flannel.yml" 43/11543/1
garciadeblas [Fri, 21 Jan 2022 12:55:25 +0000 (13:55 +0100)]
Revert "Fixed installation issue with kube-flannel.yml"

This reverts commit 5a5c63fa67e23854cec3b61ce54e5bcfd15d3290.

Change-Id: Id90ffd535c69bbe3ab7140bf977fa8a1c78de9cd
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoBug 1864 Use private key 31/11531/2
beierlm [Tue, 18 Jan 2022 17:52:23 +0000 (12:52 -0500)]
Bug 1864 Use private key

Changes script to place the private key into the ssh config
instead of public key.

Fixes bug 1864

Change-Id: I2d5204970ebea62aded6fe125b474032d8fb5d34
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoFix &amp; text when tracking installation 41/11541/1
garciadeblas [Fri, 14 Jan 2022 10:19:16 +0000 (11:19 +0100)]
Fix &amp; text when tracking installation

Change-Id: Ifd7924747a8bea16679736d68026d45efb40e69a
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoFixed installation issue with kube-flannel.yml 09/11509/3
garciadeblas [Thu, 13 Jan 2022 00:24:15 +0000 (01:24 +0100)]
Fixed installation issue with kube-flannel.yml

The installation of the local K8s cluster fails when kube-flannel.yml
is not found in the temp folder. The error that we see in the installation is
"error reading [/tmp/flannel.*****]: recognized file extensions are [.json .yaml .yml]"

This commit updates the function deploy_cni_provider to remove the silent
output when getting kube-flannel.yml. In addition, it adds several retries on error.
Finally, the error message has been modified to be more explicit about the error.

Change-Id: Ica07bc5b3b76ffb84f7247c436b214b531d8e833
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoSilent output when deleting ns osm in k8s cluster 08/11508/5
garciadeblas [Wed, 12 Jan 2022 08:58:50 +0000 (09:58 +0100)]
Silent output when deleting ns osm in k8s cluster

The installation of the local k8s cluster with install_kubeadm_cluster.sh
raised an error message when deleting the namespace "osm". That NS is
deleted as a previous step to the deployment of OSM pods, just to make sure
that we start from a clean NS.

In principle, the error from kubectl should appear always in clean
installations. For that reason, the output of the command is redirected
to /dev/null to avoid confusion for the end user.

Change-Id: I65b90675194848f3968a9c192427224652e3087f
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoBug 1841 Partial Revert 39/11539/1
beierlm [Thu, 20 Jan 2022 13:39:55 +0000 (08:39 -0500)]
Bug 1841 Partial Revert

Revert the apt proxy in stage 3 as it appears that the cache gets
crossed packages if 2 or more builds run at the same time.  Evidence
of problem is hash mismatch on osm_devops deb file during stage 3

Change-Id: Id8680453fd4588ca526ab1ea9cb8a322075e2386
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoBug 1841: LTS Support 33/11533/3
beierlm [Wed, 19 Jan 2022 17:13:55 +0000 (12:13 -0500)]
Bug 1841: LTS Support

Change stage 3 base image to Ubuntu 20.04 so we can use
python3.8

Change-Id: I42f9185277b9f081611c550cf0f86235b9bf8e85
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoBug 1841: LTS Support 23/11523/2
beierlm [Thu, 13 Jan 2022 15:53:08 +0000 (10:53 -0500)]
Bug 1841: LTS Support

Updates base to Ubuntu 20.04
Updates python to 3.8
Updates pip dependencies to more recent versions
Adds apt cache to stage 2 dockerfile

Fixes bug 1841

Change-Id: I70af3cfab7484d7b284c143d554bef9f0be51812
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoBug 1858: Adding APT proxy 10/11510/3
beierlm [Thu, 13 Jan 2022 15:53:08 +0000 (10:53 -0500)]
Bug 1858: Adding APT proxy

Adds apt proxy to build scripts and dockerfiles.  Backward compatible
change and proxy will not be used unless environment variable
is supplied to docker build command.

Fixes bug 1858

Change-Id: Ibd25bd1c145b8d43eeb85c5c952aec30ebcce1fc
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoUpdate versions of helm3 and kubernetes for OSM community installer 00/11500/3
garciadeblas [Tue, 14 Dec 2021 17:02:30 +0000 (18:02 +0100)]
Update versions of helm3 and kubernetes for OSM community installer

Change-Id: Ibed733d04770f00789f4f0c2ed1faf77ffdb5143
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoLCM Dockerfile updated to use helm 3.7.2 and kubectl 1.20.14 99/11499/2
garciadeblas [Tue, 14 Dec 2021 16:46:08 +0000 (17:46 +0100)]
LCM Dockerfile updated to use helm 3.7.2 and kubectl 1.20.14

Change-Id: I0c1e4a5d56e7dd8057d10e5636d4ca07d462d364
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoRemoving Fog05 VIM RO Plugin 95/11495/2
sousaedu [Mon, 13 Dec 2021 22:34:01 +0000 (22:34 +0000)]
Removing Fog05 VIM RO Plugin

Change-Id: Iaff583362ed0421318ae79d0010e81ee5d974de4
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
2 years agoFix bug 1833: fix DATA_SOURCE_NAME in mysqld-exporter 01/11501/1
David Garcia [Fri, 17 Dec 2021 07:30:59 +0000 (08:30 +0100)]
Fix bug 1833: fix DATA_SOURCE_NAME in mysqld-exporter

Change-Id: I6641aa68aaa920bbe14ca688b984c5591c0ff72d
Signed-off-by: David Garcia <david.garcia@canonical.com>
2 years agoBug 1648: Update Microstack Installation 89/11489/2
beierlm [Thu, 9 Dec 2021 13:47:59 +0000 (08:47 -0500)]
Bug 1648: Update Microstack Installation

Change installation to --devmode instead of --classic
Add --control to the init
Checks for state before creating some objects
Use the admin password generated by MicroStack install script
Update default security group to have fully open access
Update the initial image laod to 20.04
Added creation of an osm-ext network with router to external

Fixes bug 1648

Change-Id: I6038be023bf04f99000b0ac8aeec7f7bcf205204
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoBug 1530: Limit IP addresses 85/11485/4
beierlm [Tue, 7 Dec 2021 21:15:53 +0000 (16:15 -0500)]
Bug 1530: Limit IP addresses

Adds an exit to the awk command so that only the first IP address is used on
a system that might have more than one IP address on the chosen interface

Fixes bug 1530

Change-Id: I7d5775ed1c1e801a338e048576d5106dc6c3d23a
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoBug 1531: Check for packages 84/11484/2
beierlm [Tue, 7 Dec 2021 21:02:22 +0000 (16:02 -0500)]
Bug 1531: Check for packages

Fixes logic to check for packages.  Originally based on dpkg -l, which could
return packages that were once installed, then removed.  Instead a new function
has been created that takes a list of packages to check and uses dpkg -L, which
will return an error if a package is not, or no longer, installed

Fixes bug 1531

Change-Id: Id096cf969aacca62dc7783b803e7925c796e325d
Signed-off-by: beierlm <mark.beierl@canonical.com>
2 years agoReports now available on qhttpd server 80/11380/4
veleza [Mon, 22 Nov 2021 11:26:50 +0000 (11:26 +0000)]
Reports now available on qhttpd server

Change-Id: I3f946e7e13554e7cab74993fabfaae54e04d453e
Signed-off-by: veleza <axel.velez@etsi.org>
2 years agoFix bug 1819 to report correctly osm_unhealthy 76/11476/1
garciadeblas [Fri, 3 Dec 2021 10:37:40 +0000 (11:37 +0100)]
Fix bug 1819 to report correctly osm_unhealthy

Change-Id: I5ca8b030f9124a35325876a5e88752483f668f50
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
2 years agoFix bug 1807 - Disabling RO OpenNebula plugin 48/11448/2
sousaedu [Mon, 29 Nov 2021 09:46:14 +0000 (09:46 +0000)]
Fix bug 1807 - Disabling RO OpenNebula plugin

Change-Id: I2d7a6256249ff4b2688b6fc5126ffe435757cfe1
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
2 years agoFix propagation of failures in installer scripts 12/11412/3
garciadeblas [Thu, 25 Nov 2021 10:57:18 +0000 (11:57 +0100)]
Fix propagation of failures in installer scripts

Change-Id: Ie83a4c9284ea63b40c37975da261634f930b6317
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
3 years agoPrevent tests Dockerfile to use cache of osm-packages repo 10/11410/2
garciadeblas [Wed, 24 Nov 2021 17:28:51 +0000 (18:28 +0100)]
Prevent tests Dockerfile to use cache of osm-packages repo

Change-Id: I867590f408bb401f7bd66785645f7d185ce6861e
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
3 years agoFix bug 1708 - Adding non-root user to run PLA 23/11323/4
sousaedu [Tue, 9 Nov 2021 23:59:54 +0000 (23:59 +0000)]
Fix bug 1708 - Adding non-root user to run PLA

Change-Id: I4c22ceb50c953f75654670fdd1b35e55e90db280
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
3 years agobugfix: prometheus config loop to avoid crashes during jobs collection changes listening 01/11401/2
bravof [Tue, 23 Nov 2021 20:21:58 +0000 (17:21 -0300)]
bugfix: prometheus config loop to avoid crashes during jobs collection changes listening

Change-Id: Ieb4e4caec3fe7f89f6bf0b4fc400ff0db88f3c4c
Signed-off-by: bravof <fbravo@whitestack.com>
3 years agoFix bug 1799: Add hostpath mount option in OSM charms 71/11371/4
David Garcia [Thu, 18 Nov 2021 15:45:05 +0000 (16:45 +0100)]
Fix bug 1799: Add hostpath mount option in OSM charms

Change-Id: Ie5ef484759bd37d6cc8dcea0f32573e2a7dd3a11
Signed-off-by: David Garcia <david.garcia@canonical.com>
3 years agoFix bug 1707 - Adding non-root user to run POL 66/11266/6
sousaedu [Thu, 14 Oct 2021 14:16:59 +0000 (15:16 +0100)]
Fix bug 1707 - Adding non-root user to run POL

Change-Id: I4b3df48e7c277de7ccd91b4a017577942ec4926f
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
3 years agoFix bug 1706 - Adding non-root user to run MON 64/11264/6
sousaedu [Thu, 14 Oct 2021 12:37:51 +0000 (13:37 +0100)]
Fix bug 1706 - Adding non-root user to run MON

Change-Id: I66e7cab3f4707dbe05e17749abd154e05c852888
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
3 years agoFix bug 1703 - Adding non-root user to run NBI 27/11227/12
sousaedu [Thu, 30 Sep 2021 13:07:57 +0000 (14:07 +0100)]
Fix bug 1703 - Adding non-root user to run NBI

The idea behind this is to run NBI as a non-root user for security
reasons. This required the creation of a new user in the container
image and setting permissions acordingly.

Change-Id: I9c8105b9b648c79643940994e51815118b9bbbe7
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
3 years agoFix bug 1705 - Adding non-root user to run RO 61/11261/5
sousaedu [Thu, 14 Oct 2021 02:55:25 +0000 (03:55 +0100)]
Fix bug 1705 - Adding non-root user to run RO

Change-Id: I3b5ccbd3efe4284996c81ebc65fc4adf53e9914e
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
3 years agofix(prometheus): decoupling prometheus/lcm modules. Depends on changes made to lcm 01/9901/20
bravof [Wed, 21 Oct 2020 19:58:50 +0000 (16:58 -0300)]
fix(prometheus): decoupling prometheus/lcm modules. Depends on changes made to lcm

Change-Id: I52b26344eac166a4b76523986c7900078342eb5b
Signed-off-by: bravof <fbravo@whitestack.com>
3 years agoMove NG-UI Dockerfile to use a build stage 68/11368/1
sousaedu [Thu, 18 Nov 2021 13:15:38 +0000 (13:15 +0000)]
Move NG-UI Dockerfile to use a build stage

Change-Id: I23685d6fea5a61048b367981468a91fcd8de0473
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
3 years agoFix bug 1777 - Adding openstack client to Keystone dockerfile 64/11364/3
sousaedu [Tue, 16 Nov 2021 23:16:09 +0000 (23:16 +0000)]
Fix bug 1777 - Adding openstack client to Keystone dockerfile

Change-Id: Ia4d8fc323a8d9b8a64810b676d4cb206d5fcd01f
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
3 years agoAdd NTP Sync 60/11360/1
beierlm [Tue, 16 Nov 2021 15:27:42 +0000 (10:27 -0500)]
Add NTP Sync

Adds ntp to the new VM and forces a full clock sync to avoid
any drift between Jenkins and ETSI VIM

Fixes bug 1773

Change-Id: I7cec55cdedcf53f6206ee54959dea4f8f1cfeb65
Signed-off-by: beierlm <mark.beierl@canonical.com>
3 years agoFix bug 1766: update to latest charm revisions (Charmed installer) 49/11349/2
David Garcia [Tue, 9 Nov 2021 07:45:49 +0000 (08:45 +0100)]
Fix bug 1766: update to latest charm revisions (Charmed installer)

The new revisions include:
 - fixed security issues: secret management
 - Authentication in prometheus and grafana
 - Fix n2vc path in LCM charm (debug-mode)

Change-Id: I4ace5a2e8e7f96883e439047dff739c8a9b40870
Signed-off-by: David Garcia <david.garcia@canonical.com>
3 years agoFix bug 1753: update keystone dockerfile to ubuntu 20.04 79/11279/6
bravof [Wed, 20 Oct 2021 14:48:16 +0000 (11:48 -0300)]
Fix bug 1753: update keystone dockerfile to ubuntu 20.04

Change-Id: I79eddf6085d27823ea67561113bdba9593ad6a41
Signed-off-by: bravof <fbravo@whitestack.com>
Signed-off-by: sousaedu <eduardo.sousa@canonical.com>
3 years agoFix bug 1757 to send installation_id in track function 31/11331/1
garciadeblas [Thu, 11 Nov 2021 08:54:38 +0000 (09:54 +0100)]
Fix bug 1757 to send installation_id in track function

Change-Id: I66bd6367938fd39f37564920810d4fe1a31a1765
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
3 years agoFix bug 1751 to add GCP connector to RO Dockerfile and RO charm 25/11325/1
garciadeblas [Tue, 9 Nov 2021 22:30:47 +0000 (23:30 +0100)]
Fix bug 1751 to add GCP connector to RO Dockerfile and RO charm

Change-Id: I00237ab83be75629bcef93c7cbfd6f132f85c3f3
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
3 years agoFix grafana datasource authentication in Charmed OSM 07/11307/3
David Garcia [Fri, 5 Nov 2021 11:33:03 +0000 (12:33 +0100)]
Fix grafana datasource authentication in Charmed OSM

Change-Id: I7620f0a3b52f378f97fea92e8542418a5da36e5f
Signed-off-by: David Garcia <david.garcia@canonical.com>
3 years agoFix bug 1746 to allow installation without docker proxy 16/11316/1
garciadeblas [Mon, 8 Nov 2021 22:02:01 +0000 (23:02 +0100)]
Fix bug 1746 to allow installation without docker proxy

Change-Id: Ie840cbe538a33c5240dc0edf604477dbdfe5ac98
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
3 years agoFix bug 1745 to update installers and manifests for Release ELEVEN 11/11311/1
garciadeblas [Mon, 8 Nov 2021 11:40:18 +0000 (12:40 +0100)]
Fix bug 1745 to update installers and manifests for Release ELEVEN

Change-Id: Ied76a46baca9940a2856a289ca8a5ddb7d1381f2
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>
3 years agoFeature 10892/10893/8460: refactor of OSM installer 81/11281/15 release-v11.0-start
garciadeblas [Wed, 20 Oct 2021 20:16:17 +0000 (22:16 +0200)]
Feature 10892/10893/8460: refactor of OSM installer

This change covers:

- Feature 10892. Installation of OSM on top of Ubuntu20.04. Changes
  are mostly in full_install_osm.sh and are related to the use of new
  versions of kubeadm and docker-ce. In addition, changes in Jenkins
  groovy files have been done to indicate the base image to be used,
  either 18.04 or 20.04.
- Feature 10893. Better tracking of installation. The code for tracking
  in in common/track. There is a function track that it is called in
  the different steps of the installation.
- Feature 8460: Cleanup old code in full_install_osm.sh. The script
  full_install_osm.sh has been split in different scripts performing
  specific tasks, thus simplifying the installer: install_docker_ce.sh,
  install_juju.sh and install_kubeadm_cluster.sh.

Change-Id: I1e388ec56285337eaf34f68470aa5a9b23ff45ff
Signed-off-by: garciadeblas <gerardo.garciadeblas@telefonica.com>