osm/MON.git
4 years agoMerge "Adds osm_automated tag to automated dashboards Fixes Bug 1027."
lavado [Fri, 20 Mar 2020 22:46:05 +0000 (23:46 +0100)]
Merge "Adds osm_automated tag to automated dashboards Fixes Bug 1027."

4 years agoAdds osm_automated tag to automated dashboards 06/8706/1
lavado [Fri, 20 Mar 2020 21:59:41 +0000 (16:59 -0500)]
Adds osm_automated tag to automated dashboards
Fixes Bug 1027.

Change-Id: Id4ef8828b93acc6a68b1020ff25043c36f4878e5
Signed-off-by: lavado <glavado@whitestack.com>
4 years agomigrating to ubuntu 18.04 88/8588/1
tierno [Wed, 5 Feb 2020 11:31:52 +0000 (11:31 +0000)]
migrating to ubuntu 18.04

Change-Id: Id120c2bb4a18b367a24eef567de1995794090777
Signed-off-by: tierno <alfonso.tiernosepulveda@telefonica.com>
(cherry picked from commit 46b49775fd781017ee9d6fcbd6d5aa6a24962a8b)

4 years agoCollect null project_ids as empty strings 79/8379/1 sol006 v7.0.0 v7.0.1rc1 v7.0.1rc2 v7.0.1rc3
lavado [Wed, 11 Dec 2019 11:32:48 +0000 (06:32 -0500)]
Collect null project_ids as empty strings

This deals with errored or transient elements at common
database that do not have a valid project_id.

Fixes bug 966

Change-Id: I628d621a9ad94c7c7e96894af8743fd30b90d893
Signed-off-by: lavado <glavado@whitestack.com>
4 years agoFixes double decryption 62/8362/1
beierl [Tue, 10 Dec 2019 01:54:58 +0000 (20:54 -0500)]
Fixes double decryption

Code to decrypt the passwords happens twice, causing
an error for the second decryption.

Bug 959

Change-Id: I873699af61ae45ae3ed45e98e0d8d087ba79dccc
Signed-off-by: beierl <mbeierl@vmware.com>
4 years agoValidate Grafana is present for dashboarder service 58/8358/3 v7.0.0rc1
lavado [Mon, 9 Dec 2019 21:02:18 +0000 (16:02 -0500)]
Validate Grafana is present for dashboarder service

Check if MON can resolve a grafana service.
This is currently useful in the transition to K8s,
or in OSM distros with absent Grafana.

Fixes Bug 932

Change-Id: I3b5ebf3d8ee3397f16793cd730e7e1fa5f6676d4
Signed-off-by: lavado <glavado@whitestack.com>
4 years agoFixes autoscaling with VNF Indicators 49/8349/2
Gianpietro Lavado [Sun, 8 Dec 2019 20:21:10 +0000 (20:21 +0000)]
Fixes autoscaling with VNF Indicators

Adds vdu_name to VNF Indicators collection.
This fixes autoscaling as Prometheus is queried using alarm
tags, which includes vdu_name.

Change-Id: I68e6368e4839b96737142be426d82d1b1e07e186
Signed-off-by: Gianpietro Lavado <glavado@whitestack.com>
4 years agoFix bug in juju metrics collection 47/8347/1
Gianpietro Lavado [Sun, 8 Dec 2019 13:27:02 +0000 (13:27 +0000)]
Fix bug in juju metrics collection

Change-Id: I0efd96227078df10e062d087afb86dc3796d4eb3
Signed-off-by: Gianpietro Lavado <glavado@whitestack.com>
4 years agominor enhancements to NS dashboard 41/8341/1
lavado [Fri, 6 Dec 2019 13:53:40 +0000 (08:53 -0500)]
minor enhancements to NS dashboard

Change-Id: I5241b55e0d54020027fd2a09dc13b32de9dd6689
Signed-off-by: lavado <glavado@whitestack.com>
4 years agoPartial fix for bug 936 (MON Part) 37/8337/3
lavado [Fri, 6 Dec 2019 03:22:26 +0000 (22:22 -0500)]
Partial fix for bug 936 (MON Part)

Change-Id: Ia574c865aa4d68d1e5bf4778762d96590e9bc907
Signed-off-by: lavado <glavado@whitestack.com>
4 years agoFix __init__.py file for dashboarder 12/8312/1
lavado [Wed, 4 Dec 2019 11:29:21 +0000 (06:29 -0500)]
Fix __init__.py file for dashboarder

Change-Id: I326b69d0917c7e7ebe70324409b0685f9f04263c
Signed-off-by: lavado <glavado@whitestack.com>
4 years agoFix bug in osm_mon path in Dashboarder service 03/8303/1
Gianpietro Lavado [Tue, 3 Dec 2019 15:16:14 +0000 (15:16 +0000)]
Fix bug in osm_mon path in Dashboarder service

Change-Id: I40fffb2d1a4c5ad8459fdbda5823e05ed4c6bdd7
Signed-off-by: Gianpietro Lavado <glavado@whitestack.com>
4 years agoMinor fixes for MON Evaluator & Dashboarder 89/8289/4
Gianpietro Lavado [Mon, 2 Dec 2019 17:41:20 +0000 (17:41 +0000)]
Minor fixes for MON Evaluator & Dashboarder

Change-Id: I1f2b1f786809aa84e2ee2cddbf401a03e504ff47
Signed-off-by: Gianpietro Lavado <glavado@whitestack.com>
4 years agoRe-Revert "Revert "Migrates alarms to MongoDB"" approved by TSC 78/8278/1
almagia [Sat, 30 Nov 2019 02:56:04 +0000 (03:56 +0100)]
Re-Revert "Revert "Migrates alarms to MongoDB"" approved by TSC

This reverts commit 628df021896fa8775f9743af62a4267b617cc35c.

Change-Id: Ie07a6856ee3f2e15c539d52afc4c7e5ecc07ca95

4 years agoRevert "Migrates alarms to MongoDB" 77/8277/1
lavado [Sat, 30 Nov 2019 02:15:09 +0000 (03:15 +0100)]
Revert "Migrates alarms to MongoDB"

This reverts commit b6233b3d90ca1ba617e476b915fba056cf7891f7.

Change-Id: I82b7c5916cdf7eb2816348c4ea13609d0fddffe6
Signed-off-by: lavado <glavado@whitestack.com>
4 years agoMigrates alarms to MongoDB 74/8274/1
Benjamin Diaz [Wed, 9 Oct 2019 15:36:50 +0000 (12:36 -0300)]
Migrates alarms to MongoDB

Change-Id: Iec09f507f05f6694910bf5ea82b948372d837af3
Signed-off-by: lavado <glavado@whitestack.com>
4 years agoMinor fixes to additional metric labels 70/8270/1
lavado [Fri, 29 Nov 2019 17:40:30 +0000 (12:40 -0500)]
Minor fixes to additional metric labels

Change-Id: Ia2ad1b28c7c1fd61effaf46d04f97e004a93be15
Signed-off-by: lavado <glavado@whitestack.com>
4 years agoGrafana dashboard automation 84/8184/11
lavado [Fri, 15 Nov 2019 22:04:02 +0000 (17:04 -0500)]
Grafana dashboard automation

Change-Id: I78a353ad59ea39cf747412e00ae2210826862150
Signed-off-by: lavado <glavado@whitestack.com>
4 years agoMerge "Adding more labels to Prometheus metrics"
lavado [Fri, 29 Nov 2019 16:24:16 +0000 (17:24 +0100)]
Merge "Adding more labels to Prometheus metrics"

4 years agoMerge "Adding project_id label to Prometheus Infra metrics"
lavado [Fri, 29 Nov 2019 16:23:21 +0000 (17:23 +0100)]
Merge "Adding project_id label to Prometheus Infra metrics"

4 years agoMerge "Revert "Migrates alarms to MongoDB""
lavado [Fri, 29 Nov 2019 15:25:21 +0000 (16:25 +0100)]
Merge "Revert "Migrates alarms to MongoDB""

4 years agoRevert "Migrates alarms to MongoDB" 62/8262/2
lavado [Fri, 29 Nov 2019 13:00:24 +0000 (14:00 +0100)]
Revert "Migrates alarms to MongoDB"

This reverts commit 0085a4a8870a73a9186b0a2305ba00bae44a6ea0.

Change-Id: Ifd94058969c1480863a67529a9d5ed70e5e062c3
Signed-off-by: Gianpietro Lavado <glavado@whitestack.com>
4 years agoMerge "Migrates alarms to MongoDB"
lavado [Fri, 29 Nov 2019 12:58:22 +0000 (13:58 +0100)]
Merge "Migrates alarms to MongoDB"

5 years agoAdding project_id label to Prometheus Infra metrics 54/8154/6
lavado [Tue, 12 Nov 2019 03:00:50 +0000 (22:00 -0500)]
Adding project_id label to Prometheus Infra metrics

Change-Id: I24fb5f1eb33e0adb6bca396b8f74dafeeae93917
Signed-off-by: lavado <glavado@whitestack.com>
5 years agoUpgrading PyYaml due to new juju package 47/8147/2
lavado [Mon, 11 Nov 2019 21:25:35 +0000 (16:25 -0500)]
Upgrading PyYaml due to new juju package

Change-Id: Idce6235e9bdd033d16d207734c9e1ddd0ed0453b
Signed-off-by: lavado <glavado@whitestack.com>
5 years agoAdding more labels to Prometheus metrics 41/8141/14
lavado [Mon, 11 Nov 2019 11:41:38 +0000 (06:41 -0500)]
Adding more labels to Prometheus metrics

Change-Id: I412de4ee47808af09e4156b703a95d1edb5fbca7
Signed-off-by: lavado <glavado@whitestack.com>
5 years agoFixed request for OpenStack Rocky Endpoints 43/8143/1
Antonio Marsico [Mon, 11 Nov 2019 16:17:01 +0000 (16:17 +0000)]
Fixed request for OpenStack Rocky Endpoints

Gnocchi enpoints where not loaded correctly with
        the previous patch.

Change-Id: Ib27183ea8cfeda64f80c11bc40b451d28b92514e
Signed-off-by: Antonio Marsico <antonio.marsico@bt.com>
5 years agoMigrates alarms to MongoDB 37/8037/2
Benjamin Diaz [Wed, 9 Oct 2019 15:36:50 +0000 (12:36 -0300)]
Migrates alarms to MongoDB

Change-Id: Ic71f1d408ef06a6c04e0e95d16389b2c3e0f8630
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoFixed the usage of self signed certificates 38/8038/1 feature5837 feature7928
Antonio Marsico [Wed, 9 Oct 2019 09:02:42 +0000 (09:02 +0000)]
Fixed the usage of self signed certificates

Change-Id: I5962256da90fabd1332527d7cba422204549f7a0
Signed-off-by: Antonio Marsico <antonio.marsico@bt.com>
5 years agoRefactors alarms to decouple them from vnf specific data 63/7963/2
Benjamin Diaz [Thu, 19 Sep 2019 14:59:06 +0000 (11:59 -0300)]
Refactors alarms to decouple them from vnf specific data

Alarms now handle the concept of tags, instead of having vnf specific
parameters in the model. This allows for wider usecases of alarms (e.g. fault management).

Change-Id: I2b395c4bb7f72d4fb7c53b75feccd7de00508013
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoRemoves obsolete documentation. Adds architectural docs. 48/7848/4
Benjamin Diaz [Fri, 16 Aug 2019 16:17:28 +0000 (13:17 -0300)]
Removes obsolete documentation. Adds architectural docs.

Change-Id: I9ee1a87ed78de06c4f726f1aecbb3c988f41fb05
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoMerge "Replaces call to Gnocchi status for a request of metric list when determining...
diazb [Wed, 4 Sep 2019 18:26:12 +0000 (20:26 +0200)]
Merge "Replaces call to Gnocchi status for a request of metric list when determining backend in openstack vnf collector"

5 years agoChange coverage path 02/7902/1
beierl [Tue, 3 Sep 2019 16:48:31 +0000 (12:48 -0400)]
Change coverage path

Changes the patch for the coverage.xml file so the
Jenkins plugin can find the source code for display.

Change-Id: I2cff214a69799e9f46cc2a5c8ca5e85a290daffb
Signed-off-by: beierl <mbeierl@vmware.com>
5 years agoReplaces call to Gnocchi status for a request of metric list when determining backend... 03/7903/1
Benjamin Diaz [Mon, 2 Sep 2019 19:19:10 +0000 (16:19 -0300)]
Replaces call to Gnocchi status for a request of metric list when determining backend in openstack vnf collector

When trying to determine metric backend, the openstack vnf collector was
requesting Gnocchi status data, which is only available for privileged users.
This generated errors in the metric collection when using a nonadmin openstack user.

Change-Id: I6a85f27c4714a1d3f8bbbf82da1795066352a1e0
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoReadds logic to obtain vim_type when it is available in vim config 63/7863/2
Benjamin Diaz [Tue, 27 Aug 2019 20:49:59 +0000 (17:49 -0300)]
Readds logic to obtain vim_type when it is available in vim config

bug 835

Change-Id: Ia8a870ede8b6ceac71329a09a25c7d9ba4d6219e
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds check for config param in vim_account dict to avoid errors when it does not... 44/7844/2
Benjamin Diaz [Tue, 13 Aug 2019 16:50:09 +0000 (13:50 -0300)]
Adds check for config param in vim_account dict to avoid errors when it does not exist

Change-Id: Iceb0b03a67464ff35ec5e700e5e3b1be92cb48b9
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds vrops_password to passwords to decrypt. Adds check of schema_version for backwar... 43/7843/1
Benjamin Diaz [Mon, 12 Aug 2019 18:14:10 +0000 (15:14 -0300)]
Adds vrops_password to passwords to decrypt. Adds check of schema_version for backwards compatibility

Change-Id: I601b2eec9d84b0f2c33486b184c9ef279a583a24
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoMerge "Change to nose2"
diazb [Mon, 5 Aug 2019 15:47:07 +0000 (17:47 +0200)]
Merge "Change to nose2"

5 years agoModifies MON to use mongodb directly for vim info and do vim pass decryption on demand 18/7818/9
Benjamin Diaz [Mon, 29 Jul 2019 15:00:38 +0000 (12:00 -0300)]
Modifies MON to use mongodb directly for vim info and do vim pass decryption on demand

Change-Id: Id088f60bcbe7943661d088f949b55465c4939800
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoChange to nose2 26/7826/5
beierl [Wed, 31 Jul 2019 19:06:10 +0000 (15:06 -0400)]
Change to nose2

Use nose2 instead of stestr for running unit test as nose2 provides
junit-style xml output that can be reported in Jenkins to show test
pass/fail and trend history.

Change-Id: I3f57992ca7252bfd5403f7fdf7153d1faa232e71
Signed-off-by: beierl <mbeierl@vmware.com>
5 years agoFixes VIO collection 12/7812/7
beierl [Thu, 25 Jul 2019 17:05:58 +0000 (13:05 -0400)]
Fixes VIO collection

Extract common vROPS code from vmware and vio collectors.
Add unit test coverage.
Remove unused code.
Improved vROPS collection to ask for current values only
instead of a date range.
Reduces number of calls to vROPS by asking for all metrics
for all VDUs at once.

BUG 796

Change-Id: I00ecd70c6d25f7c8982cbc633a28ab6f1ceb8cd6
Signed-off-by: beierl <mbeierl@vmware.com>
5 years agoCorrect multiplier 76/7776/2
beierl [Mon, 15 Jul 2019 15:56:21 +0000 (11:56 -0400)]
Correct multiplier

Use the correct metric name when multiplying network
bytes sent/received.

Change-Id: I51391f5b0c55aeca5ecc4e2888d8365bf8d77cd7
Signed-off-by: beierl <mbeierl@vmware.com>
5 years agoAdds unit test coverage 71/7771/3
beierl [Fri, 12 Jul 2019 15:55:36 +0000 (11:55 -0400)]
Adds unit test coverage

Adds the coverage and stestr modules to tox so
that unit test code coverage reports can be
generated.

Change-Id: If67b31be5996de95e60ad73f63124e181ec955b5
Signed-off-by: beierl <mbeierl@vmware.com>
5 years agoRemoves kafka check from healthcheck 72/7772/1
Benjamin Diaz [Fri, 12 Jul 2019 20:10:00 +0000 (17:10 -0300)]
Removes kafka check from healthcheck

bug 801

Change-Id: Ia966da925695c4e56f490820e627c36a02c81a81
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoMerge "Reduce Resource Consumption"
diazb [Mon, 1 Jul 2019 20:30:30 +0000 (22:30 +0200)]
Merge "Reduce Resource Consumption"

5 years agoReduce Resource Consumption 98/7698/6
beierl [Mon, 24 Jun 2019 19:51:33 +0000 (15:51 -0400)]
Reduce Resource Consumption

The vmware vnf collector requests a time series of data from
vROPS and then parses the whole block in order to retrieve the
most recent data element.  The time frame for the request
should be limited to a sane value, such as 1 hour.

The look ups for items that do not change should be outside
of the loop for looking up the metrics.

Add more metrics to list of supported metrics.

Improve error handling.

BUG 784

Change-Id: Ie3cef457eaf657c18ba682e3c5d3abf40a759e69
Signed-off-by: beierl <mbeierl@vmware.com>
5 years agoAdds support for custom project and user domain names defined in vim config 08/7708/1
Benjamin Diaz [Wed, 26 Jun 2019 16:18:38 +0000 (13:18 -0300)]
Adds support for custom project and user domain names defined in vim config

bug 789

Change-Id: I77fe4a1f9fce4d1767560458de116f3431b35894
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoChanges insufficient data validation in alarms to account for metric results 0.0 97/7697/1
Benjamin Diaz [Mon, 24 Jun 2019 18:50:38 +0000 (15:50 -0300)]
Changes insufficient data validation in alarms to account for metric results 0.0

Change-Id: Ia67e54ced6f5885ecd875c8a94529b9384fa46b2
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoSource Dockerfile now points to master for N2VC and osm-common allowing better dev... 60/7660/3
Benjamin Diaz [Wed, 12 Jun 2019 19:23:56 +0000 (16:23 -0300)]
Source Dockerfile now points to master for N2VC and osm-common allowing better dev testing

Change-Id: Iab1f4c0fc761efe9eb7d1aa3fe184fac604ad2a2
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoNegotiate vCD Version 80/7680/4
beierl [Wed, 19 Jun 2019 01:17:08 +0000 (21:17 -0400)]
Negotiate vCD Version

Request highest supported vCD version between MON and
vCD on setup and then continue to use v27.0 as the confirmed
tested version.

BUG 775

Change-Id: I04333fa0c915107fb432d799d3440fec711d95ec
Signed-off-by: beierl <mbeierl@vmware.com>
5 years agoMake vcloud api version compatible for different vCDs 72/7672/1
kasar [Tue, 18 Jun 2019 07:39:04 +0000 (00:39 -0700)]
Make vcloud api version compatible for different vCDs

Change-Id: Ic0b1f9e18b1711f73ec2b2c876e8211534caaa87
Signed-off-by: kasar <pkasar@vmware.com>
5 years agoAdds validation of vim-id in vdur in OpenStack base infra plugin 59/7659/2 v6.0.0
Benjamin Diaz [Wed, 12 Jun 2019 19:21:34 +0000 (16:21 -0300)]
Adds validation of vim-id in vdur in OpenStack base infra plugin

Prevents errors in vim_status collection when vm_status fails because vim-id
param missing in vdur.

Change-Id: I81f10ee19b7fa17e9cbbe4526c4d3be19eae1834
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoReplaces use of vdu_name for vdu_id and vdu_count_index in VCACollector 58/7658/3
Benjamin Diaz [Wed, 12 Jun 2019 19:18:55 +0000 (16:18 -0300)]
Replaces use of vdu_name for vdu_id and vdu_count_index in VCACollector

vdu_name param is no longer configured by LCM, causing issues during
collection of VCA metrics. To fix that, it has been replaced by currently
configured params: vdu_id and vdu_count_index, which are obtained from the
vdur.

Fixes bug 762

Change-Id: Ic8cc7e8572bfc6d78493fdceea32375c6f3a379e
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoRemove use of granularity and just retrieve last metric collected in OpenStack plugin 13/7613/4
Benjamin Diaz [Wed, 5 Jun 2019 14:39:07 +0000 (11:39 -0300)]
Remove use of granularity and just retrieve last metric collected in OpenStack plugin

Change-Id: I8e52cda7bffb069a76b3834964100399a1c5746b
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoChanges openstack vim status check to use nova to allow non admin users in config 09/7609/3
Benjamin Diaz [Tue, 4 Jun 2019 13:55:18 +0000 (10:55 -0300)]
Changes openstack vim status check to use nova to allow non admin users in config

Change-Id: I1cdfeac879580a61e0211e869785c737763cd310
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoModifies logic por determining metric backend in OpenStack plugin 08/7608/4
Benjamin Diaz [Tue, 4 Jun 2019 13:35:03 +0000 (10:35 -0300)]
Modifies logic por determining metric backend in OpenStack plugin

Removes the need to access the service catalog directly.

Change-Id: I8c4f4bff4bbd236c3ec5a33e4f1abd38b8dcf010
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds network interface name as tag in corresponding metric 06/7606/1
Benjamin Diaz [Tue, 4 Jun 2019 12:55:50 +0000 (09:55 -0300)]
Adds network interface name as tag in corresponding metric

Change-Id: I5c02d9a0582113319936772bd456b347828f7443
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoFixes missing parent constructor call in openstack based infra collectors 91/7491/1
Benjamin Diaz [Wed, 22 May 2019 19:28:28 +0000 (16:28 -0300)]
Fixes missing parent constructor call in openstack based infra collectors

Change-Id: Iaed814e59b81a664a4e2009ddf93d2edf2ad4502
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoMerge "Added vio infra collector plugin"
diazb [Tue, 21 May 2019 18:24:09 +0000 (20:24 +0200)]
Merge "Added vio infra collector plugin"

5 years agoAdded vio infra collector plugin 51/7451/4
kasar [Thu, 9 May 2019 07:55:30 +0000 (00:55 -0700)]
Added vio infra collector plugin

Change-Id: I709b2b358cb6aae1d07e01ba9a010cf8592ee735
Signed-off-by: kasar <pkasar@vmware.com>
5 years agoAdds handling of exception inside OpenStack collector 52/7452/1
Benjamin Diaz [Thu, 9 May 2019 19:40:38 +0000 (16:40 -0300)]
Adds handling of exception inside OpenStack collector

Change-Id: I9756bef185a3f9495a2ffe737bf5b8326a7e8af6
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoImplemented VMware infra collector plugin 32/7432/5
kasar [Fri, 19 Apr 2019 10:57:58 +0000 (03:57 -0700)]
Implemented VMware infra collector plugin

Change-Id: Id46ceb4955ef1c9e9b3389c1016e77a41b7fda1b
Signed-off-by: kasar <pkasar@vmware.com>
5 years agoImproves README 30/7430/2 feature7106
Benjamin Diaz [Fri, 26 Apr 2019 18:56:36 +0000 (15:56 -0300)]
Improves README

Change-Id: I4bf5d7d13822b20af8828b048c80092209dbf96d
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds support for interface specific metrics in OpenStack plugin 16/7416/9
Benjamin Diaz [Tue, 16 Apr 2019 15:41:24 +0000 (12:41 -0300)]
Adds support for interface specific metrics in OpenStack plugin

Change-Id: I374a2c623a783215b2bbbdf8a69e600e3cb0f55d
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoFixes error during alarm evaluation 08/7408/3
Benjamin Diaz [Fri, 12 Apr 2019 15:53:05 +0000 (12:53 -0300)]
Fixes error during alarm evaluation

Adds unit test

Change-Id: I2679210b7ce13f8ffd714183c220b617236003f8
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoRefactors code and adds unit tests 01/7401/2
Benjamin Diaz [Wed, 10 Apr 2019 18:22:22 +0000 (15:22 -0300)]
Refactors code and adds unit tests

Change-Id: Ia14034679af8fc7e9ac91a1bfb766e4b99ec9e39
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds pylint to tox test pipeline and fixes related errors 00/7400/2
Benjamin Diaz [Wed, 10 Apr 2019 20:06:19 +0000 (17:06 -0300)]
Adds pylint to tox test pipeline and fixes related errors

Change-Id: I0965b2818898d144a441208391f4c831fa28279b
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds partial support for interface metrics in OpenStack plugin 92/7392/2
Benjamin Diaz [Thu, 4 Apr 2019 19:33:01 +0000 (16:33 -0300)]
Adds partial support for interface metrics in OpenStack plugin

Adds support for 'packets_in_dropped', 'packets_out_dropped', 'packets_received', 'packets_sent'
All of this metrics correspond to a sum of the metric for each interface in the vdu

Change-Id: I93b4fb760b927f98417ae2e65a27c0c2b3fb5b6f
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds support for multiple alarm statuses 22/7322/3
Benjamin Diaz [Wed, 6 Mar 2019 18:53:56 +0000 (15:53 -0300)]
Adds support for multiple alarm statuses

Requirement for Feature 6373

Change-Id: I5440c6cdd8e4b3ad12bcf8949871c67a74f31500
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoFixes bug with VM status collection when VIM is down 83/7283/1
Benjamin Diaz [Wed, 6 Mar 2019 18:54:37 +0000 (15:54 -0300)]
Fixes bug with VM status collection when VIM is down

Change-Id: I5f4c8ad9d074ede337aae53e4120088d0a307170
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds collection of sdnc status metric 81/7281/1
Benjamin Diaz [Mon, 4 Mar 2019 14:03:43 +0000 (11:03 -0300)]
Adds collection of sdnc status metric

Adds plugin for ONOS controller

Change-Id: I0a885a4061a1cf9f99276d3befece078ac991d32
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds support in entrypoint script for more complex mysql URI (+pool and query params) 80/7280/1
Benjamin Diaz [Tue, 5 Mar 2019 17:28:32 +0000 (14:28 -0300)]
Adds support in entrypoint script for more complex mysql URI (+pool and query params)

Change-Id: I71445bbd489b905cb796eff294997a83e4d4cb91
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoOpens and closes db connections manually to avoid errors when using MySQL backend 79/7279/1
Benjamin Diaz [Fri, 8 Feb 2019 16:41:12 +0000 (13:41 -0300)]
Opens and closes db connections manually to avoid errors when using MySQL backend

Change-Id: I39f7d17069afa6aaceb643f9ecbfeb5595c4ed9a
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoMerge "Added VIO metrics collector for vROPs"
lavado [Sat, 2 Mar 2019 02:48:04 +0000 (03:48 +0100)]
Merge "Added VIO metrics collector for vROPs"

5 years agoAdded VIO metrics collector for vROPs 59/7259/5
kasar [Wed, 27 Feb 2019 06:34:41 +0000 (22:34 -0800)]
Added VIO metrics collector for vROPs

Change-Id: Ia044fd0c8dd600104df32c0c613e8725f34d0b3c
Signed-off-by: kasar <pkasar@vmware.com>
5 years agoModifies MON to create database if using mysql URI 55/7255/5
Benjamin Diaz [Mon, 25 Feb 2019 20:19:23 +0000 (17:19 -0300)]
Modifies MON to create database if using mysql URI

Removes default value of config in VimCredentials as MySQL does not support
it.
Adds pymysql as dependency.

Change-Id: Idb60029e027f8abad7de4617c12bde20aa66deab
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds collection of VM status metric in OpenStack infra plugin 48/7248/2
Benjamin Diaz [Fri, 22 Feb 2019 19:36:00 +0000 (16:36 -0300)]
Adds collection of VM status metric in OpenStack infra plugin

OpenStack infra collector plugin now collects metrics regarding VM status. It
iterates over vdus and using nova client gets info regarding status. Active
status translates to 1, anything else to 0.

Change-Id: Ia6e36a79a1d20cea07d5c7b3aa2af85b5c0e18d0
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds migration engine for peewee ORM 46/7246/2
Benjamin Diaz [Thu, 21 Feb 2019 19:24:56 +0000 (16:24 -0300)]
Adds migration engine for peewee ORM

Change-Id: I8829dd6e3858149fad9e1c37d773c78523d8c05f
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds support for Ceilometer API metric collection 36/7236/2
Benjamin Diaz [Tue, 19 Feb 2019 23:49:39 +0000 (20:49 -0300)]
Adds support for Ceilometer API metric collection

Change-Id: Id0e841c465ea5772d08413dacdf490a1fc109dff
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoImplements filebased config, config override through env vars, use of osm 17/7217/8
Benjamin Diaz [Wed, 6 Feb 2019 14:58:00 +0000 (11:58 -0300)]
Implements filebased config, config override through env vars, use of osm
common msg bus drivers

Change-Id: I2ae26408f03a7faf86d5621efda50df948c55951
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds collection of vim status metric 98/7198/2
Benjamin Diaz [Mon, 4 Feb 2019 16:38:11 +0000 (13:38 -0300)]
Adds collection of vim status metric

Current support is only OpenStack. It tries to do a simple project list query
to check if VIM is up or not.

Change-Id: Ifec844d9514b6c676b065fee7cf785bdf2a2ea3d
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoExits mon-evaluator process when encountered by a database exception 97/7197/2
Benjamin Diaz [Mon, 28 Jan 2019 22:03:39 +0000 (19:03 -0300)]
Exits mon-evaluator process when encountered by a database exception

Database errors could mean database node failure. In this cases, the process
should exit so it could be automatically restarted (when handled by Docker Swarm, K8s, etc)
so it can obtain a new DB connection to an alive node.

Change-Id: I2575062d4bd23b3902b7c2ed14553d5201933002
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoChanges log level of config info to debug 96/7196/1
Benjamin Diaz [Mon, 28 Jan 2019 17:41:53 +0000 (14:41 -0300)]
Changes log level of config info to debug

Change-Id: I6fe866709cba1ae6310c54313269bac7a3b858d7
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoMerge "Bug 598 Added support for vrops metric collection"
lavado [Tue, 5 Feb 2019 11:20:32 +0000 (12:20 +0100)]
Merge "Bug 598 Added support for vrops metric collection"

5 years agoBug 598 Added support for vrops metric collection 41/7141/3
kasar [Wed, 30 Jan 2019 10:03:40 +0000 (02:03 -0800)]
Bug 598 Added support for vrops metric collection

Change-Id: I63dcff326e88f5b103b535981fdc06cb665904f1
Signed-off-by: kasar <pkasar@vmware.com>
5 years agoAdds decryption of passwords in vim config block 49/7149/1
Benjamin Diaz [Wed, 30 Jan 2019 16:01:54 +0000 (13:01 -0300)]
Adds decryption of passwords in vim config block

Change-Id: Iba064f9fb0dd38511b90410c5073fc13ce8cbeac
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoIncreases delta of start_time when collecting OpenStack metrics 27/7127/1
Benjamin Diaz [Fri, 25 Jan 2019 19:31:55 +0000 (16:31 -0300)]
Increases delta of start_time when collecting OpenStack metrics

Change-Id: I5d51c26a7a80a407a6f892d542d44420c5832e02
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoChanges way of getting VCA application name corresponding to vdu and vnf 92/6992/2 v5.0.0 v5.0.1 v5.0.2
Benjamin Diaz [Wed, 28 Nov 2018 20:26:28 +0000 (17:26 -0300)]
Changes way of getting VCA application name corresponding to vdu and vnf

MON now searches _admin dictionary in nsr to get the application and
respective model name.

Change-Id: I0a034ff20bd41356da04b1a979839b92f93d26cd
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
5 years agoAdds use of aiokafka in mon-server 64/6964/3
Benjamin Diaz [Mon, 26 Nov 2018 16:14:33 +0000 (13:14 -0300)]
Adds use of aiokafka in mon-server

Adds request timeout param for requests made to Prometheus
Adds use of response topics based on cor_id for alarm create/delete RPC

Change-Id: I5544d749d812e4e77ba913b543ccaa83542535d4
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
6 years agoAdds support for vnf-metric in mon-evaluator 58/6958/1
Benjamin Diaz [Sat, 24 Nov 2018 03:05:11 +0000 (00:05 -0300)]
Adds support for vnf-metric in mon-evaluator

Change-Id: I81e69761448418625ca4076f6e3d3903c07c9f58
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
6 years agoFixes bug in collection of vnf-metric 57/6957/1
Benjamin Diaz [Fri, 23 Nov 2018 21:36:28 +0000 (18:36 -0300)]
Fixes bug in collection of vnf-metric

Metrics declared in vnf-configuration block were not building correctly the juju
application name.

Change-Id: I952a0a2716edc7a0ea42ae1254ddc5047bcfff89
Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
6 years agoFixes bugs regarding alarm deletion 45/6945/4
Benjamin Diaz [Thu, 22 Nov 2018 20:27:35 +0000 (17:27 -0300)]
Fixes bugs regarding alarm deletion

Adds healthcheck script to be used in devops MON Dockerfile
Removes unused dependencies

Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
Change-Id: Ia353c0ae9ee6a502667c04c96f1bc7f3e9337ced

6 years agoRevert "Readds plugins code and respective tests" 39/6939/1
almagia [Wed, 21 Nov 2018 16:22:07 +0000 (18:22 +0200)]
Revert "Readds plugins code and respective tests"
MON code optimisation on behalf of TSC

This reverts commit 6eda48bf7489c00fee4e1f276404ab82db23fd1d.

Change-Id: If697df74221be72aca9630630e64033f06ece473

6 years agoReadds plugins code and respective tests 29/6929/4
Benjamin Diaz [Wed, 21 Nov 2018 13:52:05 +0000 (10:52 -0300)]
Readds plugins code and respective tests

Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
Change-Id: I80ad624892b513818b1c989494884cc8047e377e

6 years agoAdds support for VNF metric based alarming 32/6932/7
Benjamin Diaz [Tue, 20 Nov 2018 17:01:43 +0000 (14:01 -0300)]
Adds support for VNF metric based alarming

Adds collect_one method to juju collector, which is used by mon-evaluator to
evaluate alarms.

Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
Change-Id: I952280c3c8fa7496f0ea818b7a2ef7f3a091deea

6 years agoRefactors Prometheus exporter to group metrics correctly by name 25/6925/1
Benjamin Diaz [Tue, 20 Nov 2018 14:56:43 +0000 (11:56 -0300)]
Refactors Prometheus exporter to group metrics correctly by name

Metric names were appearing duplicated in the exporter which generated issues
integrating with external tools such as Metricbeat and Kibana.

Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
6 years agoAdds use of uri in connection to MongoDB instead of host and port 23/6923/1
Benjamin Diaz [Tue, 20 Nov 2018 14:18:43 +0000 (11:18 -0300)]
Adds use of uri in connection to MongoDB instead of host and port

MON now uses a mongodb uri to connect to the database. This allows to use uris
that define either a single node db or a replica set, allowing for HA
scenarios.

Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
6 years agoRevert "Adds use of uri in connection to MongoDB instead of host and port" 22/6922/1
lavado [Tue, 20 Nov 2018 14:10:37 +0000 (16:10 +0200)]
Revert "Adds use of uri in connection to MongoDB instead of host and port"

This reverts commit 2fa92533799dcac2fbb47db2e06579e951294e6a.

Change-Id: Ief2dc8eb49577c9321b34f67efa5296edc281056

6 years agoAdds use of uri in connection to MongoDB instead of host and port 19/6919/1
Benjamin Diaz [Tue, 20 Nov 2018 12:14:09 +0000 (09:14 -0300)]
Adds use of uri in connection to MongoDB instead of host and port

MON now uses a mongodb uri to connect to the database. This allows to use uris
that define either a single node db or a replica set, allowing for HA
scenarios.

Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
6 years agoAdds alarm engine 08/6908/2
Benjamin Diaz [Thu, 15 Nov 2018 13:27:12 +0000 (10:27 -0300)]
Adds alarm engine

Alarms are now created directly through mon-central. A new component called
mon-evaluator evaluates the alarms and sends a notification in case it
triggers. Alarms are still created through the Kafka bus using the same model.

It also deletes all of the old unused code of the plugin model. There were
thousands of lines dedicated to provide CRUD operations for metrics and alarms
in the VIM plugins that were never used. MON only requires to collect metrics
and insert them in the TSDB. VIMs manage their metrics autonomously. The tests
for that were also removed. This was done to make the codebase more
manageable. Support for VROPS and AWS will be added in a future patch. Neither
of those two plugins worked correctly. They need to be adapted to the new
consumer plugin model.

Signed-off-by: Benjamin Diaz <bdiaz@whitestack.com>
Change-Id: I656c78be82ca21b760a83b478560d0c8ae680222