2024-05-25T22:38:22.435919957Z 2024-05-25T22:38:22.452281695Z Cleaning logs every 900 seconds 2024-05-25T22:38:22.452303894Z Trimming airflow logs to 15 days. 2024-05-25T22:45:00.505035713Z Trimming airflow logs to 15 days. 2024-05-25T22:45:01.531008064Z Trimming airflow logs to 15 days. 2024-05-25T23:00:00.570109718Z Trimming airflow logs to 15 days. 2024-05-25T23:00:01.613553285Z Trimming airflow logs to 15 days. 2024-05-25T23:15:00.653648061Z Trimming airflow logs to 15 days. 2024-05-25T23:15:01.713272917Z Trimming airflow logs to 15 days. 2024-05-25T23:30:00.775799725Z Trimming airflow logs to 15 days. 2024-05-25T23:30:01.844982548Z Trimming airflow logs to 15 days. 2024-05-25T23:45:00.908196969Z Trimming airflow logs to 15 days. 2024-05-25T23:45:01.962800718Z Trimming airflow logs to 15 days. 2024-05-26T00:00:00.037838875Z Trimming airflow logs to 15 days. 2024-05-26T00:00:01.094463444Z Trimming airflow logs to 15 days. 2024-05-26T00:15:00.178112727Z Trimming airflow logs to 15 days. 2024-05-26T00:15:01.259777341Z Trimming airflow logs to 15 days. 2024-05-26T00:30:00.342111000Z Trimming airflow logs to 15 days. 2024-05-26T00:30:01.413045813Z Trimming airflow logs to 15 days. 2024-05-26T00:45:00.505599710Z Trimming airflow logs to 15 days. 2024-05-26T00:45:01.576883237Z Trimming airflow logs to 15 days. 2024-05-26T01:00:00.648768733Z Trimming airflow logs to 15 days. 2024-05-26T01:00:01.726951103Z Trimming airflow logs to 15 days. 2024-05-26T01:15:00.844590602Z Trimming airflow logs to 15 days. 2024-05-26T01:15:01.942853115Z Trimming airflow logs to 15 days. 2024-05-26T01:30:00.027424913Z Trimming airflow logs to 15 days. 2024-05-26T01:30:01.129773104Z Trimming airflow logs to 15 days. 2024-05-26T01:45:00.277143081Z Trimming airflow logs to 15 days. 2024-05-26T01:45:01.368386932Z Trimming airflow logs to 15 days. 2024-05-26T02:00:00.468228438Z Trimming airflow logs to 15 days. 2024-05-26T02:00:01.575768443Z Trimming airflow logs to 15 days. 2024-05-26T02:15:00.704029098Z Trimming airflow logs to 15 days. 2024-05-26T02:15:01.816869751Z Trimming airflow logs to 15 days. 2024-05-26T02:30:00.933162770Z Trimming airflow logs to 15 days. 2024-05-26T02:45:00.074830141Z Trimming airflow logs to 15 days. 2024-05-26T02:45:01.206497199Z Trimming airflow logs to 15 days. 2024-05-25T22:37:54.887784564Z .. 2024-05-25T22:37:55.266701255Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-25T22:37:56.632463894Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-25T22:38:03.028722299Z [2024-05-25T22:38:03.027+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-05-25T22:38:04.037553111Z [2024-05-25T22:38:04.036+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-05-25T22:38:05.042736583Z [2024-05-25T22:38:05.042+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-05-25T22:38:15.346475475Z 2024-05-25T22:38:18.644437770Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-25T22:38:22.383711379Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-25T22:38:27.754275336Z [2024-05-25 22:38:27 +0000] [15] [INFO] Starting gunicorn 20.1.0 2024-05-25T22:38:27.771768658Z [2024-05-25 22:38:27 +0000] [15] [INFO] Listening at: http://[::]:8793 (15) 2024-05-25T22:38:27.771780310Z [2024-05-25 22:38:27 +0000] [15] [INFO] Using worker: sync 2024-05-25T22:38:27.823686618Z [2024-05-25 22:38:27 +0000] [16] [INFO] Booting worker with pid: 16 2024-05-25T22:38:27.924806527Z [2024-05-25 22:38:27 +0000] [17] [INFO] Booting worker with pid: 17 2024-05-25T22:38:30.188930064Z 2024-05-25T22:38:30.188948284Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-05-25T22:38:30.188965689Z --- ***** ----- 2024-05-25T22:38:30.188969681Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-05-25 22:38:30 2024-05-25T22:38:30.188972914Z - *** --- * --- 2024-05-25T22:38:30.188976580Z - ** ---------- [config] 2024-05-25T22:38:30.188980161Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f76ca8d4190 2024-05-25T22:38:30.188983873Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-05-25T22:38:30.188987070Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-05-25T22:38:30.188994331Z - *** --- * --- .> concurrency: 16 (prefork) 2024-05-25T22:38:30.188997451Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-05-25T22:38:30.189000557Z --- ***** ----- 2024-05-25T22:38:30.189003639Z -------------- [queues] 2024-05-25T22:38:30.189006700Z .> default exchange=default(direct) key=default 2024-05-25T22:38:30.189009834Z 2024-05-25T22:38:30.189012639Z 2024-05-25T22:38:30.189015692Z [tasks] 2024-05-25T22:38:30.189018744Z . airflow.executors.celery_executor.execute_command 2024-05-25T22:38:30.189021562Z 2024-05-25T22:38:36.377093849Z [2024-05-25 22:38:36,365: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-05-25T22:38:36.379670264Z [2024-05-25 22:38:36,378: INFO/MainProcess] mingle: searching for neighbors 2024-05-25T22:38:37.427637154Z [2024-05-25 22:38:37,427: INFO/MainProcess] mingle: all alone 2024-05-25T22:38:37.455745158Z [2024-05-25 22:38:37,454: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-05-25T22:39:31.983259578Z [2024-05-25 22:39:31,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23b57efe-29eb-4b2f-bc61-de36723ee355] received 2024-05-25T22:39:32.151657710Z [2024-05-25 22:39:32,149: INFO/ForkPoolWorker-15] [23b57efe-29eb-4b2f-bc61-de36723ee355] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:39:32.583667453Z [2024-05-25 22:39:32,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:39:33.099048907Z [2024-05-25 22:39:33,097: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:40:03.883440543Z [2024-05-25 22:40:03,882: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23b57efe-29eb-4b2f-bc61-de36723ee355] succeeded in 31.895652189999964s: None 2024-05-25T22:40:14.554367380Z [2024-05-25 22:40:14,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8274070f-4aa6-4c6f-9e17-2011ee4938be] received 2024-05-25T22:40:14.562251504Z [2024-05-25 22:40:14,561: INFO/ForkPoolWorker-15] [8274070f-4aa6-4c6f-9e17-2011ee4938be] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:40:14.998215886Z [2024-05-25 22:40:14,994: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:40:15.244545699Z [2024-05-25 22:40:15,244: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:40:45.889690955Z [2024-05-25 22:40:45,889: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8274070f-4aa6-4c6f-9e17-2011ee4938be] succeeded in 31.333145987999956s: None 2024-05-25T22:40:47.015662567Z [2024-05-25 22:40:47,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16751614-a895-4aeb-b08d-c2d4691ae8a1] received 2024-05-25T22:40:47.026924882Z [2024-05-25 22:40:47,026: INFO/ForkPoolWorker-15] [16751614-a895-4aeb-b08d-c2d4691ae8a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:40:47.294909694Z [2024-05-25 22:40:47,291: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:40:47.550606845Z [2024-05-25 22:40:47,550: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:41:18.215158752Z [2024-05-25 22:41:18,214: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16751614-a895-4aeb-b08d-c2d4691ae8a1] succeeded in 31.196885715000008s: None 2024-05-25T22:41:29.013390943Z [2024-05-25 22:41:29,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[412f0763-57f0-421c-9e67-1507bce05f94] received 2024-05-25T22:41:29.023681067Z [2024-05-25 22:41:29,023: INFO/ForkPoolWorker-15] [412f0763-57f0-421c-9e67-1507bce05f94] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:41:29.315570939Z [2024-05-25 22:41:29,311: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:41:29.585923130Z [2024-05-25 22:41:29,585: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:42:00.172032636Z [2024-05-25 22:42:00,171: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[412f0763-57f0-421c-9e67-1507bce05f94] succeeded in 31.155966241999977s: None 2024-05-25T22:42:01.015323781Z [2024-05-25 22:42:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7565b9d2-235b-46ca-902e-58469e879fe5] received 2024-05-25T22:42:01.029872053Z [2024-05-25 22:42:01,029: INFO/ForkPoolWorker-15] [7565b9d2-235b-46ca-902e-58469e879fe5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:42:01.342170782Z [2024-05-25 22:42:01,339: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:42:01.717702979Z [2024-05-25 22:42:01,716: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:42:02.394106033Z [2024-05-25 22:42:02,393: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7565b9d2-235b-46ca-902e-58469e879fe5] succeeded in 1.369749987000091s: None 2024-05-25T22:44:00.828653094Z [2024-05-25 22:44:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a202bcb3-59b5-4850-a231-43a82dc96afa] received 2024-05-25T22:44:00.842920061Z [2024-05-25 22:44:00,842: INFO/ForkPoolWorker-15] [a202bcb3-59b5-4850-a231-43a82dc96afa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:44:01.166298548Z [2024-05-25 22:44:01,162: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:44:01.440172088Z [2024-05-25 22:44:01,439: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:44:01.993864248Z [2024-05-25 22:44:01,993: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a202bcb3-59b5-4850-a231-43a82dc96afa] succeeded in 1.1620029069999873s: None 2024-05-25T22:46:00.705336429Z [2024-05-25 22:46:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53548b6c-8e0e-4cf8-9012-bb54e5b90b72] received 2024-05-25T22:46:00.724686280Z [2024-05-25 22:46:00,722: INFO/ForkPoolWorker-15] [53548b6c-8e0e-4cf8-9012-bb54e5b90b72] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:46:01.129384697Z [2024-05-25 22:46:01,125: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:46:01.480702406Z [2024-05-25 22:46:01,480: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:46:02.133214810Z [2024-05-25 22:46:02,132: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53548b6c-8e0e-4cf8-9012-bb54e5b90b72] succeeded in 1.4225614720000976s: None 2024-05-25T22:47:14.720113538Z [2024-05-25 22:47:14,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7424cce-910f-46b5-8541-42c368eb9849] received 2024-05-25T22:47:14.737697138Z [2024-05-25 22:47:14,737: INFO/ForkPoolWorker-15] [a7424cce-910f-46b5-8541-42c368eb9849] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:47:15.085143936Z [2024-05-25 22:47:15,081: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:47:15.251940146Z [2024-05-25 22:47:15,251: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T22:47:15.256445235Z [2024-05-25 22:47:15,255: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:15.287271607Z [2024-05-25 22:47:15,287: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:47:15.288513719Z [2024-05-25 22:47:15,288: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:47:15.288725080Z [2024-05-25 22:47:15,288: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:47:15.288890523Z [2024-05-25 22:47:15,288: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T22:47:15.289205934Z [2024-05-25 22:47:15,289: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:47:15.394472348Z [2024-05-25 22:47:15,394: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:15.957594600Z [2024-05-25 22:47:15,956: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7424cce-910f-46b5-8541-42c368eb9849] succeeded in 1.2331842599999163s: None 2024-05-25T22:47:21.826831470Z [2024-05-25 22:47:21,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9625f49e-4bc6-4823-8e87-c9c0de692e6d] received 2024-05-25T22:47:21.833404140Z [2024-05-25 22:47:21,833: INFO/ForkPoolWorker-15] [9625f49e-4bc6-4823-8e87-c9c0de692e6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:47:21.997276627Z [2024-05-25 22:47:21,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[307b4c8a-c9b2-4268-84a0-568a0e4819f9] received 2024-05-25T22:47:22.067960147Z [2024-05-25 22:47:22,067: INFO/ForkPoolWorker-16] [307b4c8a-c9b2-4268-84a0-568a0e4819f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:47:22.186595286Z [2024-05-25 22:47:22,183: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:47:22.391198516Z [2024-05-25 22:47:22,381: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:47:23.509354845Z [2024-05-25 22:47:23,509: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:47:23.512598499Z [2024-05-25 22:47:23,512: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:23.559018557Z [2024-05-25 22:47:23,558: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:47:23.560749151Z [2024-05-25 22:47:23,560: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:47:23.560786339Z [2024-05-25 22:47:23,560: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:47:23.561555582Z [2024-05-25 22:47:23,560: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:47:23.561900753Z [2024-05-25 22:47:23,561: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:47:23.562634618Z [2024-05-25 22:47:23,562: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:47:23.562772125Z [2024-05-25 22:47:23,562: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:47:23.653879738Z [2024-05-25 22:47:23,653: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:47:23.661526708Z [2024-05-25 22:47:23,657: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:23.691407875Z [2024-05-25 22:47:23,691: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:47:23.693050512Z [2024-05-25 22:47:23,692: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:47:23.693212507Z [2024-05-25 22:47:23,693: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:47:23.693536061Z [2024-05-25 22:47:23,693: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:47:23.693922959Z [2024-05-25 22:47:23,693: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:47:23.694421961Z [2024-05-25 22:47:23,694: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:47:23.694767308Z [2024-05-25 22:47:23,694: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:47:23.695278978Z [2024-05-25 22:47:23,695: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:23.779909520Z [2024-05-25 22:47:23,779: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:24.849175567Z [2024-05-25 22:47:24,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f4bb1c9-24a3-45bc-a8c1-88059a4b4e66] received 2024-05-25T22:47:24.899046282Z [2024-05-25 22:47:24,898: INFO/ForkPoolWorker-1] [8f4bb1c9-24a3-45bc-a8c1-88059a4b4e66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:25.185079457Z [2024-05-25 22:47:25,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9625f49e-4bc6-4823-8e87-c9c0de692e6d] succeeded in 3.356343162999792s: None 2024-05-25T22:47:25.237530598Z [2024-05-25 22:47:25,233: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:47:25.474445064Z [2024-05-25 22:47:25,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[307b4c8a-c9b2-4268-84a0-568a0e4819f9] succeeded in 3.4634984910001094s: None 2024-05-25T22:47:26.484282614Z [2024-05-25 22:47:26,483: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:47:26.487503495Z [2024-05-25 22:47:26,486: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:26.511226109Z [2024-05-25 22:47:26,508: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:47:26.511244161Z [2024-05-25 22:47:26,509: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:47:26.511247857Z [2024-05-25 22:47:26,509: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:47:26.511255119Z [2024-05-25 22:47:26,510: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:47:26.511260147Z [2024-05-25 22:47:26,510: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:47:26.511263564Z [2024-05-25 22:47:26,510: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:47:26.511267969Z [2024-05-25 22:47:26,510: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:47:26.594797838Z [2024-05-25 22:47:26,594: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:27.142207705Z [2024-05-25 22:47:27,141: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f4bb1c9-24a3-45bc-a8c1-88059a4b4e66] succeeded in 2.2845021369998904s: None 2024-05-25T22:47:27.202805098Z [2024-05-25 22:47:27,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1383c3cc-e295-4ba1-98a8-bf3f9724cd44] received 2024-05-25T22:47:27.214739999Z [2024-05-25 22:47:27,214: INFO/ForkPoolWorker-15] [1383c3cc-e295-4ba1-98a8-bf3f9724cd44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:27.517001534Z [2024-05-25 22:47:27,514: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:47:28.678155273Z [2024-05-25 22:47:28,677: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:47:28.681696641Z [2024-05-25 22:47:28,681: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:28.699118110Z [2024-05-25 22:47:28,698: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:47:28.700953113Z [2024-05-25 22:47:28,700: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:47:28.701045496Z [2024-05-25 22:47:28,700: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:47:28.701190059Z [2024-05-25 22:47:28,701: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:47:28.701287572Z [2024-05-25 22:47:28,701: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:47:28.701524932Z [2024-05-25 22:47:28,701: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:47:28.701640343Z [2024-05-25 22:47:28,701: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:47:28.780005377Z [2024-05-25 22:47:28,779: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:29.329464113Z [2024-05-25 22:47:29,329: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1383c3cc-e295-4ba1-98a8-bf3f9724cd44] succeeded in 2.1210059390000424s: None 2024-05-25T22:47:29.904091756Z [2024-05-25 22:47:29,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06241394-56c2-4b1d-851a-461dfa8a0cd4] received 2024-05-25T22:47:29.910351645Z [2024-05-25 22:47:29,910: INFO/ForkPoolWorker-15] [06241394-56c2-4b1d-851a-461dfa8a0cd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:47:30.262306749Z [2024-05-25 22:47:30,259: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:47:31.356425133Z [2024-05-25 22:47:31,356: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:47:31.359833865Z [2024-05-25 22:47:31,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:31.376811215Z [2024-05-25 22:47:31,376: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:47:31.378217537Z [2024-05-25 22:47:31,378: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:47:31.378250129Z [2024-05-25 22:47:31,378: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:47:31.378442939Z [2024-05-25 22:47:31,378: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:47:31.378521811Z [2024-05-25 22:47:31,378: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:47:31.378951871Z [2024-05-25 22:47:31,378: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:47:31.379110206Z [2024-05-25 22:47:31,378: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:47:31.459347418Z [2024-05-25 22:47:31,459: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:32.009861157Z [2024-05-25 22:47:32,008: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06241394-56c2-4b1d-851a-461dfa8a0cd4] succeeded in 2.1031173229998785s: None 2024-05-25T22:47:32.464568422Z [2024-05-25 22:47:32,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c878758e-a96d-422a-ae95-3d9766fff349] received 2024-05-25T22:47:32.472652237Z [2024-05-25 22:47:32,472: INFO/ForkPoolWorker-15] [c878758e-a96d-422a-ae95-3d9766fff349] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:32.899551408Z [2024-05-25 22:47:32,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:47:34.471641088Z [2024-05-25 22:47:34,469: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:47:34.478198837Z [2024-05-25 22:47:34,473: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:34.547810596Z [2024-05-25 22:47:34,547: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:47:34.549016688Z [2024-05-25 22:47:34,548: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:47:34.549143240Z [2024-05-25 22:47:34,549: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:47:34.549336006Z [2024-05-25 22:47:34,549: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:47:34.549438032Z [2024-05-25 22:47:34,549: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:47:34.549669916Z [2024-05-25 22:47:34,549: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:47:34.549759320Z [2024-05-25 22:47:34,549: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:47:34.617783730Z [2024-05-25 22:47:34,617: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:35.202578598Z [2024-05-25 22:47:35,202: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c878758e-a96d-422a-ae95-3d9766fff349] succeeded in 2.735582852999869s: None 2024-05-25T22:47:53.429758408Z [2024-05-25 22:47:53,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb2fd7bf-c01c-42b2-8914-e98ad569327e] received 2024-05-25T22:47:53.447006250Z [2024-05-25 22:47:53,446: INFO/ForkPoolWorker-15] [eb2fd7bf-c01c-42b2-8914-e98ad569327e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:47:53.806889730Z [2024-05-25 22:47:53,803: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:47:54.089295240Z [2024-05-25 22:47:54,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0a014a1-552d-460a-a3c7-0d499c039dd4] received 2024-05-25T22:47:54.100025273Z [2024-05-25 22:47:54,099: INFO/ForkPoolWorker-16] [c0a014a1-552d-460a-a3c7-0d499c039dd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:47:54.431619856Z [2024-05-25 22:47:54,422: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:47:55.090404873Z [2024-05-25 22:47:55,090: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:47:55.094752412Z [2024-05-25 22:47:55,094: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:55.115951248Z [2024-05-25 22:47:55,115: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:47:55.117134259Z [2024-05-25 22:47:55,116: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:47:55.117226793Z [2024-05-25 22:47:55,117: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:47:55.117320111Z [2024-05-25 22:47:55,117: INFO/ForkPoolWorker-15] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:47:55.117470312Z [2024-05-25 22:47:55,117: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:47:55.117561036Z [2024-05-25 22:47:55,117: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:47:55.117776614Z [2024-05-25 22:47:55,117: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:47:55.117871464Z [2024-05-25 22:47:55,117: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:47:55.123028917Z [2024-05-25 22:47:55,122: INFO/ForkPoolWorker-15] Creating DAG vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:47:55.210449482Z [2024-05-25 22:47:55,210: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:55.778387308Z [2024-05-25 22:47:55,778: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:47:55.783674120Z [2024-05-25 22:47:55,783: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:55.813206484Z [2024-05-25 22:47:55,812: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:47:55.814550155Z [2024-05-25 22:47:55,813: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:47:55.814561047Z [2024-05-25 22:47:55,814: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:47:55.814564358Z [2024-05-25 22:47:55,814: INFO/ForkPoolWorker-16] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:47:55.814568963Z [2024-05-25 22:47:55,814: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:47:55.814572643Z [2024-05-25 22:47:55,814: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:47:55.814575787Z [2024-05-25 22:47:55,814: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:47:55.814579337Z [2024-05-25 22:47:55,814: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:47:55.819614276Z [2024-05-25 22:47:55,819: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:47:55.920923958Z [2024-05-25 22:47:55,920: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:56.530277175Z [2024-05-25 22:47:56,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f9707b2-5e59-4e37-aca8-16c70500410f] received 2024-05-25T22:47:56.552901628Z [2024-05-25 22:47:56,552: INFO/ForkPoolWorker-1] [8f9707b2-5e59-4e37-aca8-16c70500410f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:56.834089864Z [2024-05-25 22:47:56,833: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb2fd7bf-c01c-42b2-8914-e98ad569327e] succeeded in 3.4013049789998604s: None 2024-05-25T22:47:56.883204628Z [2024-05-25 22:47:56,880: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:47:57.729629545Z [2024-05-25 22:47:57,729: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c0a014a1-552d-460a-a3c7-0d499c039dd4] succeeded in 3.6367767809999805s: None 2024-05-25T22:47:58.132214481Z [2024-05-25 22:47:58,131: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:47:58.135923174Z [2024-05-25 22:47:58,135: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:47:58.157400456Z [2024-05-25 22:47:58,157: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:47:58.158583995Z [2024-05-25 22:47:58,158: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:47:58.158599033Z [2024-05-25 22:47:58,158: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:47:58.158635859Z [2024-05-25 22:47:58,158: INFO/ForkPoolWorker-1] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:47:58.158771153Z [2024-05-25 22:47:58,158: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:47:58.158778892Z [2024-05-25 22:47:58,158: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:47:58.158992464Z [2024-05-25 22:47:58,158: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:47:58.159001610Z [2024-05-25 22:47:58,158: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:47:58.165398176Z [2024-05-25 22:47:58,165: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:47:58.248925485Z [2024-05-25 22:47:58,248: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:47:58.808320743Z [2024-05-25 22:47:58,807: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f9707b2-5e59-4e37-aca8-16c70500410f] succeeded in 2.262987202999966s: None 2024-05-25T22:47:58.939701678Z [2024-05-25 22:47:58,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e47d0f7-7da9-4c90-acb6-46ccccf81e45] received 2024-05-25T22:47:58.947590186Z [2024-05-25 22:47:58,947: INFO/ForkPoolWorker-15] [0e47d0f7-7da9-4c90-acb6-46ccccf81e45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'split_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:59.207060080Z [2024-05-25 22:47:59,204: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:48:00.429594051Z [2024-05-25 22:48:00,429: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:48:00.434017733Z [2024-05-25 22:48:00,433: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:00.455376838Z [2024-05-25 22:48:00,455: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:48:00.456665924Z [2024-05-25 22:48:00,456: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:00.456785454Z [2024-05-25 22:48:00,456: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:00.456890812Z [2024-05-25 22:48:00,456: INFO/ForkPoolWorker-15] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:48:00.457057234Z [2024-05-25 22:48:00,456: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:48:00.457162414Z [2024-05-25 22:48:00,457: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:48:00.457713268Z [2024-05-25 22:48:00,457: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:48:00.457831209Z [2024-05-25 22:48:00,457: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:00.463736798Z [2024-05-25 22:48:00,463: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:48:00.550588787Z [2024-05-25 22:48:00,550: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:00.637736306Z [2024-05-25 22:48:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[225470d6-0048-4719-908e-5489d5319ed7] received 2024-05-25T22:48:00.643272817Z [2024-05-25 22:48:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c60e065-ddaa-4882-b99a-59a438957684] received 2024-05-25T22:48:00.648982152Z [2024-05-25 22:48:00,648: INFO/ForkPoolWorker-16] [225470d6-0048-4719-908e-5489d5319ed7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:48:00.682208596Z [2024-05-25 22:48:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3b17d94-6ea5-4e6b-a884-ee3fcb205580] received 2024-05-25T22:48:00.685613632Z [2024-05-25 22:48:00,685: INFO/ForkPoolWorker-1] [7c60e065-ddaa-4882-b99a-59a438957684] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:48:00.693540002Z [2024-05-25 22:48:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6b4a291-2dac-4429-a0e9-4b7add5f5cb3] received 2024-05-25T22:48:00.700491133Z [2024-05-25 22:48:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03758a77-7c1d-4ee7-a1ba-36918394d2cc] received 2024-05-25T22:48:00.706090253Z [2024-05-25 22:48:00,705: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b680459-f7a4-46cd-b665-6d80c691d501] received 2024-05-25T22:48:00.779343113Z [2024-05-25 22:48:00,778: INFO/ForkPoolWorker-2] [b3b17d94-6ea5-4e6b-a884-ee3fcb205580] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:48:00.785183776Z [2024-05-25 22:48:00,784: INFO/ForkPoolWorker-3] [c6b4a291-2dac-4429-a0e9-4b7add5f5cb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:48:00.793034467Z [2024-05-25 22:48:00,792: INFO/ForkPoolWorker-4] [03758a77-7c1d-4ee7-a1ba-36918394d2cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:48:00.836075696Z [2024-05-25 22:48:00,835: INFO/ForkPoolWorker-5] [3b680459-f7a4-46cd-b665-6d80c691d501] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:48:01.293788709Z [2024-05-25 22:48:01,289: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:48:01.462813922Z [2024-05-25 22:48:01,449: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:48:01.527300059Z [2024-05-25 22:48:01,524: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:48:01.601519346Z [2024-05-25 22:48:01,595: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:48:01.798483442Z [2024-05-25 22:48:01,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e47d0f7-7da9-4c90-acb6-46ccccf81e45] succeeded in 2.85729966599979s: None 2024-05-25T22:48:01.818209985Z [2024-05-25 22:48:01,812: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:48:01.866133823Z [2024-05-25 22:48:01,855: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:48:01.914412019Z [2024-05-25 22:48:01,913: INFO/ForkPoolWorker-4] Getting SDNC list 2024-05-25T22:48:01.919294360Z [2024-05-25 22:48:01,918: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:01.984536696Z [2024-05-25 22:48:01,984: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-25T22:48:01.989754824Z [2024-05-25 22:48:01,989: INFO/ForkPoolWorker-4] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:48:01.989907105Z [2024-05-25 22:48:01,989: INFO/ForkPoolWorker-4] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:48:01.990008310Z [2024-05-25 22:48:01,989: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-05-25T22:48:01.990270590Z [2024-05-25 22:48:01,990: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:48:02.149025462Z [2024-05-25 22:48:02,148: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:02.303096958Z [2024-05-25 22:48:02,302: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:02.913711189Z [2024-05-25 22:48:02,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[530619cb-327c-4562-803a-140bdfdf1a88] received 2024-05-25T22:48:02.940790057Z [2024-05-25 22:48:02,940: INFO/ForkPoolWorker-15] [530619cb-327c-4562-803a-140bdfdf1a88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'collect_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:48:03.305701510Z [2024-05-25 22:48:03,305: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[03758a77-7c1d-4ee7-a1ba-36918394d2cc] succeeded in 2.6030338499999743s: None 2024-05-25T22:48:03.441483517Z [2024-05-25 22:48:03,436: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[225470d6-0048-4719-908e-5489d5319ed7] succeeded in 2.797080740999945s: None 2024-05-25T22:48:03.480732940Z [2024-05-25 22:48:03,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:48:03.966117942Z [2024-05-25 22:48:03,965: INFO/ForkPoolWorker-5] Getting VIM list 2024-05-25T22:48:03.969429583Z [2024-05-25 22:48:03,969: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:04.023369890Z [2024-05-25 22:48:04,023: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-25T22:48:04.028788036Z [2024-05-25 22:48:04,028: INFO/ForkPoolWorker-5] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:04.028865961Z [2024-05-25 22:48:04,028: INFO/ForkPoolWorker-5] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:04.028938015Z [2024-05-25 22:48:04,028: INFO/ForkPoolWorker-5] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:48:04.029088647Z [2024-05-25 22:48:04,028: INFO/ForkPoolWorker-5] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:48:04.029161851Z [2024-05-25 22:48:04,029: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-05-25T22:48:04.029470938Z [2024-05-25 22:48:04,029: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:48:04.029546232Z [2024-05-25 22:48:04,029: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:04.034131725Z [2024-05-25 22:48:04,033: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:48:04.062927857Z [2024-05-25 22:48:04,062: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T22:48:04.095682522Z [2024-05-25 22:48:04,095: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:04.133975061Z [2024-05-25 22:48:04,133: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T22:48:04.136351435Z [2024-05-25 22:48:04,136: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:04.136420960Z [2024-05-25 22:48:04,136: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:04.136536389Z [2024-05-25 22:48:04,136: INFO/ForkPoolWorker-3] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:48:04.136773623Z [2024-05-25 22:48:04,136: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:48:04.137093471Z [2024-05-25 22:48:04,136: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T22:48:04.137446158Z [2024-05-25 22:48:04,137: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:48:04.137523705Z [2024-05-25 22:48:04,137: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:04.144861717Z [2024-05-25 22:48:04,144: INFO/ForkPoolWorker-3] Creating DAG vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:48:04.160364156Z [2024-05-25 22:48:04,159: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T22:48:04.163757561Z [2024-05-25 22:48:04,163: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:04.270201729Z [2024-05-25 22:48:04,269: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:04.277493378Z [2024-05-25 22:48:04,275: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T22:48:04.279805590Z [2024-05-25 22:48:04,279: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:04.279854018Z [2024-05-25 22:48:04,279: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:04.280112967Z [2024-05-25 22:48:04,279: INFO/ForkPoolWorker-2] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:48:04.280307480Z [2024-05-25 22:48:04,280: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:48:04.280366031Z [2024-05-25 22:48:04,280: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T22:48:04.280655322Z [2024-05-25 22:48:04,280: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:48:04.280704696Z [2024-05-25 22:48:04,280: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:04.297609548Z [2024-05-25 22:48:04,297: INFO/ForkPoolWorker-2] Creating DAG vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:48:04.466260969Z [2024-05-25 22:48:04,461: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:04.620369433Z [2024-05-25 22:48:04,620: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:06.215965706Z [2024-05-25 22:48:06,215: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:48:06.256737167Z [2024-05-25 22:48:06,255: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:06.449869600Z [2024-05-25 22:48:06,449: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:48:06.452467354Z [2024-05-25 22:48:06,452: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:06.452618229Z [2024-05-25 22:48:06,452: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:06.452719251Z [2024-05-25 22:48:06,452: INFO/ForkPoolWorker-1] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:48:06.452908824Z [2024-05-25 22:48:06,452: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:48:06.453009717Z [2024-05-25 22:48:06,452: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:48:06.453310680Z [2024-05-25 22:48:06,453: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:48:06.453414058Z [2024-05-25 22:48:06,453: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:06.459848009Z [2024-05-25 22:48:06,459: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:48:06.590974121Z [2024-05-25 22:48:06,590: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:06.668450144Z [2024-05-25 22:48:06,668: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c6b4a291-2dac-4429-a0e9-4b7add5f5cb3] succeeded in 5.966831107999951s: None 2024-05-25T22:48:07.028250246Z [2024-05-25 22:48:07,027: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b3b17d94-6ea5-4e6b-a884-ee3fcb205580] succeeded in 6.34318655900006s: None 2024-05-25T22:48:07.519382967Z [2024-05-25 22:48:07,518: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:48:07.527316829Z [2024-05-25 22:48:07,526: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:07.620246339Z [2024-05-25 22:48:07,620: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:48:07.630426846Z [2024-05-25 22:48:07,627: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:07.631218576Z [2024-05-25 22:48:07,630: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:07.633477746Z [2024-05-25 22:48:07,631: INFO/ForkPoolWorker-15] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:48:07.633694961Z [2024-05-25 22:48:07,633: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:48:07.633850892Z [2024-05-25 22:48:07,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:48:07.634335321Z [2024-05-25 22:48:07,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:48:07.634535377Z [2024-05-25 22:48:07,634: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:07.658129495Z [2024-05-25 22:48:07,657: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:48:07.795398945Z [2024-05-25 22:48:07,795: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:07.839587541Z [2024-05-25 22:48:07,839: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[3b680459-f7a4-46cd-b665-6d80c691d501] succeeded in 7.127663518999952s: None 2024-05-25T22:48:08.506547339Z [2024-05-25 22:48:08,505: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[530619cb-327c-4562-803a-140bdfdf1a88] succeeded in 5.587848137000037s: None 2024-05-25T22:48:09.224982159Z [2024-05-25 22:48:09,224: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c60e065-ddaa-4882-b99a-59a438957684] succeeded in 8.57666217000019s: None 2024-05-25T22:48:09.426791795Z [2024-05-25 22:48:09,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1607a0ca-4b2a-4582-9b02-4ff7062ec69b] received 2024-05-25T22:48:09.433277233Z [2024-05-25 22:48:09,433: INFO/ForkPoolWorker-15] [1607a0ca-4b2a-4582-9b02-4ff7062ec69b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'send_prometheus', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:48:09.795302355Z [2024-05-25 22:48:09,792: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:48:11.035872580Z [2024-05-25 22:48:11,035: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:48:11.040522689Z [2024-05-25 22:48:11,039: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:11.078941547Z [2024-05-25 22:48:11,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:48:11.082360407Z [2024-05-25 22:48:11,081: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:11.082651673Z [2024-05-25 22:48:11,082: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:11.083073007Z [2024-05-25 22:48:11,082: INFO/ForkPoolWorker-15] Read VIM fd84dd44-64f0-46c2-9218-bdaf287e6c21 (basic01_197226) 2024-05-25T22:48:11.083602684Z [2024-05-25 22:48:11,083: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'name': 'basic01_197226', 'vim_type': 'openstack'}] 2024-05-25T22:48:11.083825450Z [2024-05-25 22:48:11,083: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:48:11.084407868Z [2024-05-25 22:48:11,084: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:48:11.084746310Z [2024-05-25 22:48:11,084: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:11.098035148Z [2024-05-25 22:48:11,097: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 2024-05-25T22:48:11.182956452Z [2024-05-25 22:48:11,182: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:11.733412755Z [2024-05-25 22:48:11,732: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1607a0ca-4b2a-4582-9b02-4ff7062ec69b] succeeded in 2.3048443740001403s: None 2024-05-25T22:48:25.951192278Z [2024-05-25 22:48:25,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50b8056b-5979-4816-8170-8ab39b9063d5] received 2024-05-25T22:48:25.964219436Z [2024-05-25 22:48:25,963: INFO/ForkPoolWorker-15] [50b8056b-5979-4816-8170-8ab39b9063d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:48:26.229048516Z [2024-05-25 22:48:26,225: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:48:27.560002242Z [2024-05-25 22:48:27,559: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:48:27.563384677Z [2024-05-25 22:48:27,562: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:27.587405676Z [2024-05-25 22:48:27,587: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:48:27.588660543Z [2024-05-25 22:48:27,588: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:27.588670944Z [2024-05-25 22:48:27,588: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:27.588719541Z [2024-05-25 22:48:27,588: INFO/ForkPoolWorker-15] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:48:27.588853296Z [2024-05-25 22:48:27,588: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:48:27.588951936Z [2024-05-25 22:48:27,588: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:48:27.589092867Z [2024-05-25 22:48:27,588: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:48:27.589127232Z [2024-05-25 22:48:27,589: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:27.594696850Z [2024-05-25 22:48:27,594: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:48:27.699409325Z [2024-05-25 22:48:27,699: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:28.280897136Z [2024-05-25 22:48:28,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d602a9b3-97d5-4d96-b9e8-a9889056979f] received 2024-05-25T22:48:28.308405648Z [2024-05-25 22:48:28,307: INFO/ForkPoolWorker-16] [d602a9b3-97d5-4d96-b9e8-a9889056979f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:48:28.621862606Z [2024-05-25 22:48:28,618: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:48:29.455928211Z [2024-05-25 22:48:29,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50b8056b-5979-4816-8170-8ab39b9063d5] succeeded in 3.5022414699999445s: None 2024-05-25T22:48:29.660092587Z [2024-05-25 22:48:29,659: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:48:29.663360025Z [2024-05-25 22:48:29,662: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:29.687279955Z [2024-05-25 22:48:29,687: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:48:29.688562611Z [2024-05-25 22:48:29,688: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:29.688666987Z [2024-05-25 22:48:29,688: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:29.688814733Z [2024-05-25 22:48:29,688: INFO/ForkPoolWorker-16] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:48:29.689048581Z [2024-05-25 22:48:29,688: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:48:29.689067672Z [2024-05-25 22:48:29,688: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:48:29.689501232Z [2024-05-25 22:48:29,689: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:48:29.689511213Z [2024-05-25 22:48:29,689: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:29.695656633Z [2024-05-25 22:48:29,695: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:48:29.770668979Z [2024-05-25 22:48:29,770: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:30.503486924Z [2024-05-25 22:48:30,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1718ca49-2c86-473d-92f3-a6e13622a6c7] received 2024-05-25T22:48:30.516477032Z [2024-05-25 22:48:30,516: INFO/ForkPoolWorker-15] [1718ca49-2c86-473d-92f3-a6e13622a6c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'split_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:48:30.524091664Z [2024-05-25 22:48:30,523: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d602a9b3-97d5-4d96-b9e8-a9889056979f] succeeded in 2.2399198680000154s: None 2024-05-25T22:48:30.839278936Z [2024-05-25 22:48:30,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:48:31.900174713Z [2024-05-25 22:48:31,899: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:48:31.903572579Z [2024-05-25 22:48:31,902: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:31.930344585Z [2024-05-25 22:48:31,930: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:48:31.932073519Z [2024-05-25 22:48:31,931: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:31.932217631Z [2024-05-25 22:48:31,931: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:31.932372163Z [2024-05-25 22:48:31,932: INFO/ForkPoolWorker-15] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:48:31.932660673Z [2024-05-25 22:48:31,932: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:48:31.932782134Z [2024-05-25 22:48:31,932: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:48:31.933239282Z [2024-05-25 22:48:31,932: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:48:31.933362626Z [2024-05-25 22:48:31,933: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:31.941760775Z [2024-05-25 22:48:31,941: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:48:32.034671451Z [2024-05-25 22:48:32,034: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:32.735185393Z [2024-05-25 22:48:32,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1718ca49-2c86-473d-92f3-a6e13622a6c7] succeeded in 2.229573619999883s: None 2024-05-25T22:48:32.839044474Z [2024-05-25 22:48:32,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5d3a0f9-6751-4a00-9ca9-728e4901ff9a] received 2024-05-25T22:48:32.853354868Z [2024-05-25 22:48:32,852: INFO/ForkPoolWorker-15] [a5d3a0f9-6751-4a00-9ca9-728e4901ff9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'collect_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:48:33.141892962Z [2024-05-25 22:48:33,138: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:48:34.163166169Z [2024-05-25 22:48:34,162: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:48:34.167289475Z [2024-05-25 22:48:34,166: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:34.193255938Z [2024-05-25 22:48:34,193: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:48:34.194778441Z [2024-05-25 22:48:34,194: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:34.194921139Z [2024-05-25 22:48:34,194: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:34.195067442Z [2024-05-25 22:48:34,194: INFO/ForkPoolWorker-15] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:48:34.195307733Z [2024-05-25 22:48:34,195: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:48:34.195455119Z [2024-05-25 22:48:34,195: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:48:34.195838962Z [2024-05-25 22:48:34,195: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:48:34.196010541Z [2024-05-25 22:48:34,195: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:34.202724422Z [2024-05-25 22:48:34,202: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:48:34.294461324Z [2024-05-25 22:48:34,294: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:34.906969302Z [2024-05-25 22:48:34,906: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5d3a0f9-6751-4a00-9ca9-728e4901ff9a] succeeded in 2.0632048840000152s: None 2024-05-25T22:48:35.122709472Z [2024-05-25 22:48:35,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bc33e22-1087-4306-bb5b-e53bd8dc09de] received 2024-05-25T22:48:35.132113905Z [2024-05-25 22:48:35,131: INFO/ForkPoolWorker-15] [1bc33e22-1087-4306-bb5b-e53bd8dc09de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'send_prometheus', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:48:35.527719238Z [2024-05-25 22:48:35,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:48:36.646401371Z [2024-05-25 22:48:36,645: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:48:36.649600166Z [2024-05-25 22:48:36,649: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:36.679292619Z [2024-05-25 22:48:36,678: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:48:36.680591159Z [2024-05-25 22:48:36,680: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:36.680631709Z [2024-05-25 22:48:36,680: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:36.680753904Z [2024-05-25 22:48:36,680: INFO/ForkPoolWorker-15] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:48:36.680930832Z [2024-05-25 22:48:36,680: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:48:36.680992804Z [2024-05-25 22:48:36,680: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:48:36.681368354Z [2024-05-25 22:48:36,681: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:48:36.681387212Z [2024-05-25 22:48:36,681: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:36.689173297Z [2024-05-25 22:48:36,688: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:48:36.807967886Z [2024-05-25 22:48:36,807: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:37.450206075Z [2024-05-25 22:48:37,449: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bc33e22-1087-4306-bb5b-e53bd8dc09de] succeeded in 2.3253487319998385s: None 2024-05-25T22:48:56.644862429Z [2024-05-25 22:48:56,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76d05387-ee70-43c4-bc01-725cce4c1cdc] received 2024-05-25T22:48:56.652131386Z [2024-05-25 22:48:56,651: INFO/ForkPoolWorker-15] [76d05387-ee70-43c4-bc01-725cce4c1cdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:48:56.936966523Z [2024-05-25 22:48:56,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:48:58.067418001Z [2024-05-25 22:48:58,066: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:48:58.070498227Z [2024-05-25 22:48:58,070: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:48:58.091152104Z [2024-05-25 22:48:58,090: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:48:58.092936482Z [2024-05-25 22:48:58,092: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:48:58.093012443Z [2024-05-25 22:48:58,092: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:48:58.093141676Z [2024-05-25 22:48:58,092: INFO/ForkPoolWorker-15] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:48:58.093439840Z [2024-05-25 22:48:58,093: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:48:58.093580044Z [2024-05-25 22:48:58,093: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:48:58.094014081Z [2024-05-25 22:48:58,093: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:48:58.094039500Z [2024-05-25 22:48:58,093: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:48:58.099095920Z [2024-05-25 22:48:58,098: INFO/ForkPoolWorker-15] Creating DAG vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:48:58.186505276Z [2024-05-25 22:48:58,186: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:48:59.832124445Z [2024-05-25 22:48:59,831: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76d05387-ee70-43c4-bc01-725cce4c1cdc] succeeded in 3.185213886999918s: None 2024-05-25T22:49:00.871330975Z [2024-05-25 22:49:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9363a452-877d-4e1f-8572-b372b32b8c55] received 2024-05-25T22:49:00.872732015Z [2024-05-25 22:49:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a8d6fdd-50e0-4f53-92e6-e319f69a4d20] received 2024-05-25T22:49:00.877009829Z [2024-05-25 22:49:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0faf84a2-bcbe-4019-84be-83e926ab0dcb] received 2024-05-25T22:49:00.880176700Z [2024-05-25 22:49:00,879: INFO/ForkPoolWorker-15] [9363a452-877d-4e1f-8572-b372b32b8c55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:49:00.880651777Z [2024-05-25 22:49:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05f60459-61a2-42be-8419-76181b1aa147] received 2024-05-25T22:49:00.881939360Z [2024-05-25 22:49:00,881: INFO/ForkPoolWorker-16] [3a8d6fdd-50e0-4f53-92e6-e319f69a4d20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:49:00.883624392Z [2024-05-25 22:49:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b316634-4456-4f90-8a62-b7650033755d] received 2024-05-25T22:49:00.885238084Z [2024-05-25 22:49:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b06e4b9e-4975-4dfb-b8a3-3f9636bfeafa] received 2024-05-25T22:49:00.887105735Z [2024-05-25 22:49:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de33906f-2976-43be-a6c2-89feac3abb9a] received 2024-05-25T22:49:00.906402458Z [2024-05-25 22:49:00,906: INFO/ForkPoolWorker-4] [b06e4b9e-4975-4dfb-b8a3-3f9636bfeafa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:49:00.908899964Z [2024-05-25 22:49:00,908: INFO/ForkPoolWorker-5] [de33906f-2976-43be-a6c2-89feac3abb9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:49:00.909506686Z [2024-05-25 22:49:00,909: INFO/ForkPoolWorker-3] [3b316634-4456-4f90-8a62-b7650033755d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:49:00.910192499Z [2024-05-25 22:49:00,909: INFO/ForkPoolWorker-1] [0faf84a2-bcbe-4019-84be-83e926ab0dcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:49:00.914123714Z [2024-05-25 22:49:00,913: INFO/ForkPoolWorker-2] [05f60459-61a2-42be-8419-76181b1aa147] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:49:01.225209708Z [2024-05-25 22:49:01,220: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:49:01.372573075Z [2024-05-25 22:49:01,368: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:49:01.455089825Z [2024-05-25 22:49:01,452: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:49:01.471106987Z [2024-05-25 22:49:01,465: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:49:01.502151877Z [2024-05-25 22:49:01,486: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:49:01.722931125Z [2024-05-25 22:49:01,718: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:49:01.933859871Z [2024-05-25 22:49:01,905: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:49:02.195345601Z [2024-05-25 22:49:02,194: INFO/ForkPoolWorker-5] Getting SDNC list 2024-05-25T22:49:02.216804322Z [2024-05-25 22:49:02,216: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:02.289672014Z [2024-05-25 22:49:02,289: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-25T22:49:02.292175917Z [2024-05-25 22:49:02,291: INFO/ForkPoolWorker-5] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:49:02.292386074Z [2024-05-25 22:49:02,292: INFO/ForkPoolWorker-5] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:49:02.292561435Z [2024-05-25 22:49:02,292: INFO/ForkPoolWorker-5] Getting SDNC list OK 2024-05-25T22:49:02.292879620Z [2024-05-25 22:49:02,292: INFO/ForkPoolWorker-5] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:49:02.534200701Z [2024-05-25 22:49:02,533: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:49:02.766440742Z [2024-05-25 22:49:02,766: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T22:49:02.769728303Z [2024-05-25 22:49:02,769: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:02.795703349Z [2024-05-25 22:49:02,795: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T22:49:02.800554493Z [2024-05-25 22:49:02,800: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:02.800569110Z [2024-05-25 22:49:02,800: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:02.800577725Z [2024-05-25 22:49:02,800: INFO/ForkPoolWorker-3] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:49:02.800708179Z [2024-05-25 22:49:02,800: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:49:02.800736055Z [2024-05-25 22:49:02,800: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T22:49:02.800967223Z [2024-05-25 22:49:02,800: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:49:02.800993144Z [2024-05-25 22:49:02,800: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:02.806007176Z [2024-05-25 22:49:02,805: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:49:02.810217901Z [2024-05-25 22:49:02,810: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:49:02.810851051Z [2024-05-25 22:49:02,810: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:49:02.817923258Z [2024-05-25 22:49:02,811: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T22:49:02.820480341Z [2024-05-25 22:49:02,820: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:02.872649709Z [2024-05-25 22:49:02,872: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T22:49:02.876564773Z [2024-05-25 22:49:02,876: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:02.876584174Z [2024-05-25 22:49:02,876: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:02.876631781Z [2024-05-25 22:49:02,876: INFO/ForkPoolWorker-3] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:49:02.876752673Z [2024-05-25 22:49:02,876: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:49:02.876778843Z [2024-05-25 22:49:02,876: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T22:49:02.876984280Z [2024-05-25 22:49:02,876: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:49:02.877013392Z [2024-05-25 22:49:02,876: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:02.879429808Z [2024-05-25 22:49:02,879: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:49:02.882980526Z [2024-05-25 22:49:02,882: ERROR/ForkPoolWorker-3] [3b316634-4456-4f90-8a62-b7650033755d] Failed to execute task Dag 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:49:02.882994144Z Traceback (most recent call last): 2024-05-25T22:49:02.882999175Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:49:02.883002794Z args.func(args) 2024-05-25T22:49:02.883006346Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:49:02.883043720Z return func(*args, **kwargs) 2024-05-25T22:49:02.883047480Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:49:02.883050730Z return f(*args, **kwargs) 2024-05-25T22:49:02.883053903Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:49:02.883057110Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:49:02.883060152Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:49:02.883063291Z raise AirflowException( 2024-05-25T22:49:02.883066959Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:49:02.964169213Z [2024-05-25 22:49:02,963: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3b316634-4456-4f90-8a62-b7650033755d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3b316634-4456-4f90-8a62-b7650033755d') 2024-05-25T22:49:02.964209757Z Traceback (most recent call last): 2024-05-25T22:49:02.964214420Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:49:02.964218796Z R = retval = fun(*args, **kwargs) 2024-05-25T22:49:02.964221809Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:49:02.964224992Z return self.run(*args, **kwargs) 2024-05-25T22:49:02.964228647Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:49:02.964238013Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:49:02.964241355Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:49:02.964245095Z raise AirflowException(msg) 2024-05-25T22:49:02.964249056Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3b316634-4456-4f90-8a62-b7650033755d 2024-05-25T22:49:02.977066213Z [2024-05-25 22:49:02,976: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:49:02.993727044Z [2024-05-25 22:49:02,993: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-25T22:49:02.996823980Z [2024-05-25 22:49:02,996: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:03.000154412Z [2024-05-25 22:49:02,999: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:03.019982908Z [2024-05-25 22:49:03,019: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-25T22:49:03.021219276Z [2024-05-25 22:49:03,021: INFO/ForkPoolWorker-4] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:03.021245791Z [2024-05-25 22:49:03,021: INFO/ForkPoolWorker-4] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:03.021328009Z [2024-05-25 22:49:03,021: INFO/ForkPoolWorker-4] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:49:03.021457753Z [2024-05-25 22:49:03,021: INFO/ForkPoolWorker-4] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:49:03.021483279Z [2024-05-25 22:49:03,021: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-25T22:49:03.021652893Z [2024-05-25 22:49:03,021: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:49:03.021672339Z [2024-05-25 22:49:03,021: INFO/ForkPoolWorker-4] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:03.025766418Z [2024-05-25 22:49:03,025: INFO/ForkPoolWorker-4] Creating DAG vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:49:03.079667941Z [2024-05-25 22:49:03,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:49:03.083597044Z [2024-05-25 22:49:03,083: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:03.083655168Z [2024-05-25 22:49:03,083: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:03.084347826Z [2024-05-25 22:49:03,084: INFO/ForkPoolWorker-15] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:49:03.085797745Z [2024-05-25 22:49:03,084: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:49:03.085861376Z [2024-05-25 22:49:03,085: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:49:03.086155849Z [2024-05-25 22:49:03,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:49:03.086290597Z [2024-05-25 22:49:03,086: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:03.093498010Z [2024-05-25 22:49:03,092: INFO/ForkPoolWorker-15] Creating DAG vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:49:03.248173688Z [2024-05-25 22:49:03,247: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:49:03.307379737Z [2024-05-25 22:49:03,307: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:49:03.732549310Z [2024-05-25 22:49:03,732: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[de33906f-2976-43be-a6c2-89feac3abb9a] succeeded in 2.8433491860000686s: None 2024-05-25T22:49:03.936758182Z [2024-05-25 22:49:03,936: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:49:03.942031662Z [2024-05-25 22:49:03,941: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:04.008642714Z [2024-05-25 22:49:04,008: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:49:04.012848599Z [2024-05-25 22:49:04,012: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:04.013141728Z [2024-05-25 22:49:04,012: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:04.013498454Z [2024-05-25 22:49:04,013: INFO/ForkPoolWorker-16] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:49:04.013733910Z [2024-05-25 22:49:04,013: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:49:04.013940991Z [2024-05-25 22:49:04,013: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:49:04.014337682Z [2024-05-25 22:49:04,014: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:49:04.014499571Z [2024-05-25 22:49:04,014: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:04.019735979Z [2024-05-25 22:49:04,019: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:49:04.213678833Z [2024-05-25 22:49:04,213: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:49:04.734492819Z [2024-05-25 22:49:04,734: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:49:04.738866300Z [2024-05-25 22:49:04,738: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:04.836631167Z [2024-05-25 22:49:04,836: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:49:04.842924588Z [2024-05-25 22:49:04,842: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:04.842937622Z [2024-05-25 22:49:04,842: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:04.842957600Z [2024-05-25 22:49:04,842: INFO/ForkPoolWorker-1] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:49:04.843111336Z [2024-05-25 22:49:04,842: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:49:04.843122100Z [2024-05-25 22:49:04,843: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:49:04.843392660Z [2024-05-25 22:49:04,843: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:49:04.843420749Z [2024-05-25 22:49:04,843: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:04.851222091Z [2024-05-25 22:49:04,850: INFO/ForkPoolWorker-1] Creating DAG vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:49:04.865134717Z [2024-05-25 22:49:04,864: WARNING/ForkPoolWorker-1] Dag 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:49:04.865821647Z [2024-05-25 22:49:04,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:49:04.866576113Z [2024-05-25 22:49:04,866: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:49:04.881170536Z [2024-05-25 22:49:04,880: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:04.884615788Z [2024-05-25 22:49:04,884: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T22:49:04.889257860Z [2024-05-25 22:49:04,888: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:04.907185254Z [2024-05-25 22:49:04,906: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:49:04.920266146Z [2024-05-25 22:49:04,920: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:04.920505121Z [2024-05-25 22:49:04,920: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:04.920674431Z [2024-05-25 22:49:04,920: INFO/ForkPoolWorker-1] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:49:04.920941609Z [2024-05-25 22:49:04,920: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:49:04.921534270Z [2024-05-25 22:49:04,921: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:49:04.921939627Z [2024-05-25 22:49:04,921: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:49:04.922298209Z [2024-05-25 22:49:04,921: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:04.929856158Z [2024-05-25 22:49:04,929: INFO/ForkPoolWorker-1] Creating DAG vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:49:04.931876470Z [2024-05-25 22:49:04,931: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T22:49:04.937675898Z [2024-05-25 22:49:04,937: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:04.938909329Z [2024-05-25 22:49:04,938: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:04.939065030Z [2024-05-25 22:49:04,938: INFO/ForkPoolWorker-2] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:49:04.939268334Z [2024-05-25 22:49:04,939: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:49:04.940868102Z [2024-05-25 22:49:04,940: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T22:49:04.941729455Z [2024-05-25 22:49:04,941: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:49:04.943342224Z [2024-05-25 22:49:04,943: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:04.950653594Z [2024-05-25 22:49:04,950: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:49:04.960638618Z [2024-05-25 22:49:04,960: ERROR/ForkPoolWorker-1] [0faf84a2-bcbe-4019-84be-83e926ab0dcb] Failed to execute task Dag 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:49:04.960658331Z Traceback (most recent call last): 2024-05-25T22:49:04.960662729Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:49:04.960666387Z args.func(args) 2024-05-25T22:49:04.960670470Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:49:04.960674341Z return func(*args, **kwargs) 2024-05-25T22:49:04.960677347Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:49:04.960680299Z return f(*args, **kwargs) 2024-05-25T22:49:04.960683171Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:49:04.960686175Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:49:04.960689046Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:49:04.960692171Z raise AirflowException( 2024-05-25T22:49:04.960695885Z airflow.exceptions.AirflowException: Dag 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:49:05.008208993Z [2024-05-25 22:49:05,007: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0faf84a2-bcbe-4019-84be-83e926ab0dcb] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0faf84a2-bcbe-4019-84be-83e926ab0dcb') 2024-05-25T22:49:05.008225883Z Traceback (most recent call last): 2024-05-25T22:49:05.008229770Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:49:05.008232906Z R = retval = fun(*args, **kwargs) 2024-05-25T22:49:05.008236178Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:49:05.008239812Z return self.run(*args, **kwargs) 2024-05-25T22:49:05.008243278Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:49:05.008246929Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:49:05.008249853Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:49:05.008253191Z raise AirflowException(msg) 2024-05-25T22:49:05.008256739Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0faf84a2-bcbe-4019-84be-83e926ab0dcb 2024-05-25T22:49:05.087375578Z [2024-05-25 22:49:05,087: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:49:05.361626994Z [2024-05-25 22:49:05,361: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9363a452-877d-4e1f-8572-b372b32b8c55] succeeded in 4.487634005000018s: None 2024-05-25T22:49:05.713111877Z [2024-05-25 22:49:05,712: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[b06e4b9e-4975-4dfb-b8a3-3f9636bfeafa] succeeded in 4.825227248999909s: None 2024-05-25T22:49:06.398936289Z [2024-05-25 22:49:06,398: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a8d6fdd-50e0-4f53-92e6-e319f69a4d20] succeeded in 5.524147440999968s: None 2024-05-25T22:49:07.083265116Z [2024-05-25 22:49:07,082: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[05f60459-61a2-42be-8419-76181b1aa147] succeeded in 6.199259149999989s: None 2024-05-25T22:49:14.092641562Z [2024-05-25 22:49:14,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20b202b7-6670-4c07-881b-9f1a9c7a3c3a] received 2024-05-25T22:49:14.101631150Z [2024-05-25 22:49:14,101: INFO/ForkPoolWorker-15] [20b202b7-6670-4c07-881b-9f1a9c7a3c3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:49:14.430528705Z [2024-05-25 22:49:14,427: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:49:15.197619324Z [2024-05-25 22:49:15,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a362005a-7c19-494f-aa81-b1f92c65779a] received 2024-05-25T22:49:15.211825520Z [2024-05-25 22:49:15,211: INFO/ForkPoolWorker-16] [a362005a-7c19-494f-aa81-b1f92c65779a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:49:15.612969714Z [2024-05-25 22:49:15,609: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:49:15.653633705Z [2024-05-25 22:49:15,653: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:49:15.657019189Z [2024-05-25 22:49:15,656: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:15.712670508Z [2024-05-25 22:49:15,711: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:49:15.715038661Z [2024-05-25 22:49:15,714: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:15.715076068Z [2024-05-25 22:49:15,714: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:15.716024754Z [2024-05-25 22:49:15,715: INFO/ForkPoolWorker-15] Read VIM 634c4e17-5a7e-4f5d-9c10-919c7fad93bb (basic01_866370) 2024-05-25T22:49:15.716749591Z [2024-05-25 22:49:15,715: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'name': 'basic01_866370', 'vim_type': 'openstack'}] 2024-05-25T22:49:15.716863102Z [2024-05-25 22:49:15,716: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:49:15.717237091Z [2024-05-25 22:49:15,717: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:49:15.717307904Z [2024-05-25 22:49:15,717: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:15.721797000Z [2024-05-25 22:49:15,721: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb 2024-05-25T22:49:15.727063137Z [2024-05-25 22:49:15,726: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:49:15.727932372Z [2024-05-25 22:49:15,727: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:49:15.729204913Z [2024-05-25 22:49:15,729: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:49:15.733669838Z [2024-05-25 22:49:15,733: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:15.764189985Z [2024-05-25 22:49:15,763: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:49:15.766547348Z [2024-05-25 22:49:15,766: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:15.766727028Z [2024-05-25 22:49:15,766: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:15.766965410Z [2024-05-25 22:49:15,766: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:49:15.767096013Z [2024-05-25 22:49:15,766: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:49:15.767565233Z [2024-05-25 22:49:15,767: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:49:15.767679620Z [2024-05-25 22:49:15,767: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:15.772589170Z [2024-05-25 22:49:15,771: ERROR/ForkPoolWorker-15] [20b202b7-6670-4c07-881b-9f1a9c7a3c3a] Failed to execute task Dag 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:49:15.772603753Z Traceback (most recent call last): 2024-05-25T22:49:15.772608285Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:49:15.772612601Z args.func(args) 2024-05-25T22:49:15.772616918Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:49:15.772621711Z return func(*args, **kwargs) 2024-05-25T22:49:15.772630172Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:49:15.772633952Z return f(*args, **kwargs) 2024-05-25T22:49:15.772637596Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:49:15.772641461Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:49:15.772645157Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:49:15.772662288Z raise AirflowException( 2024-05-25T22:49:15.772667036Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:49:15.808945329Z [2024-05-25 22:49:15,808: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20b202b7-6670-4c07-881b-9f1a9c7a3c3a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 20b202b7-6670-4c07-881b-9f1a9c7a3c3a') 2024-05-25T22:49:15.808964230Z Traceback (most recent call last): 2024-05-25T22:49:15.808968534Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:49:15.808971771Z R = retval = fun(*args, **kwargs) 2024-05-25T22:49:15.808974837Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:49:15.808977909Z return self.run(*args, **kwargs) 2024-05-25T22:49:15.808981275Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:49:15.808986322Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:49:15.808989406Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:49:15.808993541Z raise AirflowException(msg) 2024-05-25T22:49:15.808997301Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 20b202b7-6670-4c07-881b-9f1a9c7a3c3a 2024-05-25T22:49:16.950565662Z [2024-05-25 22:49:16,950: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:49:16.954271493Z [2024-05-25 22:49:16,953: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:16.978529559Z [2024-05-25 22:49:16,978: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:49:16.980512219Z [2024-05-25 22:49:16,980: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:16.980525147Z [2024-05-25 22:49:16,980: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:16.980760985Z [2024-05-25 22:49:16,980: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:49:16.980775245Z [2024-05-25 22:49:16,980: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:49:16.981187268Z [2024-05-25 22:49:16,980: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:49:16.981196491Z [2024-05-25 22:49:16,981: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:16.989190276Z [2024-05-25 22:49:16,988: WARNING/ForkPoolWorker-16] Dag 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:49:16.990262581Z [2024-05-25 22:49:16,989: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:49:16.991392925Z [2024-05-25 22:49:16,991: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:49:16.994831273Z [2024-05-25 22:49:16,994: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:49:17.016310655Z [2024-05-25 22:49:17,016: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:49:17.017873692Z [2024-05-25 22:49:17,017: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:49:17.018032407Z [2024-05-25 22:49:17,017: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:49:17.018315649Z [2024-05-25 22:49:17,018: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:49:17.018422633Z [2024-05-25 22:49:17,018: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:49:17.018769057Z [2024-05-25 22:49:17,018: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:49:17.018910799Z [2024-05-25 22:49:17,018: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:49:17.023090505Z [2024-05-25 22:49:17,022: ERROR/ForkPoolWorker-16] [a362005a-7c19-494f-aa81-b1f92c65779a] Failed to execute task Dag 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:49:17.023102655Z Traceback (most recent call last): 2024-05-25T22:49:17.023106273Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:49:17.023109552Z args.func(args) 2024-05-25T22:49:17.023112766Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:49:17.023116796Z return func(*args, **kwargs) 2024-05-25T22:49:17.023122328Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:49:17.023125554Z return f(*args, **kwargs) 2024-05-25T22:49:17.023128332Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:49:17.023131084Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:49:17.023133907Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:49:17.023136682Z raise AirflowException( 2024-05-25T22:49:17.023140722Z airflow.exceptions.AirflowException: Dag 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:49:17.071077987Z [2024-05-25 22:49:17,070: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a362005a-7c19-494f-aa81-b1f92c65779a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a362005a-7c19-494f-aa81-b1f92c65779a') 2024-05-25T22:49:17.071113324Z Traceback (most recent call last): 2024-05-25T22:49:17.071123774Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:49:17.071136450Z R = retval = fun(*args, **kwargs) 2024-05-25T22:49:17.071145284Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:49:17.071153763Z return self.run(*args, **kwargs) 2024-05-25T22:49:17.071185588Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:49:17.071195906Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:49:17.071204162Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:49:17.071213070Z raise AirflowException(msg) 2024-05-25T22:49:17.071224195Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a362005a-7c19-494f-aa81-b1f92c65779a 2024-05-25T22:50:01.178346722Z [2024-05-25 22:50:01,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76946e20-39c1-41f6-bd40-fd19243dad08] received 2024-05-25T22:50:01.180756770Z [2024-05-25 22:50:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[041d4f94-20d4-4cc2-9107-0d16c632fb8f] received 2024-05-25T22:50:01.188464801Z [2024-05-25 22:50:01,188: INFO/ForkPoolWorker-15] [76946e20-39c1-41f6-bd40-fd19243dad08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:01.192930370Z [2024-05-25 22:50:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57702954-f5c3-406f-ba89-b57e20a78707] received 2024-05-25T22:50:01.197872277Z [2024-05-25 22:50:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d73e7da-64d4-42c6-bf22-78bc77a3d2b7] received 2024-05-25T22:50:01.199868356Z [2024-05-25 22:50:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6dd31b0e-38bf-4db7-8f3e-75031cf2f701] received 2024-05-25T22:50:01.209102194Z [2024-05-25 22:50:01,208: INFO/ForkPoolWorker-3] [6dd31b0e-38bf-4db7-8f3e-75031cf2f701] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:50:01.213770994Z [2024-05-25 22:50:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb226121-b228-46d0-a8d3-6e3ad3e7a01e] received 2024-05-25T22:50:01.220164750Z [2024-05-25 22:50:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69870078-5106-415d-bea3-6983c651f368] received 2024-05-25T22:50:01.230073651Z [2024-05-25 22:50:01,229: INFO/ForkPoolWorker-16] [041d4f94-20d4-4cc2-9107-0d16c632fb8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:01.230920767Z [2024-05-25 22:50:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c847673e-da3d-48ea-af86-e0afb2d25753] received 2024-05-25T22:50:01.232151385Z [2024-05-25 22:50:01,231: INFO/ForkPoolWorker-5] [69870078-5106-415d-bea3-6983c651f368] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:50:01.233166781Z [2024-05-25 22:50:01,232: INFO/ForkPoolWorker-1] [57702954-f5c3-406f-ba89-b57e20a78707] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:50:01.236598681Z [2024-05-25 22:50:01,236: INFO/ForkPoolWorker-4] [fb226121-b228-46d0-a8d3-6e3ad3e7a01e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:50:01.244984660Z [2024-05-25 22:50:01,244: INFO/ForkPoolWorker-2] [2d73e7da-64d4-42c6-bf22-78bc77a3d2b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:50:01.332893505Z [2024-05-25 22:50:01,332: INFO/ForkPoolWorker-6] [c847673e-da3d-48ea-af86-e0afb2d25753] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:50:01.787936760Z [2024-05-25 22:50:01,783: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:50:01.844772202Z [2024-05-25 22:50:01,840: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:50:01.933164515Z [2024-05-25 22:50:01,929: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:50:02.039373906Z [2024-05-25 22:50:02,034: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:02.145025589Z [2024-05-25 22:50:02,144: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:50:02.385003400Z [2024-05-25 22:50:02,381: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:50:02.565400333Z [2024-05-25 22:50:02,533: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:50:02.622372656Z [2024-05-25 22:50:02,594: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:50:02.711646702Z [2024-05-25 22:50:02,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:02.720186394Z [2024-05-25 22:50:02,719: INFO/ForkPoolWorker-6] Getting SDNC list 2024-05-25T22:50:02.759751699Z [2024-05-25 22:50:02,731: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:02.892086070Z [2024-05-25 22:50:02,891: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-05-25T22:50:02.905844953Z [2024-05-25 22:50:02,905: INFO/ForkPoolWorker-6] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:50:02.906100418Z [2024-05-25 22:50:02,905: INFO/ForkPoolWorker-6] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:50:02.906157516Z [2024-05-25 22:50:02,906: INFO/ForkPoolWorker-6] Getting SDNC list OK 2024-05-25T22:50:02.906518738Z [2024-05-25 22:50:02,906: INFO/ForkPoolWorker-6] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:50:03.541994973Z [2024-05-25 22:50:03,541: INFO/ForkPoolWorker-6] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:50:04.599223634Z [2024-05-25 22:50:04,598: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[57702954-f5c3-406f-ba89-b57e20a78707] succeeded in 3.4040636610000092s: None 2024-05-25T22:50:04.671760034Z [2024-05-25 22:50:04,671: INFO/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[c847673e-da3d-48ea-af86-e0afb2d25753] succeeded in 3.4331586739999693s: None 2024-05-25T22:50:04.935367112Z [2024-05-25 22:50:04,935: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T22:50:04.942261847Z [2024-05-25 22:50:04,941: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:04.996612308Z [2024-05-25 22:50:04,996: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T22:50:04.999102852Z [2024-05-25 22:50:04,998: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:04.999115081Z [2024-05-25 22:50:04,999: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:04.999319608Z [2024-05-25 22:50:04,999: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:04.999401788Z [2024-05-25 22:50:04,999: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T22:50:04.999795166Z [2024-05-25 22:50:04,999: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:50:04.999949432Z [2024-05-25 22:50:04,999: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:05.147629372Z [2024-05-25 22:50:05,147: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:50:05.638635451Z [2024-05-25 22:50:05,638: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:50:05.645356326Z [2024-05-25 22:50:05,644: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:05.677808695Z [2024-05-25 22:50:05,677: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:50:05.679744419Z [2024-05-25 22:50:05,679: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:05.679760664Z [2024-05-25 22:50:05,679: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:05.679854660Z [2024-05-25 22:50:05,679: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:05.679882210Z [2024-05-25 22:50:05,679: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:50:05.680075662Z [2024-05-25 22:50:05,679: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:50:05.680115813Z [2024-05-25 22:50:05,680: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:05.696749683Z [2024-05-25 22:50:05,696: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:05.697421189Z [2024-05-25 22:50:05,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:05.699559851Z [2024-05-25 22:50:05,699: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:50:05.703799580Z [2024-05-25 22:50:05,703: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:05.741797676Z [2024-05-25 22:50:05,741: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:50:05.744212127Z [2024-05-25 22:50:05,743: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:05.744325204Z [2024-05-25 22:50:05,744: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:05.744506489Z [2024-05-25 22:50:05,744: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:05.744561579Z [2024-05-25 22:50:05,744: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:50:05.744833865Z [2024-05-25 22:50:05,744: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:50:05.745396178Z [2024-05-25 22:50:05,745: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:05.750251536Z [2024-05-25 22:50:05,749: ERROR/ForkPoolWorker-16] [041d4f94-20d4-4cc2-9107-0d16c632fb8f] Failed to execute task Dag 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:50:05.750271971Z Traceback (most recent call last): 2024-05-25T22:50:05.750277667Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:50:05.750281749Z args.func(args) 2024-05-25T22:50:05.750286056Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:50:05.750290905Z return func(*args, **kwargs) 2024-05-25T22:50:05.750294769Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:50:05.750336477Z return f(*args, **kwargs) 2024-05-25T22:50:05.750340470Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:50:05.750344266Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:50:05.750347938Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:50:05.750351584Z raise AirflowException( 2024-05-25T22:50:05.750358999Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:50:05.779294192Z [2024-05-25 22:50:05,778: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T22:50:05.785897706Z [2024-05-25 22:50:05,785: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:05.790365403Z [2024-05-25 22:50:05,789: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[041d4f94-20d4-4cc2-9107-0d16c632fb8f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 041d4f94-20d4-4cc2-9107-0d16c632fb8f') 2024-05-25T22:50:05.790382408Z Traceback (most recent call last): 2024-05-25T22:50:05.790386499Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:50:05.790389589Z R = retval = fun(*args, **kwargs) 2024-05-25T22:50:05.790392804Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:50:05.790395877Z return self.run(*args, **kwargs) 2024-05-25T22:50:05.790399390Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:50:05.790403994Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:50:05.790407036Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:50:05.790410624Z raise AirflowException(msg) 2024-05-25T22:50:05.790414456Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 041d4f94-20d4-4cc2-9107-0d16c632fb8f 2024-05-25T22:50:05.828123124Z [2024-05-25 22:50:05,827: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T22:50:05.832660755Z [2024-05-25 22:50:05,832: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:05.832673526Z [2024-05-25 22:50:05,832: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:05.832796674Z [2024-05-25 22:50:05,832: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:05.832803655Z [2024-05-25 22:50:05,832: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T22:50:05.833251255Z [2024-05-25 22:50:05,832: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:50:05.833263510Z [2024-05-25 22:50:05,833: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:05.841512166Z [2024-05-25 22:50:05,841: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:50:05.842218950Z [2024-05-25 22:50:05,841: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:50:05.843730725Z [2024-05-25 22:50:05,843: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T22:50:05.846236570Z [2024-05-25 22:50:05,845: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:05.877280807Z [2024-05-25 22:50:05,877: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T22:50:05.888617425Z [2024-05-25 22:50:05,888: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:05.888639031Z [2024-05-25 22:50:05,888: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:05.888731621Z [2024-05-25 22:50:05,888: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:05.888751622Z [2024-05-25 22:50:05,888: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T22:50:05.889040057Z [2024-05-25 22:50:05,888: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:50:05.889056907Z [2024-05-25 22:50:05,888: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:05.892652460Z [2024-05-25 22:50:05,892: ERROR/ForkPoolWorker-3] [6dd31b0e-38bf-4db7-8f3e-75031cf2f701] Failed to execute task Dag 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:50:05.892662786Z Traceback (most recent call last): 2024-05-25T22:50:05.892667835Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:50:05.892672623Z args.func(args) 2024-05-25T22:50:05.892676534Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:50:05.892680113Z return func(*args, **kwargs) 2024-05-25T22:50:05.892683197Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:50:05.892686196Z return f(*args, **kwargs) 2024-05-25T22:50:05.892689442Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:50:05.892692565Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:50:05.892695637Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:50:05.892698694Z raise AirflowException( 2024-05-25T22:50:05.892703260Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:50:05.990334489Z [2024-05-25 22:50:05,989: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6dd31b0e-38bf-4db7-8f3e-75031cf2f701] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6dd31b0e-38bf-4db7-8f3e-75031cf2f701') 2024-05-25T22:50:05.990349926Z Traceback (most recent call last): 2024-05-25T22:50:05.990354102Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:50:05.990357303Z R = retval = fun(*args, **kwargs) 2024-05-25T22:50:05.990360348Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:50:05.990363377Z return self.run(*args, **kwargs) 2024-05-25T22:50:05.990401095Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:50:05.990405566Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:50:05.990408586Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:50:05.990412253Z raise AirflowException(msg) 2024-05-25T22:50:05.990427913Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6dd31b0e-38bf-4db7-8f3e-75031cf2f701 2024-05-25T22:50:06.188680669Z [2024-05-25 22:50:06,188: INFO/ForkPoolWorker-5] Getting VIM list 2024-05-25T22:50:06.194203946Z [2024-05-25 22:50:06,193: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:06.251828229Z [2024-05-25 22:50:06,251: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-25T22:50:06.254193336Z [2024-05-25 22:50:06,253: INFO/ForkPoolWorker-5] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:06.254256175Z [2024-05-25 22:50:06,254: INFO/ForkPoolWorker-5] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:06.254410217Z [2024-05-25 22:50:06,254: INFO/ForkPoolWorker-5] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:06.254524230Z [2024-05-25 22:50:06,254: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-05-25T22:50:06.254797257Z [2024-05-25 22:50:06,254: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:50:06.255290798Z [2024-05-25 22:50:06,255: INFO/ForkPoolWorker-5] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:06.391897481Z [2024-05-25 22:50:06,391: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:50:06.412704518Z [2024-05-25 22:50:06,412: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:50:06.416809518Z [2024-05-25 22:50:06,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:06.481001444Z [2024-05-25 22:50:06,480: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:50:06.496534782Z [2024-05-25 22:50:06,496: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:06.497359616Z [2024-05-25 22:50:06,496: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:06.497640699Z [2024-05-25 22:50:06,497: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:06.497817460Z [2024-05-25 22:50:06,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:50:06.498545812Z [2024-05-25 22:50:06,498: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:50:06.498795473Z [2024-05-25 22:50:06,498: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:06.638092582Z [2024-05-25 22:50:06,637: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:50:06.906464060Z [2024-05-25 22:50:06,906: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-25T22:50:06.909831850Z [2024-05-25 22:50:06,909: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:06.945103457Z [2024-05-25 22:50:06,944: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-25T22:50:06.946335398Z [2024-05-25 22:50:06,946: INFO/ForkPoolWorker-4] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:06.948583303Z [2024-05-25 22:50:06,946: INFO/ForkPoolWorker-4] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:06.948765206Z [2024-05-25 22:50:06,948: INFO/ForkPoolWorker-4] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:06.948812106Z [2024-05-25 22:50:06,948: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-25T22:50:06.949156038Z [2024-05-25 22:50:06,949: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:50:06.949379001Z [2024-05-25 22:50:06,949: INFO/ForkPoolWorker-4] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:06.963405007Z [2024-05-25 22:50:06,963: WARNING/ForkPoolWorker-4] Dag 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:50:06.966580867Z [2024-05-25 22:50:06,963: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:50:06.967380659Z [2024-05-25 22:50:06,967: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-25T22:50:06.969924528Z [2024-05-25 22:50:06,969: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:06.998512783Z [2024-05-25 22:50:06,997: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-25T22:50:07.003081246Z [2024-05-25 22:50:07,002: INFO/ForkPoolWorker-4] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:07.003093427Z [2024-05-25 22:50:07,002: INFO/ForkPoolWorker-4] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:07.003202841Z [2024-05-25 22:50:07,003: INFO/ForkPoolWorker-4] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:07.003211024Z [2024-05-25 22:50:07,003: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-25T22:50:07.003460107Z [2024-05-25 22:50:07,003: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:50:07.003468861Z [2024-05-25 22:50:07,003: INFO/ForkPoolWorker-4] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:07.009755907Z [2024-05-25 22:50:07,006: ERROR/ForkPoolWorker-4] [fb226121-b228-46d0-a8d3-6e3ad3e7a01e] Failed to execute task Dag 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:50:07.009767461Z Traceback (most recent call last): 2024-05-25T22:50:07.009771402Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:50:07.009795294Z args.func(args) 2024-05-25T22:50:07.009799188Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:50:07.009802724Z return func(*args, **kwargs) 2024-05-25T22:50:07.009806074Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:50:07.009829384Z return f(*args, **kwargs) 2024-05-25T22:50:07.009833006Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:50:07.009836085Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:50:07.009839347Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:50:07.009842326Z raise AirflowException( 2024-05-25T22:50:07.009860117Z airflow.exceptions.AirflowException: Dag 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:50:07.053209357Z [2024-05-25 22:50:07,052: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[fb226121-b228-46d0-a8d3-6e3ad3e7a01e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fb226121-b228-46d0-a8d3-6e3ad3e7a01e') 2024-05-25T22:50:07.053226243Z Traceback (most recent call last): 2024-05-25T22:50:07.053230104Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:50:07.053233218Z R = retval = fun(*args, **kwargs) 2024-05-25T22:50:07.053236171Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:50:07.053239453Z return self.run(*args, **kwargs) 2024-05-25T22:50:07.053242897Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:50:07.053246674Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:50:07.053289153Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:50:07.053292972Z raise AirflowException(msg) 2024-05-25T22:50:07.053308360Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fb226121-b228-46d0-a8d3-6e3ad3e7a01e 2024-05-25T22:50:07.341258461Z [2024-05-25 22:50:07,340: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76946e20-39c1-41f6-bd40-fd19243dad08] succeeded in 6.158514788000048s: None 2024-05-25T22:50:07.521974714Z [2024-05-25 22:50:07,521: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2d73e7da-64d4-42c6-bf22-78bc77a3d2b7] succeeded in 6.320264922999968s: None 2024-05-25T22:50:07.967326489Z [2024-05-25 22:50:07,966: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[69870078-5106-415d-bea3-6983c651f368] succeeded in 6.741838520000101s: None 2024-05-25T22:50:08.199827063Z [2024-05-25 22:50:08,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[403ce4cb-6bc0-40de-9cdc-210e4bf324bc] received 2024-05-25T22:50:08.208941034Z [2024-05-25 22:50:08,208: INFO/ForkPoolWorker-15] [403ce4cb-6bc0-40de-9cdc-210e4bf324bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:08.591852756Z [2024-05-25 22:50:08,588: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:09.785392352Z [2024-05-25 22:50:09,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:50:09.788778287Z [2024-05-25 22:50:09,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:09.812104663Z [2024-05-25 22:50:09,811: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:50:09.813780651Z [2024-05-25 22:50:09,813: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:09.813795513Z [2024-05-25 22:50:09,813: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:09.814123118Z [2024-05-25 22:50:09,813: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:09.814134203Z [2024-05-25 22:50:09,814: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:50:09.814536499Z [2024-05-25 22:50:09,814: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:50:09.814688426Z [2024-05-25 22:50:09,814: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:09.924107838Z [2024-05-25 22:50:09,923: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:50:10.759607444Z [2024-05-25 22:50:10,752: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[403ce4cb-6bc0-40de-9cdc-210e4bf324bc] succeeded in 2.5511419899999055s: None 2024-05-25T22:50:10.765156978Z [2024-05-25 22:50:10,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1971b6a-e415-4854-bd3c-4a5dbed1806e] received 2024-05-25T22:50:10.774659716Z [2024-05-25 22:50:10,774: INFO/ForkPoolWorker-15] [f1971b6a-e415-4854-bd3c-4a5dbed1806e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:50:11.043853881Z [2024-05-25 22:50:11,040: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:12.110119637Z [2024-05-25 22:50:12,109: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:50:12.113641112Z [2024-05-25 22:50:12,113: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:12.139457649Z [2024-05-25 22:50:12,139: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:50:12.141660949Z [2024-05-25 22:50:12,141: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:12.141770485Z [2024-05-25 22:50:12,141: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:12.142097345Z [2024-05-25 22:50:12,141: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:12.142256177Z [2024-05-25 22:50:12,142: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:50:12.142659830Z [2024-05-25 22:50:12,142: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:50:12.142751377Z [2024-05-25 22:50:12,142: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:12.228940687Z [2024-05-25 22:50:12,228: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:50:12.833326125Z [2024-05-25 22:50:12,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1971b6a-e415-4854-bd3c-4a5dbed1806e] succeeded in 2.0650936330000604s: None 2024-05-25T22:50:13.283303518Z [2024-05-25 22:50:13,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f77f1bf9-0e2f-4109-8676-7cb951412a22] received 2024-05-25T22:50:13.299141368Z [2024-05-25 22:50:13,298: INFO/ForkPoolWorker-15] [f77f1bf9-0e2f-4109-8676-7cb951412a22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:13.572445002Z [2024-05-25 22:50:13,569: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:14.693313941Z [2024-05-25 22:50:14,692: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:50:14.696621844Z [2024-05-25 22:50:14,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:14.723332358Z [2024-05-25 22:50:14,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:50:14.724725782Z [2024-05-25 22:50:14,724: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:14.724760292Z [2024-05-25 22:50:14,724: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:14.724910532Z [2024-05-25 22:50:14,724: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:14.724956442Z [2024-05-25 22:50:14,724: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:50:14.725185273Z [2024-05-25 22:50:14,725: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:50:14.725248594Z [2024-05-25 22:50:14,725: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:14.818416902Z [2024-05-25 22:50:14,818: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:50:15.417348634Z [2024-05-25 22:50:15,416: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f77f1bf9-0e2f-4109-8676-7cb951412a22] succeeded in 2.1298725809999723s: None 2024-05-25T22:50:18.111297992Z [2024-05-25 22:50:18,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3128c008-2270-43eb-a13f-1390b4f3d8e5] received 2024-05-25T22:50:18.119096381Z [2024-05-25 22:50:18,118: INFO/ForkPoolWorker-15] [3128c008-2270-43eb-a13f-1390b4f3d8e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:18.121295682Z [2024-05-25 22:50:18,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46a7f046-6c82-490f-b5b7-a3b7efbd6c87] received 2024-05-25T22:50:18.127541546Z [2024-05-25 22:50:18,127: INFO/ForkPoolWorker-16] [46a7f046-6c82-490f-b5b7-a3b7efbd6c87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:50:18.330377439Z [2024-05-25 22:50:18,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d57f482-b19a-46a4-bed9-eb5a71ae6106] received 2024-05-25T22:50:18.340446131Z [2024-05-25 22:50:18,340: INFO/ForkPoolWorker-1] [1d57f482-b19a-46a4-bed9-eb5a71ae6106] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:50:18.398839818Z [2024-05-25 22:50:18,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:18.441180962Z [2024-05-25 22:50:18,437: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:50:18.710059753Z [2024-05-25 22:50:18,707: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:50:19.547197207Z [2024-05-25 22:50:19,546: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:50:19.550668083Z [2024-05-25 22:50:19,550: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:19.569292965Z [2024-05-25 22:50:19,569: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:50:19.570388976Z [2024-05-25 22:50:19,570: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:19.570405731Z [2024-05-25 22:50:19,570: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:19.570665185Z [2024-05-25 22:50:19,570: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:19.570696254Z [2024-05-25 22:50:19,570: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:50:19.570748138Z [2024-05-25 22:50:19,570: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:50:19.570763951Z [2024-05-25 22:50:19,570: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:19.577904062Z [2024-05-25 22:50:19,577: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:19.578508582Z [2024-05-25 22:50:19,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:50:19.579315789Z [2024-05-25 22:50:19,579: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:50:19.581853001Z [2024-05-25 22:50:19,581: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:19.597071813Z [2024-05-25 22:50:19,596: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:50:19.598674753Z [2024-05-25 22:50:19,598: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:19.598703389Z [2024-05-25 22:50:19,598: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:19.598752426Z [2024-05-25 22:50:19,598: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:19.598895215Z [2024-05-25 22:50:19,598: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:50:19.599041101Z [2024-05-25 22:50:19,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:50:19.599097987Z [2024-05-25 22:50:19,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:19.603973303Z [2024-05-25 22:50:19,603: ERROR/ForkPoolWorker-15] [3128c008-2270-43eb-a13f-1390b4f3d8e5] Failed to execute task Dag 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:50:19.603988406Z Traceback (most recent call last): 2024-05-25T22:50:19.603992230Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:50:19.604003748Z args.func(args) 2024-05-25T22:50:19.604007457Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:50:19.604011767Z return func(*args, **kwargs) 2024-05-25T22:50:19.604014535Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:50:19.604017261Z return f(*args, **kwargs) 2024-05-25T22:50:19.604020009Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:50:19.604022962Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:50:19.604025691Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:50:19.604028408Z raise AirflowException( 2024-05-25T22:50:19.604046147Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:50:19.606801401Z [2024-05-25 22:50:19,606: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:50:19.610069854Z [2024-05-25 22:50:19,609: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:19.631086214Z [2024-05-25 22:50:19,630: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:50:19.632360693Z [2024-05-25 22:50:19,632: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:19.632391364Z [2024-05-25 22:50:19,632: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:19.632552420Z [2024-05-25 22:50:19,632: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:19.632697979Z [2024-05-25 22:50:19,632: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:50:19.633137491Z [2024-05-25 22:50:19,632: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:50:19.633329968Z [2024-05-25 22:50:19,633: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:19.638153078Z [2024-05-25 22:50:19,637: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3128c008-2270-43eb-a13f-1390b4f3d8e5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3128c008-2270-43eb-a13f-1390b4f3d8e5') 2024-05-25T22:50:19.638167570Z Traceback (most recent call last): 2024-05-25T22:50:19.638171466Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:50:19.638174656Z R = retval = fun(*args, **kwargs) 2024-05-25T22:50:19.638177673Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:50:19.638180652Z return self.run(*args, **kwargs) 2024-05-25T22:50:19.638183929Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:50:19.638193320Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:50:19.638196623Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:50:19.638206304Z raise AirflowException(msg) 2024-05-25T22:50:19.638210775Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3128c008-2270-43eb-a13f-1390b4f3d8e5 2024-05-25T22:50:19.639289413Z [2024-05-25 22:50:19,639: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:50:19.640162755Z [2024-05-25 22:50:19,639: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:50:19.641109733Z [2024-05-25 22:50:19,640: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:50:19.643917514Z [2024-05-25 22:50:19,643: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:19.655869459Z [2024-05-25 22:50:19,655: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:50:19.657167837Z [2024-05-25 22:50:19,656: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:19.657306268Z [2024-05-25 22:50:19,657: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:19.657523410Z [2024-05-25 22:50:19,657: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:19.657710079Z [2024-05-25 22:50:19,657: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:50:19.658385780Z [2024-05-25 22:50:19,658: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:50:19.658547579Z [2024-05-25 22:50:19,658: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:19.662377988Z [2024-05-25 22:50:19,661: ERROR/ForkPoolWorker-16] [46a7f046-6c82-490f-b5b7-a3b7efbd6c87] Failed to execute task Dag 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:50:19.662389878Z Traceback (most recent call last): 2024-05-25T22:50:19.662393666Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:50:19.662407277Z args.func(args) 2024-05-25T22:50:19.662410962Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:50:19.662415514Z return func(*args, **kwargs) 2024-05-25T22:50:19.662418453Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:50:19.662421378Z return f(*args, **kwargs) 2024-05-25T22:50:19.662425088Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:50:19.662446442Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:50:19.662451841Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:50:19.662456905Z raise AirflowException( 2024-05-25T22:50:19.662462996Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:50:19.696695519Z [2024-05-25 22:50:19,696: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[46a7f046-6c82-490f-b5b7-a3b7efbd6c87] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 46a7f046-6c82-490f-b5b7-a3b7efbd6c87') 2024-05-25T22:50:19.696755429Z Traceback (most recent call last): 2024-05-25T22:50:19.696764299Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:50:19.696771906Z R = retval = fun(*args, **kwargs) 2024-05-25T22:50:19.696778867Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:50:19.696785804Z return self.run(*args, **kwargs) 2024-05-25T22:50:19.696793639Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:50:19.696825808Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:50:19.696833929Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:50:19.696841407Z raise AirflowException(msg) 2024-05-25T22:50:19.696849306Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 46a7f046-6c82-490f-b5b7-a3b7efbd6c87 2024-05-25T22:50:19.886128963Z [2024-05-25 22:50:19,885: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:50:19.888989110Z [2024-05-25 22:50:19,888: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:19.910427914Z [2024-05-25 22:50:19,910: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:50:19.911785132Z [2024-05-25 22:50:19,911: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:19.911800141Z [2024-05-25 22:50:19,911: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:19.911951816Z [2024-05-25 22:50:19,911: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:19.911960687Z [2024-05-25 22:50:19,911: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:50:19.912239140Z [2024-05-25 22:50:19,912: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:50:19.912253041Z [2024-05-25 22:50:19,912: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:19.920737028Z [2024-05-25 22:50:19,920: WARNING/ForkPoolWorker-1] Dag 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:50:19.921339894Z [2024-05-25 22:50:19,920: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:50:19.922098673Z [2024-05-25 22:50:19,921: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:50:19.924777801Z [2024-05-25 22:50:19,924: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:50:19.940420228Z [2024-05-25 22:50:19,940: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:50:19.942373430Z [2024-05-25 22:50:19,942: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:50:19.942618220Z [2024-05-25 22:50:19,942: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:50:19.942739590Z [2024-05-25 22:50:19,942: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:50:19.942755332Z [2024-05-25 22:50:19,942: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:50:19.943115877Z [2024-05-25 22:50:19,942: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:50:19.943122587Z [2024-05-25 22:50:19,942: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:50:19.948097067Z [2024-05-25 22:50:19,947: ERROR/ForkPoolWorker-1] [1d57f482-b19a-46a4-bed9-eb5a71ae6106] Failed to execute task Dag 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse.. 2024-05-25T22:50:19.948112679Z Traceback (most recent call last): 2024-05-25T22:50:19.948117785Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T22:50:19.948122507Z args.func(args) 2024-05-25T22:50:19.948128942Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T22:50:19.948135677Z return func(*args, **kwargs) 2024-05-25T22:50:19.948192951Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T22:50:19.948198089Z return f(*args, **kwargs) 2024-05-25T22:50:19.948202220Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T22:50:19.948206314Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T22:50:19.948210527Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T22:50:19.948214500Z raise AirflowException( 2024-05-25T22:50:19.948242928Z airflow.exceptions.AirflowException: Dag 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb' could not be found; either it does not exist or it failed to parse. 2024-05-25T22:50:19.980897254Z [2024-05-25 22:50:19,980: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1d57f482-b19a-46a4-bed9-eb5a71ae6106] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1d57f482-b19a-46a4-bed9-eb5a71ae6106') 2024-05-25T22:50:19.980918473Z Traceback (most recent call last): 2024-05-25T22:50:19.980925101Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T22:50:19.980930176Z R = retval = fun(*args, **kwargs) 2024-05-25T22:50:19.980959446Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T22:50:19.980963334Z return self.run(*args, **kwargs) 2024-05-25T22:50:19.980968247Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T22:50:19.980973323Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T22:50:19.980976340Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T22:50:19.980980826Z raise AirflowException(msg) 2024-05-25T22:50:19.980984572Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1d57f482-b19a-46a4-bed9-eb5a71ae6106 2024-05-25T22:51:00.456856822Z [2024-05-25 22:51:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18e0d9b5-45be-477a-8b75-9adaeabed276] received 2024-05-25T22:51:00.461608860Z [2024-05-25 22:51:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83ff594c-a3c0-43d3-a44c-0f01555bc884] received 2024-05-25T22:51:00.463545694Z [2024-05-25 22:51:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbb5362f-e0c8-43bc-85c4-b22bd5002516] received 2024-05-25T22:51:00.478168044Z [2024-05-25 22:51:00,477: INFO/ForkPoolWorker-1] [cbb5362f-e0c8-43bc-85c4-b22bd5002516] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:51:00.479074801Z [2024-05-25 22:51:00,478: INFO/ForkPoolWorker-16] [83ff594c-a3c0-43d3-a44c-0f01555bc884] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:51:00.479230171Z [2024-05-25 22:51:00,478: INFO/ForkPoolWorker-15] [18e0d9b5-45be-477a-8b75-9adaeabed276] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:51:00.810967774Z [2024-05-25 22:51:00,804: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:51:00.829774120Z [2024-05-25 22:51:00,826: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:51:00.849523595Z [2024-05-25 22:51:00,844: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:51:01.010005609Z [2024-05-25 22:51:01,009: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T22:51:01.013809883Z [2024-05-25 22:51:01,013: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:51:01.044531674Z [2024-05-25 22:51:01,044: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:51:01.045644904Z [2024-05-25 22:51:01,045: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:51:01.045758218Z [2024-05-25 22:51:01,045: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:51:01.045821210Z [2024-05-25 22:51:01,045: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T22:51:01.046056793Z [2024-05-25 22:51:01,045: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:51:01.148910898Z [2024-05-25 22:51:01,148: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:51:01.807615241Z [2024-05-25 22:51:01,807: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[18e0d9b5-45be-477a-8b75-9adaeabed276] succeeded in 1.3476462739999988s: None 2024-05-25T22:51:01.971142122Z [2024-05-25 22:51:01,970: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:51:01.974286406Z [2024-05-25 22:51:01,973: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:51:01.997847916Z [2024-05-25 22:51:01,997: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:51:01.999697057Z [2024-05-25 22:51:01,999: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:51:01.999826745Z [2024-05-25 22:51:01,999: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:51:02.000003353Z [2024-05-25 22:51:01,999: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:51:02.000102850Z [2024-05-25 22:51:02,000: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:51:02.000440883Z [2024-05-25 22:51:02,000: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:51:02.000553825Z [2024-05-25 22:51:02,000: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:51:02.083013404Z [2024-05-25 22:51:02,082: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:51:02.086221344Z [2024-05-25 22:51:02,085: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:51:02.089506611Z [2024-05-25 22:51:02,089: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:51:02.108375137Z [2024-05-25 22:51:02,108: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:51:02.109566232Z [2024-05-25 22:51:02,109: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:51:02.109607154Z [2024-05-25 22:51:02,109: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:51:02.109812437Z [2024-05-25 22:51:02,109: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:51:02.109959716Z [2024-05-25 22:51:02,109: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:51:02.110470576Z [2024-05-25 22:51:02,110: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:51:02.110582693Z [2024-05-25 22:51:02,110: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:51:02.205680721Z [2024-05-25 22:51:02,205: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:51:03.731434296Z [2024-05-25 22:51:03,730: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cbb5362f-e0c8-43bc-85c4-b22bd5002516] succeeded in 3.265941904000101s: None 2024-05-25T22:51:04.342696403Z [2024-05-25 22:51:04,342: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83ff594c-a3c0-43d3-a44c-0f01555bc884] succeeded in 3.879614360000005s: None 2024-05-25T22:52:00.330630366Z [2024-05-25 22:52:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17450b76-6ead-416f-bd3a-ad0e6a740401] received 2024-05-25T22:52:00.332218045Z [2024-05-25 22:52:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ee0223e-ffe3-4c40-9b76-d82e0520aa5a] received 2024-05-25T22:52:00.343937775Z [2024-05-25 22:52:00,343: INFO/ForkPoolWorker-15] [17450b76-6ead-416f-bd3a-ad0e6a740401] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:52:00.352527905Z [2024-05-25 22:52:00,351: INFO/ForkPoolWorker-16] [0ee0223e-ffe3-4c40-9b76-d82e0520aa5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:52:00.354496632Z [2024-05-25 22:52:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e556d0e-a892-41f4-8bb9-5c66d883d718] received 2024-05-25T22:52:00.374537617Z [2024-05-25 22:52:00,374: INFO/ForkPoolWorker-1] [6e556d0e-a892-41f4-8bb9-5c66d883d718] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:52:00.376051047Z [2024-05-25 22:52:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b41962af-fde3-499e-b27a-d4dad659e026] received 2024-05-25T22:52:00.423566686Z [2024-05-25 22:52:00,423: INFO/ForkPoolWorker-2] [b41962af-fde3-499e-b27a-d4dad659e026] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:52:01.221660701Z [2024-05-25 22:52:01,217: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:52:01.223736034Z [2024-05-25 22:52:01,220: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:52:01.247849816Z [2024-05-25 22:52:01,240: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:52:01.298497980Z [2024-05-25 22:52:01,283: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:52:01.538111145Z [2024-05-25 22:52:01,537: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T22:52:01.549448753Z [2024-05-25 22:52:01,548: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:52:01.608107023Z [2024-05-25 22:52:01,607: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:52:01.611925742Z [2024-05-25 22:52:01,611: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:52:01.619445804Z [2024-05-25 22:52:01,612: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:52:01.619753395Z [2024-05-25 22:52:01,619: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:52:01.620071008Z [2024-05-25 22:52:01,619: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T22:52:01.620582411Z [2024-05-25 22:52:01,620: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:52:01.756907969Z [2024-05-25 22:52:01,756: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:52:02.666700431Z [2024-05-25 22:52:02,666: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17450b76-6ead-416f-bd3a-ad0e6a740401] succeeded in 2.332465491999983s: None 2024-05-25T22:52:02.976316697Z [2024-05-25 22:52:02,975: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ee0223e-ffe3-4c40-9b76-d82e0520aa5a] succeeded in 2.6417777229999047s: None 2024-05-25T22:52:03.498908183Z [2024-05-25 22:52:03,498: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T22:52:03.508347594Z [2024-05-25 22:52:03,507: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:52:03.565748396Z [2024-05-25 22:52:03,565: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T22:52:03.567081879Z [2024-05-25 22:52:03,566: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:52:03.567437437Z [2024-05-25 22:52:03,567: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:52:03.571999673Z [2024-05-25 22:52:03,571: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:52:03.572168547Z [2024-05-25 22:52:03,571: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T22:52:03.572521060Z [2024-05-25 22:52:03,572: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:52:03.572672787Z [2024-05-25 22:52:03,572: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:52:03.602839961Z [2024-05-25 22:52:03,595: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:52:03.606308392Z [2024-05-25 22:52:03,605: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:52:03.716681226Z [2024-05-25 22:52:03,716: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:52:03.721301244Z [2024-05-25 22:52:03,721: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:52:03.729856656Z [2024-05-25 22:52:03,727: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:52:03.729891263Z [2024-05-25 22:52:03,727: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:52:03.729895500Z [2024-05-25 22:52:03,727: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:52:03.729898749Z [2024-05-25 22:52:03,728: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:52:03.729901575Z [2024-05-25 22:52:03,728: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:52:03.834453189Z [2024-05-25 22:52:03,834: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:52:03.929347088Z [2024-05-25 22:52:03,929: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:52:06.497599860Z [2024-05-25 22:52:06,496: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6e556d0e-a892-41f4-8bb9-5c66d883d718] succeeded in 6.1319317069999215s: None 2024-05-25T22:52:06.840613281Z [2024-05-25 22:52:06,840: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b41962af-fde3-499e-b27a-d4dad659e026] succeeded in 6.462045603000206s: None 2024-05-25T22:53:00.692126565Z [2024-05-25 22:53:00,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d321e3a-dc80-46d5-9db6-3f64d300122e] received 2024-05-25T22:53:00.697315975Z [2024-05-25 22:53:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0de029fe-9035-4823-b486-69715c023a8a] received 2024-05-25T22:53:00.723654634Z [2024-05-25 22:53:00,721: INFO/ForkPoolWorker-15] [9d321e3a-dc80-46d5-9db6-3f64d300122e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:53:00.727673229Z [2024-05-25 22:53:00,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[990d9a5c-c4e2-4282-abfe-07e5ececb41f] received 2024-05-25T22:53:00.727687791Z [2024-05-25 22:53:00,726: INFO/ForkPoolWorker-16] [0de029fe-9035-4823-b486-69715c023a8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:53:00.766942207Z [2024-05-25 22:53:00,758: INFO/ForkPoolWorker-1] [990d9a5c-c4e2-4282-abfe-07e5ececb41f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:53:01.342644135Z [2024-05-25 22:53:01,328: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:53:01.355887892Z [2024-05-25 22:53:01,351: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:53:01.404883873Z [2024-05-25 22:53:01,365: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:53:01.685060510Z [2024-05-25 22:53:01,684: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T22:53:01.697816848Z [2024-05-25 22:53:01,697: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:53:01.774642623Z [2024-05-25 22:53:01,774: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:53:01.777525994Z [2024-05-25 22:53:01,777: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:53:01.777727300Z [2024-05-25 22:53:01,777: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:53:01.777843857Z [2024-05-25 22:53:01,777: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T22:53:01.778075495Z [2024-05-25 22:53:01,777: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:53:01.981218904Z [2024-05-25 22:53:01,980: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:53:02.833200036Z [2024-05-25 22:53:02,832: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[990d9a5c-c4e2-4282-abfe-07e5ececb41f] succeeded in 2.0890024150000954s: None 2024-05-25T22:53:03.385115253Z [2024-05-25 22:53:03,384: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:53:03.388839648Z [2024-05-25 22:53:03,388: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:53:03.459990954Z [2024-05-25 22:53:03,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:53:03.463450063Z [2024-05-25 22:53:03,463: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:53:03.464083341Z [2024-05-25 22:53:03,463: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:53:03.465825551Z [2024-05-25 22:53:03,464: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:53:03.466067415Z [2024-05-25 22:53:03,465: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:53:03.466183128Z [2024-05-25 22:53:03,466: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:53:03.466476873Z [2024-05-25 22:53:03,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:53:03.467638540Z [2024-05-25 22:53:03,466: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:53:03.468272957Z [2024-05-25 22:53:03,467: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:53:03.505816695Z [2024-05-25 22:53:03,505: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:53:03.509999583Z [2024-05-25 22:53:03,509: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:53:03.511607415Z [2024-05-25 22:53:03,511: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:53:03.512651421Z [2024-05-25 22:53:03,512: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:53:03.512760184Z [2024-05-25 22:53:03,512: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:53:03.519747377Z [2024-05-25 22:53:03,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:53:03.519849153Z [2024-05-25 22:53:03,519: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:53:03.584433379Z [2024-05-25 22:53:03,584: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:53:03.653556523Z [2024-05-25 22:53:03,653: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:53:05.788131313Z [2024-05-25 22:53:05,787: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0de029fe-9035-4823-b486-69715c023a8a] succeeded in 5.084023432999857s: None 2024-05-25T22:53:05.958961694Z [2024-05-25 22:53:05,958: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d321e3a-dc80-46d5-9db6-3f64d300122e] succeeded in 5.264388899000096s: None 2024-05-25T22:54:00.611667039Z [2024-05-25 22:54:00,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd8f0bd0-aaf6-4851-8e88-2ed1c47a4e07] received 2024-05-25T22:54:00.615728917Z [2024-05-25 22:54:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a076bd5e-9bef-4bff-b203-6ee22d8cb9ff] received 2024-05-25T22:54:00.620672511Z [2024-05-25 22:54:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f800a1cf-644c-47bc-b48f-863991dfef8c] received 2024-05-25T22:54:00.628471999Z [2024-05-25 22:54:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[866627d3-59d4-49c1-901f-4a91b77dc460] received 2024-05-25T22:54:00.630699619Z [2024-05-25 22:54:00,630: INFO/ForkPoolWorker-16] [a076bd5e-9bef-4bff-b203-6ee22d8cb9ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:54:00.634932895Z [2024-05-25 22:54:00,634: INFO/ForkPoolWorker-15] [bd8f0bd0-aaf6-4851-8e88-2ed1c47a4e07] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:54:00.636140131Z [2024-05-25 22:54:00,635: INFO/ForkPoolWorker-1] [f800a1cf-644c-47bc-b48f-863991dfef8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:54:00.651593291Z [2024-05-25 22:54:00,651: INFO/ForkPoolWorker-2] [866627d3-59d4-49c1-901f-4a91b77dc460] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:54:00.982365130Z [2024-05-25 22:54:00,978: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:54:00.993391996Z [2024-05-25 22:54:00,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:54:01.018635298Z [2024-05-25 22:54:01,015: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:54:01.158711499Z [2024-05-25 22:54:01,154: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:54:01.202589259Z [2024-05-25 22:54:01,202: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T22:54:01.208350731Z [2024-05-25 22:54:01,207: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:54:01.248267982Z [2024-05-25 22:54:01,248: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:54:01.250088909Z [2024-05-25 22:54:01,249: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:54:01.250296249Z [2024-05-25 22:54:01,250: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:54:01.250663174Z [2024-05-25 22:54:01,250: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T22:54:01.250927671Z [2024-05-25 22:54:01,250: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:54:01.365463136Z [2024-05-25 22:54:01,365: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:54:01.404017534Z [2024-05-25 22:54:01,403: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:54:01.891004335Z [2024-05-25 22:54:01,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a076bd5e-9bef-4bff-b203-6ee22d8cb9ff] succeeded in 1.2720956620000834s: None 2024-05-25T22:54:02.010656999Z [2024-05-25 22:54:02,010: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd8f0bd0-aaf6-4851-8e88-2ed1c47a4e07] succeeded in 1.3929537630001505s: None 2024-05-25T22:54:02.415315073Z [2024-05-25 22:54:02,414: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:54:02.418672698Z [2024-05-25 22:54:02,418: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:54:02.444129139Z [2024-05-25 22:54:02,443: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:54:02.446012629Z [2024-05-25 22:54:02,445: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:54:02.446168359Z [2024-05-25 22:54:02,446: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:54:02.446457275Z [2024-05-25 22:54:02,446: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:54:02.446566006Z [2024-05-25 22:54:02,446: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:54:02.446849163Z [2024-05-25 22:54:02,446: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:54:02.446948065Z [2024-05-25 22:54:02,446: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:54:02.529451614Z [2024-05-25 22:54:02,529: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:54:02.530539760Z [2024-05-25 22:54:02,530: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T22:54:02.533904675Z [2024-05-25 22:54:02,533: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:54:02.553577853Z [2024-05-25 22:54:02,553: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T22:54:02.554760575Z [2024-05-25 22:54:02,554: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:54:02.554775891Z [2024-05-25 22:54:02,554: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:54:02.554970075Z [2024-05-25 22:54:02,554: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:54:02.554985926Z [2024-05-25 22:54:02,554: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T22:54:02.555187790Z [2024-05-25 22:54:02,555: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:54:02.555239376Z [2024-05-25 22:54:02,555: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:54:02.650704629Z [2024-05-25 22:54:02,650: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:54:04.342566207Z [2024-05-25 22:54:04,342: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[866627d3-59d4-49c1-901f-4a91b77dc460] succeeded in 3.7061713220000456s: None 2024-05-25T22:54:04.369529633Z [2024-05-25 22:54:04,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f800a1cf-644c-47bc-b48f-863991dfef8c] succeeded in 3.7440517320001163s: None 2024-05-25T22:55:00.681388011Z [2024-05-25 22:55:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85ed7f97-bc38-4678-928b-0a4850ca1aaa] received 2024-05-25T22:55:00.683727337Z [2024-05-25 22:55:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9eccb98c-7c67-4326-9547-af17a2201003] received 2024-05-25T22:55:00.689377965Z [2024-05-25 22:55:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b7bb584-3123-40a7-8597-4d5ca26d5ad1] received 2024-05-25T22:55:00.695639255Z [2024-05-25 22:55:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23c4ac8e-f8bc-4173-84e4-59a2a59188f7] received 2024-05-25T22:55:00.705954568Z [2024-05-25 22:55:00,705: INFO/ForkPoolWorker-16] [9eccb98c-7c67-4326-9547-af17a2201003] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:55:00.709843569Z [2024-05-25 22:55:00,709: INFO/ForkPoolWorker-15] [85ed7f97-bc38-4678-928b-0a4850ca1aaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:55:00.711919212Z [2024-05-25 22:55:00,711: INFO/ForkPoolWorker-2] [23c4ac8e-f8bc-4173-84e4-59a2a59188f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:55:00.720531604Z [2024-05-25 22:55:00,719: INFO/ForkPoolWorker-1] [9b7bb584-3123-40a7-8597-4d5ca26d5ad1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:55:01.102752176Z [2024-05-25 22:55:01,097: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:55:01.106145415Z [2024-05-25 22:55:01,101: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:55:01.137449353Z [2024-05-25 22:55:01,133: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:55:01.153639859Z [2024-05-25 22:55:01,144: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:55:01.317577929Z [2024-05-25 22:55:01,317: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T22:55:01.323746821Z [2024-05-25 22:55:01,323: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:55:01.368611198Z [2024-05-25 22:55:01,368: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:55:01.369810932Z [2024-05-25 22:55:01,369: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:55:01.370047304Z [2024-05-25 22:55:01,369: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:55:01.370208379Z [2024-05-25 22:55:01,370: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T22:55:01.370556722Z [2024-05-25 22:55:01,370: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:55:01.477382403Z [2024-05-25 22:55:01,477: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:55:02.163863760Z [2024-05-25 22:55:02,163: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9b7bb584-3123-40a7-8597-4d5ca26d5ad1] succeeded in 1.468874976000052s: None 2024-05-25T22:55:02.571020765Z [2024-05-25 22:55:02,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:55:02.574429347Z [2024-05-25 22:55:02,573: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:55:02.598988654Z [2024-05-25 22:55:02,598: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:55:02.600634683Z [2024-05-25 22:55:02,600: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:55:02.600821927Z [2024-05-25 22:55:02,600: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:55:02.600845209Z [2024-05-25 22:55:02,600: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:55:02.600853700Z [2024-05-25 22:55:02,600: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:55:02.601045945Z [2024-05-25 22:55:02,600: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:55:02.601083448Z [2024-05-25 22:55:02,600: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:55:02.642434439Z [2024-05-25 22:55:02,641: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:55:02.647041811Z [2024-05-25 22:55:02,646: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:55:02.678726063Z [2024-05-25 22:55:02,678: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:55:02.690917189Z [2024-05-25 22:55:02,690: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T22:55:02.692049288Z [2024-05-25 22:55:02,691: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:55:02.695287563Z [2024-05-25 22:55:02,694: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:55:02.696880527Z [2024-05-25 22:55:02,696: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:55:02.696981457Z [2024-05-25 22:55:02,696: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:55:02.697038891Z [2024-05-25 22:55:02,696: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:55:02.697049029Z [2024-05-25 22:55:02,696: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:55:02.697284548Z [2024-05-25 22:55:02,697: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:55:02.697327788Z [2024-05-25 22:55:02,697: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:55:02.729956520Z [2024-05-25 22:55:02,729: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T22:55:02.732599360Z [2024-05-25 22:55:02,732: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:55:02.732918919Z [2024-05-25 22:55:02,732: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:55:02.733647821Z [2024-05-25 22:55:02,733: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:55:02.734008280Z [2024-05-25 22:55:02,733: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T22:55:02.734498785Z [2024-05-25 22:55:02,734: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:55:02.734720268Z [2024-05-25 22:55:02,734: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:55:02.831499315Z [2024-05-25 22:55:02,831: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:55:02.847868266Z [2024-05-25 22:55:02,847: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:55:03.525327441Z [2024-05-25 22:55:03,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afa325dc-6f5f-4e68-aed1-812fda65ab37] received 2024-05-25T22:55:03.563699218Z [2024-05-25 22:55:03,563: INFO/ForkPoolWorker-1] [afa325dc-6f5f-4e68-aed1-812fda65ab37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:55:03.616712795Z [2024-05-25 22:55:03,616: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9eccb98c-7c67-4326-9547-af17a2201003] succeeded in 2.9279694000001655s: None 2024-05-25T22:55:03.911300663Z [2024-05-25 22:55:03,907: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:55:04.674444727Z [2024-05-25 22:55:04,673: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85ed7f97-bc38-4678-928b-0a4850ca1aaa] succeeded in 3.987794549s: None 2024-05-25T22:55:05.324202595Z [2024-05-25 22:55:05,323: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:55:05.327620594Z [2024-05-25 22:55:05,327: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:55:05.357101533Z [2024-05-25 22:55:05,356: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:55:05.360046458Z [2024-05-25 22:55:05,358: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:55:05.360061373Z [2024-05-25 22:55:05,358: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:55:05.360066711Z [2024-05-25 22:55:05,359: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:55:05.360071832Z [2024-05-25 22:55:05,359: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:55:05.360075672Z [2024-05-25 22:55:05,359: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:55:05.360080205Z [2024-05-25 22:55:05,359: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:55:05.502489437Z [2024-05-25 22:55:05,502: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:55:05.850121143Z [2024-05-25 22:55:05,849: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[23c4ac8e-f8bc-4173-84e4-59a2a59188f7] succeeded in 5.151832089999971s: None 2024-05-25T22:55:06.221233987Z [2024-05-25 22:55:06,220: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[afa325dc-6f5f-4e68-aed1-812fda65ab37] succeeded in 2.6877532230000725s: None 2024-05-25T22:55:07.135129091Z [2024-05-25 22:55:07,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[046b0afc-2b48-4861-a12f-30edcd8257c6] received 2024-05-25T22:55:07.147491438Z [2024-05-25 22:55:07,147: INFO/ForkPoolWorker-15] [046b0afc-2b48-4861-a12f-30edcd8257c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:55:07.432371172Z [2024-05-25 22:55:07,428: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:55:08.573263419Z [2024-05-25 22:55:08,572: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:55:08.576605556Z [2024-05-25 22:55:08,575: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:55:08.600782679Z [2024-05-25 22:55:08,600: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:55:08.605326241Z [2024-05-25 22:55:08,604: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:55:08.605703948Z [2024-05-25 22:55:08,605: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:55:08.606117960Z [2024-05-25 22:55:08,605: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:55:08.606406617Z [2024-05-25 22:55:08,606: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:55:08.607947587Z [2024-05-25 22:55:08,607: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:55:08.608552354Z [2024-05-25 22:55:08,608: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:55:08.708673012Z [2024-05-25 22:55:08,708: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:55:09.464220216Z [2024-05-25 22:55:09,463: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[046b0afc-2b48-4861-a12f-30edcd8257c6] succeeded in 2.322886599999947s: None 2024-05-25T22:55:09.658815754Z [2024-05-25 22:55:09,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f1bdd1f-363f-4b29-ba31-5504c4325388] received 2024-05-25T22:55:09.670993487Z [2024-05-25 22:55:09,670: INFO/ForkPoolWorker-15] [6f1bdd1f-363f-4b29-ba31-5504c4325388] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:55:09.958447292Z [2024-05-25 22:55:09,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T22:55:11.023019523Z [2024-05-25 22:55:11,022: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:55:11.026217217Z [2024-05-25 22:55:11,025: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:55:11.051475492Z [2024-05-25 22:55:11,051: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:55:11.053239011Z [2024-05-25 22:55:11,052: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:55:11.053383981Z [2024-05-25 22:55:11,053: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:55:11.053693973Z [2024-05-25 22:55:11,053: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:55:11.053883345Z [2024-05-25 22:55:11,053: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:55:11.054246957Z [2024-05-25 22:55:11,054: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T22:55:11.054378136Z [2024-05-25 22:55:11,054: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:55:11.165804766Z [2024-05-25 22:55:11,165: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:55:11.752319944Z [2024-05-25 22:55:11,751: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f1bdd1f-363f-4b29-ba31-5504c4325388] succeeded in 2.0888027819999024s: None 2024-05-25T22:56:00.587047435Z [2024-05-25 22:56:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[738f01bd-03be-46bb-a6e6-83adef71da9d] received 2024-05-25T22:56:00.591428656Z [2024-05-25 22:56:00,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[539f7246-ea85-4bd2-8a05-b0da4ae03d08] received 2024-05-25T22:56:00.595843046Z [2024-05-25 22:56:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07506316-6bbd-4aae-9196-fd2a20fa16d8] received 2024-05-25T22:56:00.600204868Z [2024-05-25 22:56:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cccac641-6e84-4f64-8297-031d3949f50e] received 2024-05-25T22:56:00.604843226Z [2024-05-25 22:56:00,604: INFO/ForkPoolWorker-15] [738f01bd-03be-46bb-a6e6-83adef71da9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:56:00.607863311Z [2024-05-25 22:56:00,607: INFO/ForkPoolWorker-1] [07506316-6bbd-4aae-9196-fd2a20fa16d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:56:00.616690136Z [2024-05-25 22:56:00,616: INFO/ForkPoolWorker-16] [539f7246-ea85-4bd2-8a05-b0da4ae03d08] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:56:00.617502059Z [2024-05-25 22:56:00,617: INFO/ForkPoolWorker-2] [cccac641-6e84-4f64-8297-031d3949f50e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:56:01.051500235Z [2024-05-25 22:56:01,046: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:56:01.130935233Z [2024-05-25 22:56:01,127: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:56:01.142506288Z [2024-05-25 22:56:01,122: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:56:01.142533785Z [2024-05-25 22:56:01,139: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:56:01.313195317Z [2024-05-25 22:56:01,312: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T22:56:01.318983808Z [2024-05-25 22:56:01,318: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:56:01.365186896Z [2024-05-25 22:56:01,364: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T22:56:01.366313574Z [2024-05-25 22:56:01,366: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:56:01.366529550Z [2024-05-25 22:56:01,366: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:56:01.366692352Z [2024-05-25 22:56:01,366: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T22:56:01.367089967Z [2024-05-25 22:56:01,366: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:56:01.478337060Z [2024-05-25 22:56:01,478: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:56:01.573384220Z [2024-05-25 22:56:01,572: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:56:02.185389350Z [2024-05-25 22:56:02,184: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cccac641-6e84-4f64-8297-031d3949f50e] succeeded in 1.5818574610000269s: None 2024-05-25T22:56:02.228753456Z [2024-05-25 22:56:02,228: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[539f7246-ea85-4bd2-8a05-b0da4ae03d08] succeeded in 1.6336126880000847s: None 2024-05-25T22:56:02.533956900Z [2024-05-25 22:56:02,533: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:56:02.537219331Z [2024-05-25 22:56:02,536: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:56:02.566795522Z [2024-05-25 22:56:02,566: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:56:02.567821446Z [2024-05-25 22:56:02,567: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:56:02.567835467Z [2024-05-25 22:56:02,567: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:56:02.567968201Z [2024-05-25 22:56:02,567: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:56:02.568007999Z [2024-05-25 22:56:02,567: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:56:02.568327025Z [2024-05-25 22:56:02,568: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:56:02.568401907Z [2024-05-25 22:56:02,568: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:56:02.591777910Z [2024-05-25 22:56:02,591: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:56:02.595033046Z [2024-05-25 22:56:02,594: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:56:02.625898285Z [2024-05-25 22:56:02,625: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:56:02.628198277Z [2024-05-25 22:56:02,627: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:56:02.628547787Z [2024-05-25 22:56:02,628: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:56:02.628996453Z [2024-05-25 22:56:02,628: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:56:02.629175490Z [2024-05-25 22:56:02,628: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:56:02.630127766Z [2024-05-25 22:56:02,629: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:56:02.630336366Z [2024-05-25 22:56:02,630: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:56:02.661095593Z [2024-05-25 22:56:02,660: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:56:02.773644478Z [2024-05-25 22:56:02,773: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:56:04.769680548Z [2024-05-25 22:56:04,769: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[738f01bd-03be-46bb-a6e6-83adef71da9d] succeeded in 4.178147091000028s: None 2024-05-25T22:56:05.782553214Z [2024-05-25 22:56:05,782: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07506316-6bbd-4aae-9196-fd2a20fa16d8] succeeded in 5.184684687999834s: None 2024-05-25T22:57:01.157349954Z [2024-05-25 22:57:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb5de184-e5f8-4bd9-97e2-4189584e443c] received 2024-05-25T22:57:01.168746937Z [2024-05-25 22:57:01,168: INFO/ForkPoolWorker-15] [fb5de184-e5f8-4bd9-97e2-4189584e443c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:57:01.176162106Z [2024-05-25 22:57:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d97aaed-92e6-413e-9d67-6ab3be43dc22] received 2024-05-25T22:57:01.187230526Z [2024-05-25 22:57:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3b66368-e113-4b77-8dfd-467804520efa] received 2024-05-25T22:57:01.199639877Z [2024-05-25 22:57:01,199: INFO/ForkPoolWorker-16] [0d97aaed-92e6-413e-9d67-6ab3be43dc22] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:57:01.205328000Z [2024-05-25 22:57:01,204: INFO/ForkPoolWorker-1] [d3b66368-e113-4b77-8dfd-467804520efa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:57:01.635063837Z [2024-05-25 22:57:01,631: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:57:01.810770684Z [2024-05-25 22:57:01,806: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:57:01.818349724Z [2024-05-25 22:57:01,817: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T22:57:01.823179757Z [2024-05-25 22:57:01,822: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:57:01.871625838Z [2024-05-25 22:57:01,858: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:57:01.879675500Z [2024-05-25 22:57:01,879: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:57:01.880752927Z [2024-05-25 22:57:01,880: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:57:01.880773336Z [2024-05-25 22:57:01,880: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:57:01.880862604Z [2024-05-25 22:57:01,880: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T22:57:01.881023722Z [2024-05-25 22:57:01,880: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:57:02.159379070Z [2024-05-25 22:57:02,159: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:57:03.186517427Z [2024-05-25 22:57:03,179: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0d97aaed-92e6-413e-9d67-6ab3be43dc22] succeeded in 2.0016573720001816s: None 2024-05-25T22:57:03.821221307Z [2024-05-25 22:57:03,820: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T22:57:03.824262530Z [2024-05-25 22:57:03,823: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:57:03.865959681Z [2024-05-25 22:57:03,865: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:57:03.867502291Z [2024-05-25 22:57:03,867: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:57:03.867580734Z [2024-05-25 22:57:03,867: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:57:03.867776463Z [2024-05-25 22:57:03,867: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:57:03.871178205Z [2024-05-25 22:57:03,867: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T22:57:03.871191318Z [2024-05-25 22:57:03,867: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:57:03.871195021Z [2024-05-25 22:57:03,868: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:57:03.973806417Z [2024-05-25 22:57:03,973: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:57:04.230870302Z [2024-05-25 22:57:04,230: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:57:04.234451260Z [2024-05-25 22:57:04,234: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:57:04.281712494Z [2024-05-25 22:57:04,281: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:57:04.289472926Z [2024-05-25 22:57:04,289: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:57:04.289582587Z [2024-05-25 22:57:04,289: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:57:04.289775253Z [2024-05-25 22:57:04,289: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:57:04.289945627Z [2024-05-25 22:57:04,289: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:57:04.290883154Z [2024-05-25 22:57:04,290: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:57:04.291035715Z [2024-05-25 22:57:04,290: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:57:04.423041612Z [2024-05-25 22:57:04,422: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:57:06.906255868Z [2024-05-25 22:57:06,905: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb5de184-e5f8-4bd9-97e2-4189584e443c] succeeded in 5.744732784000007s: None 2024-05-25T22:57:07.282334204Z [2024-05-25 22:57:07,281: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3b66368-e113-4b77-8dfd-467804520efa] succeeded in 6.092362732000083s: None 2024-05-25T22:58:00.479670503Z [2024-05-25 22:58:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efad520e-388d-4687-b148-061b5ef73c83] received 2024-05-25T22:58:00.481576063Z [2024-05-25 22:58:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec10089a-a716-4895-ba45-9ea1099c4ee1] received 2024-05-25T22:58:00.488447986Z [2024-05-25 22:58:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ab26837-3d82-47d1-84db-d7282af59090] received 2024-05-25T22:58:00.490569620Z [2024-05-25 22:58:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b519761c-6c2f-48ef-896d-3dc9b759429d] received 2024-05-25T22:58:00.499260590Z [2024-05-25 22:58:00,498: INFO/ForkPoolWorker-16] [ec10089a-a716-4895-ba45-9ea1099c4ee1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:58:00.499746225Z [2024-05-25 22:58:00,499: INFO/ForkPoolWorker-15] [efad520e-388d-4687-b148-061b5ef73c83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:58:00.509547342Z [2024-05-25 22:58:00,509: INFO/ForkPoolWorker-1] [7ab26837-3d82-47d1-84db-d7282af59090] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:58:00.512033495Z [2024-05-25 22:58:00,511: INFO/ForkPoolWorker-2] [b519761c-6c2f-48ef-896d-3dc9b759429d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:58:00.825268841Z [2024-05-25 22:58:00,821: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:58:00.939246900Z [2024-05-25 22:58:00,932: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:58:00.996089197Z [2024-05-25 22:58:00,995: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T22:58:01.000073401Z [2024-05-25 22:58:00,999: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:58:01.042615736Z [2024-05-25 22:58:01,042: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:58:01.047074395Z [2024-05-25 22:58:01,046: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:58:01.047098973Z [2024-05-25 22:58:01,046: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:58:01.047148635Z [2024-05-25 22:58:01,047: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T22:58:01.047405924Z [2024-05-25 22:58:01,047: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:58:01.098975713Z [2024-05-25 22:58:01,094: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T22:58:01.228641365Z [2024-05-25 22:58:01,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:58:01.443372825Z [2024-05-25 22:58:01,443: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:58:01.516660524Z [2024-05-25 22:58:01,479: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:58:02.482900053Z [2024-05-25 22:58:02,482: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ab26837-3d82-47d1-84db-d7282af59090] succeeded in 1.9887777440001173s: None 2024-05-25T22:58:02.556576870Z [2024-05-25 22:58:02,556: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec10089a-a716-4895-ba45-9ea1099c4ee1] succeeded in 2.0715138759999263s: None 2024-05-25T22:58:03.219951641Z [2024-05-25 22:58:03,217: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:58:03.228002716Z [2024-05-25 22:58:03,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:58:03.245961231Z [2024-05-25 22:58:03,245: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:58:03.247214457Z [2024-05-25 22:58:03,246: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:58:03.247404196Z [2024-05-25 22:58:03,247: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:58:03.247658346Z [2024-05-25 22:58:03,247: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:58:03.247749156Z [2024-05-25 22:58:03,247: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:58:03.248646224Z [2024-05-25 22:58:03,248: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:58:03.249262278Z [2024-05-25 22:58:03,249: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:58:03.342253875Z [2024-05-25 22:58:03,342: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:58:03.446483759Z [2024-05-25 22:58:03,446: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T22:58:03.449668377Z [2024-05-25 22:58:03,449: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:58:03.474771374Z [2024-05-25 22:58:03,474: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T22:58:03.476183015Z [2024-05-25 22:58:03,475: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:58:03.476358685Z [2024-05-25 22:58:03,476: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:58:03.476584244Z [2024-05-25 22:58:03,476: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:58:03.476714598Z [2024-05-25 22:58:03,476: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T22:58:03.477002515Z [2024-05-25 22:58:03,476: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:58:03.477138091Z [2024-05-25 22:58:03,477: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:58:03.568941568Z [2024-05-25 22:58:03,568: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:58:05.215669274Z [2024-05-25 22:58:05,215: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b519761c-6c2f-48ef-896d-3dc9b759429d] succeeded in 4.721526623000045s: None 2024-05-25T22:58:05.291090296Z [2024-05-25 22:58:05,290: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[efad520e-388d-4687-b148-061b5ef73c83] succeeded in 4.809102313000039s: None 2024-05-25T22:59:00.867079014Z [2024-05-25 22:59:00,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[651bc8e9-ac52-422d-a23e-6c7dea6187c5] received 2024-05-25T22:59:00.875843361Z [2024-05-25 22:59:00,874: INFO/ForkPoolWorker-15] [651bc8e9-ac52-422d-a23e-6c7dea6187c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:59:00.877395913Z [2024-05-25 22:59:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d27deea5-83f9-4197-8e18-cd3f5226ccb1] received 2024-05-25T22:59:00.886143232Z [2024-05-25 22:59:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d228e024-b620-4a55-8082-6200a21d7862] received 2024-05-25T22:59:00.906706152Z [2024-05-25 22:59:00,904: INFO/ForkPoolWorker-16] [d27deea5-83f9-4197-8e18-cd3f5226ccb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:59:00.907371518Z [2024-05-25 22:59:00,907: INFO/ForkPoolWorker-1] [d228e024-b620-4a55-8082-6200a21d7862] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:59:01.304347871Z [2024-05-25 22:59:01,300: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T22:59:01.315929177Z [2024-05-25 22:59:01,312: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T22:59:01.378916779Z [2024-05-25 22:59:01,374: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T22:59:01.557305034Z [2024-05-25 22:59:01,556: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T22:59:01.561156637Z [2024-05-25 22:59:01,560: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:59:01.588830932Z [2024-05-25 22:59:01,588: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T22:59:01.590933745Z [2024-05-25 22:59:01,590: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T22:59:01.590993930Z [2024-05-25 22:59:01,590: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T22:59:01.591061481Z [2024-05-25 22:59:01,590: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T22:59:01.591229201Z [2024-05-25 22:59:01,591: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T22:59:01.685372852Z [2024-05-25 22:59:01,685: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:59:02.502042097Z [2024-05-25 22:59:02,501: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d228e024-b620-4a55-8082-6200a21d7862] succeeded in 1.6099647999999434s: None 2024-05-25T22:59:02.697665668Z [2024-05-25 22:59:02,697: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T22:59:02.701478905Z [2024-05-25 22:59:02,701: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:59:02.730244653Z [2024-05-25 22:59:02,730: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T22:59:02.732116723Z [2024-05-25 22:59:02,731: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:59:02.732130889Z [2024-05-25 22:59:02,732: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:59:02.732221736Z [2024-05-25 22:59:02,732: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:59:02.732243256Z [2024-05-25 22:59:02,732: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T22:59:02.735726591Z [2024-05-25 22:59:02,732: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T22:59:02.735757056Z [2024-05-25 22:59:02,735: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:59:02.803135346Z [2024-05-25 22:59:02,802: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T22:59:02.806613822Z [2024-05-25 22:59:02,806: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T22:59:02.833213738Z [2024-05-25 22:59:02,832: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:59:02.840886778Z [2024-05-25 22:59:02,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T22:59:02.845950499Z [2024-05-25 22:59:02,845: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T22:59:02.845965823Z [2024-05-25 22:59:02,845: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T22:59:02.846044861Z [2024-05-25 22:59:02,845: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T22:59:02.846127241Z [2024-05-25 22:59:02,846: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T22:59:02.846657166Z [2024-05-25 22:59:02,846: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T22:59:02.846665738Z [2024-05-25 22:59:02,846: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T22:59:02.938771516Z [2024-05-25 22:59:02,938: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T22:59:04.840881604Z [2024-05-25 22:59:04,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[651bc8e9-ac52-422d-a23e-6c7dea6187c5] succeeded in 3.972997892999956s: None 2024-05-25T22:59:04.982662592Z [2024-05-25 22:59:04,982: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d27deea5-83f9-4197-8e18-cd3f5226ccb1] succeeded in 4.099554160000025s: None 2024-05-25T23:00:01.386716487Z [2024-05-25 23:00:01,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60c8febb-f6f9-4a07-9abb-9cd85e1d9461] received 2024-05-25T23:00:01.393859675Z [2024-05-25 23:00:01,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0f44b31-caf1-4a46-a05f-aa0ecab09382] received 2024-05-25T23:00:01.396797375Z [2024-05-25 23:00:01,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5493dd6-2917-455e-a41f-45c3f717f9b5] received 2024-05-25T23:00:01.404308409Z [2024-05-25 23:00:01,404: INFO/ForkPoolWorker-15] [60c8febb-f6f9-4a07-9abb-9cd85e1d9461] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:00:01.405140840Z [2024-05-25 23:00:01,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31c00998-2f7d-45d9-bc2a-399a9eff2bf8] received 2024-05-25T23:00:01.414693061Z [2024-05-25 23:00:01,414: INFO/ForkPoolWorker-16] [b0f44b31-caf1-4a46-a05f-aa0ecab09382] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:00:01.414856675Z [2024-05-25 23:00:01,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f2a1197-2977-48d3-9c67-5fea87c31b99] received 2024-05-25T23:00:01.418584666Z [2024-05-25 23:00:01,418: INFO/ForkPoolWorker-2] [31c00998-2f7d-45d9-bc2a-399a9eff2bf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:00:01.430043359Z [2024-05-25 23:00:01,429: INFO/ForkPoolWorker-1] [b5493dd6-2917-455e-a41f-45c3f717f9b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:00:01.435612596Z [2024-05-25 23:00:01,435: INFO/ForkPoolWorker-3] [6f2a1197-2977-48d3-9c67-5fea87c31b99] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:00:01.855722089Z [2024-05-25 23:00:01,851: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:00:01.895335803Z [2024-05-25 23:00:01,892: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:00:01.975902307Z [2024-05-25 23:00:01,962: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:00:02.049878534Z [2024-05-25 23:00:02,040: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:00:02.095097656Z [2024-05-25 23:00:02,083: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:00:02.353026126Z [2024-05-25 23:00:02,352: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:00:02.361707185Z [2024-05-25 23:00:02,361: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:00:02.415396985Z [2024-05-25 23:00:02,415: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:00:02.420386187Z [2024-05-25 23:00:02,420: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:00:02.420412455Z [2024-05-25 23:00:02,420: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:00:02.420462198Z [2024-05-25 23:00:02,420: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:00:02.420759845Z [2024-05-25 23:00:02,420: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:00:02.494533194Z [2024-05-25 23:00:02,494: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:00:02.582119922Z [2024-05-25 23:00:02,581: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:00:03.367922561Z [2024-05-25 23:00:03,367: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[31c00998-2f7d-45d9-bc2a-399a9eff2bf8] succeeded in 1.9605700150000303s: None 2024-05-25T23:00:03.596867248Z [2024-05-25 23:00:03,596: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6f2a1197-2977-48d3-9c67-5fea87c31b99] succeeded in 2.178943689999869s: None 2024-05-25T23:00:03.968944094Z [2024-05-25 23:00:03,968: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:00:03.972412973Z [2024-05-25 23:00:03,972: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:00:03.988665123Z [2024-05-25 23:00:03,988: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:00:03.993392403Z [2024-05-25 23:00:03,992: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:00:04.012093391Z [2024-05-25 23:00:04,011: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:00:04.012365972Z [2024-05-25 23:00:04,011: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:00:04.015926038Z [2024-05-25 23:00:04,015: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:00:04.016485994Z [2024-05-25 23:00:04,016: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:00:04.016739018Z [2024-05-25 23:00:04,016: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:00:04.019761151Z [2024-05-25 23:00:04,016: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:00:04.019775378Z [2024-05-25 23:00:04,019: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:00:04.019935720Z [2024-05-25 23:00:04,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:00:04.019966979Z [2024-05-25 23:00:04,019: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:00:04.064782318Z [2024-05-25 23:00:04,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:00:04.068061523Z [2024-05-25 23:00:04,067: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:00:04.068208624Z [2024-05-25 23:00:04,068: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:00:04.068463945Z [2024-05-25 23:00:04,068: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:00:04.068707866Z [2024-05-25 23:00:04,068: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:00:04.069813658Z [2024-05-25 23:00:04,069: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:00:04.069948468Z [2024-05-25 23:00:04,069: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:00:04.089801565Z [2024-05-25 23:00:04,089: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:00:04.092387002Z [2024-05-25 23:00:04,092: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:00:04.092569286Z [2024-05-25 23:00:04,092: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:00:04.092764756Z [2024-05-25 23:00:04,092: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:00:04.092880487Z [2024-05-25 23:00:04,092: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:00:04.093161540Z [2024-05-25 23:00:04,093: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:00:04.093284824Z [2024-05-25 23:00:04,093: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:00:04.212031988Z [2024-05-25 23:00:04,211: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:00:04.227201902Z [2024-05-25 23:00:04,226: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:00:04.245976831Z [2024-05-25 23:00:04,245: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:00:05.188201678Z [2024-05-25 23:00:05,187: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b5493dd6-2917-455e-a41f-45c3f717f9b5] succeeded in 3.787667690999797s: None 2024-05-25T23:00:05.204329775Z [2024-05-25 23:00:05,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29e03def-6eef-4940-b88b-5ff3b4d6ea29] received 2024-05-25T23:00:05.228338964Z [2024-05-25 23:00:05,228: INFO/ForkPoolWorker-1] [29e03def-6eef-4940-b88b-5ff3b4d6ea29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:00:05.643936690Z [2024-05-25 23:00:05,631: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:00:06.202301951Z [2024-05-25 23:00:06,201: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60c8febb-f6f9-4a07-9abb-9cd85e1d9461] succeeded in 4.81142266300003s: None 2024-05-25T23:00:07.275039245Z [2024-05-25 23:00:07,274: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:00:07.278094094Z [2024-05-25 23:00:07,277: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:00:07.324225280Z [2024-05-25 23:00:07,323: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:00:07.329994517Z [2024-05-25 23:00:07,329: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:00:07.330030599Z [2024-05-25 23:00:07,329: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:00:07.330048802Z [2024-05-25 23:00:07,329: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:00:07.330076242Z [2024-05-25 23:00:07,329: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:00:07.330457350Z [2024-05-25 23:00:07,330: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:00:07.330475267Z [2024-05-25 23:00:07,330: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:00:07.452947738Z [2024-05-25 23:00:07,452: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:00:07.913623370Z [2024-05-25 23:00:07,912: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0f44b31-caf1-4a46-a05f-aa0ecab09382] succeeded in 6.516349011999864s: None 2024-05-25T23:00:08.177276641Z [2024-05-25 23:00:08,176: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29e03def-6eef-4940-b88b-5ff3b4d6ea29] succeeded in 2.9688517250001496s: None 2024-05-25T23:00:08.920096658Z [2024-05-25 23:00:08,919: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18567fe0-590e-49a2-be23-76b0b2465eed] received 2024-05-25T23:00:08.934766609Z [2024-05-25 23:00:08,934: INFO/ForkPoolWorker-15] [18567fe0-590e-49a2-be23-76b0b2465eed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:00:09.460500547Z [2024-05-25 23:00:09,448: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:00:10.659665851Z [2024-05-25 23:00:10,659: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:00:10.663612734Z [2024-05-25 23:00:10,663: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:00:10.682216850Z [2024-05-25 23:00:10,682: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:00:10.683473824Z [2024-05-25 23:00:10,683: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:00:10.683493874Z [2024-05-25 23:00:10,683: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:00:10.683753116Z [2024-05-25 23:00:10,683: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:00:10.683825432Z [2024-05-25 23:00:10,683: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:00:10.684370348Z [2024-05-25 23:00:10,684: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:00:10.684428297Z [2024-05-25 23:00:10,684: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:00:10.775399981Z [2024-05-25 23:00:10,775: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:00:11.544083664Z [2024-05-25 23:00:11,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89d8a6ee-793d-4ee0-ad4f-7a7c8ba6cd4c] received 2024-05-25T23:00:11.559507414Z [2024-05-25 23:00:11,558: INFO/ForkPoolWorker-16] [89d8a6ee-793d-4ee0-ad4f-7a7c8ba6cd4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:00:11.599570179Z [2024-05-25 23:00:11,591: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[18567fe0-590e-49a2-be23-76b0b2465eed] succeeded in 2.66898507399992s: None 2024-05-25T23:00:11.864945510Z [2024-05-25 23:00:11,861: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:00:13.167479772Z [2024-05-25 23:00:13,167: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:00:13.171255786Z [2024-05-25 23:00:13,170: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:00:13.196816745Z [2024-05-25 23:00:13,196: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:00:13.198626244Z [2024-05-25 23:00:13,198: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:00:13.198779535Z [2024-05-25 23:00:13,198: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:00:13.199023504Z [2024-05-25 23:00:13,198: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:00:13.199153686Z [2024-05-25 23:00:13,199: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:00:13.199589217Z [2024-05-25 23:00:13,199: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:00:13.199728697Z [2024-05-25 23:00:13,199: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:00:13.303963541Z [2024-05-25 23:00:13,303: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:00:13.960091744Z [2024-05-25 23:00:13,959: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89d8a6ee-793d-4ee0-ad4f-7a7c8ba6cd4c] succeeded in 2.412951479999947s: None 2024-05-25T23:01:00.472186859Z [2024-05-25 23:01:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23e60967-d59b-4807-a401-bf1f5f8fd1b2] received 2024-05-25T23:01:00.476979882Z [2024-05-25 23:01:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[950ffc18-df07-4fbd-978a-2ae494824133] received 2024-05-25T23:01:00.478566813Z [2024-05-25 23:01:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ca3e80e-7689-4d09-bb66-8507940925b0] received 2024-05-25T23:01:00.485460089Z [2024-05-25 23:01:00,485: INFO/ForkPoolWorker-15] [23e60967-d59b-4807-a401-bf1f5f8fd1b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:01:00.487565966Z [2024-05-25 23:01:00,487: INFO/ForkPoolWorker-16] [950ffc18-df07-4fbd-978a-2ae494824133] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:01:00.496841521Z [2024-05-25 23:01:00,496: INFO/ForkPoolWorker-1] [3ca3e80e-7689-4d09-bb66-8507940925b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:01:00.814228921Z [2024-05-25 23:01:00,810: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:01:00.818980887Z [2024-05-25 23:01:00,815: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:01:00.823963086Z [2024-05-25 23:01:00,819: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:01:00.990231590Z [2024-05-25 23:01:00,989: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:01:00.994491250Z [2024-05-25 23:01:00,994: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:01:01.024630053Z [2024-05-25 23:01:01,024: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:01:01.025701075Z [2024-05-25 23:01:01,025: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:01:01.025885219Z [2024-05-25 23:01:01,025: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:01:01.025997163Z [2024-05-25 23:01:01,025: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:01:01.026262944Z [2024-05-25 23:01:01,026: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:01:01.124569745Z [2024-05-25 23:01:01,124: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:01:01.796259715Z [2024-05-25 23:01:01,795: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[950ffc18-df07-4fbd-978a-2ae494824133] succeeded in 1.3168809799999508s: None 2024-05-25T23:01:02.108190613Z [2024-05-25 23:01:02,107: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:01:02.111218529Z [2024-05-25 23:01:02,110: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:01:02.152597676Z [2024-05-25 23:01:02,152: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:01:02.153780016Z [2024-05-25 23:01:02,153: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:01:02.153795839Z [2024-05-25 23:01:02,153: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:01:02.153882806Z [2024-05-25 23:01:02,153: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:01:02.153953940Z [2024-05-25 23:01:02,153: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:01:02.154176231Z [2024-05-25 23:01:02,154: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:01:02.154188513Z [2024-05-25 23:01:02,154: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:01:02.204168573Z [2024-05-25 23:01:02,203: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:01:02.207927408Z [2024-05-25 23:01:02,207: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:01:02.227433950Z [2024-05-25 23:01:02,227: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:01:02.233960361Z [2024-05-25 23:01:02,233: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:01:02.233978583Z [2024-05-25 23:01:02,233: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:01:02.234077299Z [2024-05-25 23:01:02,233: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:01:02.234082725Z [2024-05-25 23:01:02,233: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:01:02.234738188Z [2024-05-25 23:01:02,234: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:01:02.234748647Z [2024-05-25 23:01:02,234: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:01:02.249248157Z [2024-05-25 23:01:02,248: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:01:02.325571178Z [2024-05-25 23:01:02,325: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:01:04.603476496Z [2024-05-25 23:01:04,603: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23e60967-d59b-4807-a401-bf1f5f8fd1b2] succeeded in 4.127865404999966s: None 2024-05-25T23:01:04.757571888Z [2024-05-25 23:01:04,757: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3ca3e80e-7689-4d09-bb66-8507940925b0] succeeded in 4.276496417000089s: None 2024-05-25T23:01:44.148098071Z [2024-05-25 23:01:44,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29162b1b-5557-4612-8cfe-f2f999540556] received 2024-05-25T23:01:44.155107557Z [2024-05-25 23:01:44,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7034bec4-706d-4680-8c48-d6c010e7d132] received 2024-05-25T23:01:44.189283068Z [2024-05-25 23:01:44,188: INFO/ForkPoolWorker-15] [29162b1b-5557-4612-8cfe-f2f999540556] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:01:44.194563660Z [2024-05-25 23:01:44,194: INFO/ForkPoolWorker-16] [7034bec4-706d-4680-8c48-d6c010e7d132] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:01:44.720832576Z [2024-05-25 23:01:44,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:01:44.739717691Z [2024-05-25 23:01:44,735: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:01:45.594765888Z [2024-05-25 23:01:45,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6446576b-3cab-49e3-a08d-4c338fd8a648] received 2024-05-25T23:01:45.612179285Z [2024-05-25 23:01:45,611: INFO/ForkPoolWorker-1] [6446576b-3cab-49e3-a08d-4c338fd8a648] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:01:45.957895129Z [2024-05-25 23:01:45,953: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:01:46.049884685Z [2024-05-25 23:01:46,049: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:01:46.053588491Z [2024-05-25 23:01:46,053: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:01:46.077916342Z [2024-05-25 23:01:46,077: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:01:46.079638707Z [2024-05-25 23:01:46,079: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:01:46.080349287Z [2024-05-25 23:01:46,080: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:01:46.080529669Z [2024-05-25 23:01:46,080: INFO/ForkPoolWorker-16] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:01:46.080811228Z [2024-05-25 23:01:46,080: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:01:46.080993286Z [2024-05-25 23:01:46,080: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:01:46.081362443Z [2024-05-25 23:01:46,081: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:01:46.081521013Z [2024-05-25 23:01:46,081: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:01:46.086519829Z [2024-05-25 23:01:46,086: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:01:46.091689982Z [2024-05-25 23:01:46,091: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:01:46.095477145Z [2024-05-25 23:01:46,095: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:01:46.119612265Z [2024-05-25 23:01:46,119: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:01:46.121412151Z [2024-05-25 23:01:46,121: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:01:46.121526176Z [2024-05-25 23:01:46,121: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:01:46.121693552Z [2024-05-25 23:01:46,121: INFO/ForkPoolWorker-15] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:01:46.121837645Z [2024-05-25 23:01:46,121: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:01:46.121893653Z [2024-05-25 23:01:46,121: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:01:46.122212397Z [2024-05-25 23:01:46,122: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:01:46.122756857Z [2024-05-25 23:01:46,122: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:01:46.128125227Z [2024-05-25 23:01:46,127: INFO/ForkPoolWorker-15] Creating DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:01:46.180745995Z [2024-05-25 23:01:46,180: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:01:46.220321407Z [2024-05-25 23:01:46,220: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:01:47.140453901Z [2024-05-25 23:01:47,139: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:01:47.143422514Z [2024-05-25 23:01:47,142: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:01:47.179117777Z [2024-05-25 23:01:47,178: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:01:47.181284657Z [2024-05-25 23:01:47,181: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:01:47.181566074Z [2024-05-25 23:01:47,181: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:01:47.181760792Z [2024-05-25 23:01:47,181: INFO/ForkPoolWorker-1] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:01:47.182088235Z [2024-05-25 23:01:47,181: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:01:47.182327790Z [2024-05-25 23:01:47,182: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:01:47.182984009Z [2024-05-25 23:01:47,182: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:01:47.183240313Z [2024-05-25 23:01:47,183: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:01:47.194000490Z [2024-05-25 23:01:47,193: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:01:47.257430667Z [2024-05-25 23:01:47,257: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:01:47.686148554Z [2024-05-25 23:01:47,685: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29162b1b-5557-4612-8cfe-f2f999540556] succeeded in 3.5342283439999846s: None 2024-05-25T23:01:47.880222539Z [2024-05-25 23:01:47,879: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6446576b-3cab-49e3-a08d-4c338fd8a648] succeeded in 2.2822803110000223s: None 2024-05-25T23:01:47.944567647Z [2024-05-25 23:01:47,944: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7034bec4-706d-4680-8c48-d6c010e7d132] succeeded in 3.779145370999913s: None 2024-05-25T23:01:48.122984157Z [2024-05-25 23:01:48,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fff8774-2032-4b2f-afca-88b8d7437fa4] received 2024-05-25T23:01:48.135404007Z [2024-05-25 23:01:48,133: INFO/ForkPoolWorker-15] [4fff8774-2032-4b2f-afca-88b8d7437fa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'split_metrics', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:01:48.516906530Z [2024-05-25 23:01:48,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:01:49.664012095Z [2024-05-25 23:01:49,663: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:01:49.667595560Z [2024-05-25 23:01:49,667: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:01:49.689717669Z [2024-05-25 23:01:49,689: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:01:49.691434930Z [2024-05-25 23:01:49,691: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:01:49.691448220Z [2024-05-25 23:01:49,691: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:01:49.691665434Z [2024-05-25 23:01:49,691: INFO/ForkPoolWorker-15] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:01:49.691890467Z [2024-05-25 23:01:49,691: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:01:49.692038335Z [2024-05-25 23:01:49,691: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:01:49.692393239Z [2024-05-25 23:01:49,692: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:01:49.692603807Z [2024-05-25 23:01:49,692: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:01:49.699242283Z [2024-05-25 23:01:49,698: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:01:49.789621533Z [2024-05-25 23:01:49,789: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:01:50.477131250Z [2024-05-25 23:01:50,476: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4fff8774-2032-4b2f-afca-88b8d7437fa4] succeeded in 2.351419402999909s: None 2024-05-25T23:01:50.482396161Z [2024-05-25 23:01:50,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4956a36-8a7b-4f2a-8ea2-e8524af1065d] received 2024-05-25T23:01:50.492404853Z [2024-05-25 23:01:50,492: INFO/ForkPoolWorker-15] [b4956a36-8a7b-4f2a-8ea2-e8524af1065d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'collect_metrics', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:01:50.806882876Z [2024-05-25 23:01:50,803: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:01:51.866318440Z [2024-05-25 23:01:51,865: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:01:51.869618238Z [2024-05-25 23:01:51,869: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:01:51.887335376Z [2024-05-25 23:01:51,887: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:01:51.888835244Z [2024-05-25 23:01:51,888: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:01:51.888850786Z [2024-05-25 23:01:51,888: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:01:51.888929981Z [2024-05-25 23:01:51,888: INFO/ForkPoolWorker-15] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:01:51.888992965Z [2024-05-25 23:01:51,888: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:01:51.889016508Z [2024-05-25 23:01:51,888: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:01:51.889232405Z [2024-05-25 23:01:51,889: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:01:51.889299788Z [2024-05-25 23:01:51,889: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:01:51.895189119Z [2024-05-25 23:01:51,894: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:01:51.960881333Z [2024-05-25 23:01:51,960: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:01:52.516932363Z [2024-05-25 23:01:52,516: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4956a36-8a7b-4f2a-8ea2-e8524af1065d] succeeded in 2.03268435699988s: None 2024-05-25T23:01:53.172448239Z [2024-05-25 23:01:53,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[268bdb42-bf53-4e67-a9ac-3d744b178bf2] received 2024-05-25T23:01:53.186443845Z [2024-05-25 23:01:53,185: INFO/ForkPoolWorker-15] [268bdb42-bf53-4e67-a9ac-3d744b178bf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'send_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:01:53.493806277Z [2024-05-25 23:01:53,490: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:01:54.635421676Z [2024-05-25 23:01:54,634: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:01:54.638862429Z [2024-05-25 23:01:54,638: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:01:54.676286473Z [2024-05-25 23:01:54,675: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:01:54.678541879Z [2024-05-25 23:01:54,678: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:01:54.678786999Z [2024-05-25 23:01:54,678: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:01:54.679041970Z [2024-05-25 23:01:54,678: INFO/ForkPoolWorker-15] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:01:54.679409807Z [2024-05-25 23:01:54,679: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:01:54.679683047Z [2024-05-25 23:01:54,679: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:01:54.680203550Z [2024-05-25 23:01:54,680: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:01:54.680455771Z [2024-05-25 23:01:54,680: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:01:54.690840513Z [2024-05-25 23:01:54,690: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:01:54.780438621Z [2024-05-25 23:01:54,779: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:01:55.487794332Z [2024-05-25 23:01:55,486: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[268bdb42-bf53-4e67-a9ac-3d744b178bf2] succeeded in 2.3103218389999256s: None 2024-05-25T23:02:00.596705276Z [2024-05-25 23:02:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d26299cd-3829-424a-8663-afb4ccc997e3] received 2024-05-25T23:02:00.604216056Z [2024-05-25 23:02:00,603: INFO/ForkPoolWorker-15] [d26299cd-3829-424a-8663-afb4ccc997e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:02:00.605997554Z [2024-05-25 23:02:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e01a18c-292e-4a74-a360-da8b913899cf] received 2024-05-25T23:02:00.611534782Z [2024-05-25 23:02:00,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e33b122d-2372-4164-8f1a-99ee3298d925] received 2024-05-25T23:02:00.613557258Z [2024-05-25 23:02:00,613: INFO/ForkPoolWorker-16] [3e01a18c-292e-4a74-a360-da8b913899cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:02:00.613909138Z [2024-05-25 23:02:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c35b26f-b98d-415b-8517-9962e01b7e5f] received 2024-05-25T23:02:00.620077559Z [2024-05-25 23:02:00,619: INFO/ForkPoolWorker-1] [e33b122d-2372-4164-8f1a-99ee3298d925] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:02:00.626751841Z [2024-05-25 23:02:00,626: INFO/ForkPoolWorker-2] [3c35b26f-b98d-415b-8517-9962e01b7e5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:02:00.628028333Z [2024-05-25 23:02:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97ca0804-3ab4-457c-8ab9-4681af901c54] received 2024-05-25T23:02:00.637313079Z [2024-05-25 23:02:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bff4b99-be33-4644-9e3e-195d6dd9f879] received 2024-05-25T23:02:00.656056287Z [2024-05-25 23:02:00,655: INFO/ForkPoolWorker-3] [97ca0804-3ab4-457c-8ab9-4681af901c54] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:02:00.676508857Z [2024-05-25 23:02:00,676: INFO/ForkPoolWorker-4] [1bff4b99-be33-4644-9e3e-195d6dd9f879] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:02:01.010715546Z [2024-05-25 23:02:01,007: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:02:01.056887349Z [2024-05-25 23:02:01,050: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:02:01.084415391Z [2024-05-25 23:02:01,080: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:02:01.203442114Z [2024-05-25 23:02:01,199: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:02:01.245416786Z [2024-05-25 23:02:01,244: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T23:02:01.249317408Z [2024-05-25 23:02:01,248: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:02:01.253105160Z [2024-05-25 23:02:01,235: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:02:01.308688021Z [2024-05-25 23:02:01,308: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T23:02:01.316039209Z [2024-05-25 23:02:01,315: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:02:01.316303279Z [2024-05-25 23:02:01,315: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:02:01.316460717Z [2024-05-25 23:02:01,316: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T23:02:01.319942084Z [2024-05-25 23:02:01,319: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:02:01.424365234Z [2024-05-25 23:02:01,412: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:02:01.471951042Z [2024-05-25 23:02:01,471: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:02:01.731567484Z [2024-05-25 23:02:01,731: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:02:02.077390463Z [2024-05-25 23:02:02,076: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[97ca0804-3ab4-457c-8ab9-4681af901c54] succeeded in 1.445414812999843s: None 2024-05-25T23:02:02.420346777Z [2024-05-25 23:02:02,419: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d26299cd-3829-424a-8663-afb4ccc997e3] succeeded in 1.8219583730001432s: None 2024-05-25T23:02:02.906259590Z [2024-05-25 23:02:02,905: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:02:02.909546769Z [2024-05-25 23:02:02,909: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:02:02.929657790Z [2024-05-25 23:02:02,929: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:02:02.933350128Z [2024-05-25 23:02:02,932: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:02:02.962788347Z [2024-05-25 23:02:02,962: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:02:02.965198331Z [2024-05-25 23:02:02,964: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:02:02.965776534Z [2024-05-25 23:02:02,965: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:02:02.965788671Z [2024-05-25 23:02:02,965: INFO/ForkPoolWorker-1] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:02:02.965794043Z [2024-05-25 23:02:02,965: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:02:02.965798957Z [2024-05-25 23:02:02,965: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:02:02.966483319Z [2024-05-25 23:02:02,966: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:02:02.966600774Z [2024-05-25 23:02:02,966: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:02:02.971799961Z [2024-05-25 23:02:02,971: INFO/ForkPoolWorker-1] Creating DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:02:02.976691005Z [2024-05-25 23:02:02,976: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:02:02.978393145Z [2024-05-25 23:02:02,978: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:02:02.978631598Z [2024-05-25 23:02:02,978: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:02:02.979235275Z [2024-05-25 23:02:02,978: INFO/ForkPoolWorker-16] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:02:02.979510363Z [2024-05-25 23:02:02,979: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:02:02.979695755Z [2024-05-25 23:02:02,979: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:02:02.980594327Z [2024-05-25 23:02:02,980: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:02:02.981050064Z [2024-05-25 23:02:02,980: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:02:02.985617862Z [2024-05-25 23:02:02,985: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:02:03.066824762Z [2024-05-25 23:02:03,066: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:02:03.077596663Z [2024-05-25 23:02:03,077: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:02:03.081027152Z [2024-05-25 23:02:03,080: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:02:03.111490255Z [2024-05-25 23:02:03,111: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:02:03.129951049Z [2024-05-25 23:02:03,129: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:02:03.131461263Z [2024-05-25 23:02:03,131: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:02:03.131608834Z [2024-05-25 23:02:03,131: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:02:03.131717681Z [2024-05-25 23:02:03,131: INFO/ForkPoolWorker-2] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:02:03.131880162Z [2024-05-25 23:02:03,131: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:02:03.131975802Z [2024-05-25 23:02:03,131: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:02:03.132251733Z [2024-05-25 23:02:03,132: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:02:03.132340910Z [2024-05-25 23:02:03,132: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:02:03.136711242Z [2024-05-25 23:02:03,136: INFO/ForkPoolWorker-2] Creating DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:02:03.285120899Z [2024-05-25 23:02:03,284: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:02:03.392985417Z [2024-05-25 23:02:03,392: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-25T23:02:03.401237909Z [2024-05-25 23:02:03,398: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:02:03.490065382Z [2024-05-25 23:02:03,489: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-25T23:02:03.491376160Z [2024-05-25 23:02:03,491: INFO/ForkPoolWorker-4] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:02:03.491507569Z [2024-05-25 23:02:03,491: INFO/ForkPoolWorker-4] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:02:03.491639718Z [2024-05-25 23:02:03,491: INFO/ForkPoolWorker-4] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:02:03.491794253Z [2024-05-25 23:02:03,491: INFO/ForkPoolWorker-4] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:02:03.491890861Z [2024-05-25 23:02:03,491: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-25T23:02:03.492187005Z [2024-05-25 23:02:03,492: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:02:03.493243530Z [2024-05-25 23:02:03,492: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:02:03.516699031Z [2024-05-25 23:02:03,516: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:02:03.729710233Z [2024-05-25 23:02:03,729: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:02:05.148621765Z [2024-05-25 23:02:05,148: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e33b122d-2372-4164-8f1a-99ee3298d925] succeeded in 4.532683024000107s: None 2024-05-25T23:02:05.607978423Z [2024-05-25 23:02:05,607: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3c35b26f-b98d-415b-8517-9962e01b7e5f] succeeded in 4.990917795000087s: None 2024-05-25T23:02:05.655826486Z [2024-05-25 23:02:05,651: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e01a18c-292e-4a74-a360-da8b913899cf] succeeded in 5.043665954000062s: None 2024-05-25T23:02:06.131561929Z [2024-05-25 23:02:06,131: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[1bff4b99-be33-4644-9e3e-195d6dd9f879] succeeded in 5.490053138000121s: None 2024-05-25T23:03:00.599204142Z [2024-05-25 23:03:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65ee33fb-cd3a-452e-91fb-508d62014a80] received 2024-05-25T23:03:00.604064166Z [2024-05-25 23:03:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae1ea269-c729-4ffd-85f1-afff36568f0a] received 2024-05-25T23:03:00.613523179Z [2024-05-25 23:03:00,613: INFO/ForkPoolWorker-15] [65ee33fb-cd3a-452e-91fb-508d62014a80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:03:00.614360095Z [2024-05-25 23:03:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bce0e06b-3f69-4913-9a4e-3494bf081a3b] received 2024-05-25T23:03:00.616233013Z [2024-05-25 23:03:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9877c603-f4e2-4c2b-a5d4-2cf67caccb49] received 2024-05-25T23:03:00.616698525Z [2024-05-25 23:03:00,616: INFO/ForkPoolWorker-16] [ae1ea269-c729-4ffd-85f1-afff36568f0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:03:00.618736641Z [2024-05-25 23:03:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7e16aa0-d1b4-4cb0-9f28-0685f1df7d61] received 2024-05-25T23:03:00.626725170Z [2024-05-25 23:03:00,626: INFO/ForkPoolWorker-2] [9877c603-f4e2-4c2b-a5d4-2cf67caccb49] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:03:00.627897847Z [2024-05-25 23:03:00,627: INFO/ForkPoolWorker-1] [bce0e06b-3f69-4913-9a4e-3494bf081a3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:03:00.638210829Z [2024-05-25 23:03:00,637: INFO/ForkPoolWorker-3] [e7e16aa0-d1b4-4cb0-9f28-0685f1df7d61] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:03:01.022022995Z [2024-05-25 23:03:01,016: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:03:01.079616099Z [2024-05-25 23:03:01,076: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:03:01.097389968Z [2024-05-25 23:03:01,085: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:03:01.192513824Z [2024-05-25 23:03:01,188: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:03:01.295251930Z [2024-05-25 23:03:01,287: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:03:01.538405312Z [2024-05-25 23:03:01,537: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:03:01.542578690Z [2024-05-25 23:03:01,542: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:03:01.574416474Z [2024-05-25 23:03:01,574: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:03:01.575975027Z [2024-05-25 23:03:01,575: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:03:01.576218837Z [2024-05-25 23:03:01,575: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:03:01.576314276Z [2024-05-25 23:03:01,576: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:03:01.576651921Z [2024-05-25 23:03:01,576: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:03:01.744519987Z [2024-05-25 23:03:01,744: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:03:02.498521610Z [2024-05-25 23:03:02,498: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9877c603-f4e2-4c2b-a5d4-2cf67caccb49] succeeded in 1.8788196049999897s: None 2024-05-25T23:03:02.706671062Z [2024-05-25 23:03:02,706: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:03:02.707022695Z [2024-05-25 23:03:02,706: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T23:03:02.710561432Z [2024-05-25 23:03:02,710: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:03:02.710902382Z [2024-05-25 23:03:02,710: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:03:02.731705441Z [2024-05-25 23:03:02,731: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:03:02.734358440Z [2024-05-25 23:03:02,734: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:03:02.734669379Z [2024-05-25 23:03:02,734: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:03:02.734808250Z [2024-05-25 23:03:02,734: INFO/ForkPoolWorker-15] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:03:02.734978590Z [2024-05-25 23:03:02,734: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:03:02.735028996Z [2024-05-25 23:03:02,734: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:03:02.735293403Z [2024-05-25 23:03:02,735: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:03:02.735415894Z [2024-05-25 23:03:02,735: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:03:02.736334005Z [2024-05-25 23:03:02,736: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T23:03:02.737789448Z [2024-05-25 23:03:02,737: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:03:02.737895299Z [2024-05-25 23:03:02,737: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:03:02.737979481Z [2024-05-25 23:03:02,737: INFO/ForkPoolWorker-3] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:03:02.739355335Z [2024-05-25 23:03:02,738: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:03:02.739455981Z [2024-05-25 23:03:02,739: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T23:03:02.742864468Z [2024-05-25 23:03:02,742: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:03:02.742941825Z [2024-05-25 23:03:02,742: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:03:02.748206789Z [2024-05-25 23:03:02,747: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:03:02.748754798Z [2024-05-25 23:03:02,748: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:03:02.775684828Z [2024-05-25 23:03:02,775: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:03:02.779933311Z [2024-05-25 23:03:02,779: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:03:02.809338373Z [2024-05-25 23:03:02,809: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:03:02.811242194Z [2024-05-25 23:03:02,810: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:03:02.811459493Z [2024-05-25 23:03:02,811: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:03:02.811641640Z [2024-05-25 23:03:02,811: INFO/ForkPoolWorker-1] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:03:02.811819883Z [2024-05-25 23:03:02,811: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:03:02.812184374Z [2024-05-25 23:03:02,811: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:03:02.812492910Z [2024-05-25 23:03:02,812: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:03:02.812932610Z [2024-05-25 23:03:02,812: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:03:02.818200447Z [2024-05-25 23:03:02,817: INFO/ForkPoolWorker-1] Creating DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:03:02.837203885Z [2024-05-25 23:03:02,836: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:03:02.878664044Z [2024-05-25 23:03:02,878: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:03:02.888910572Z [2024-05-25 23:03:02,888: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:03:02.892551134Z [2024-05-25 23:03:02,892: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:03:02.914482774Z [2024-05-25 23:03:02,914: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:03:02.916949835Z [2024-05-25 23:03:02,916: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:03:02.916965687Z [2024-05-25 23:03:02,916: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:03:02.917074291Z [2024-05-25 23:03:02,916: INFO/ForkPoolWorker-16] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:03:02.917367592Z [2024-05-25 23:03:02,917: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:03:02.917431288Z [2024-05-25 23:03:02,917: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:03:02.917674253Z [2024-05-25 23:03:02,917: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:03:02.918092376Z [2024-05-25 23:03:02,917: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:03:02.923546326Z [2024-05-25 23:03:02,923: INFO/ForkPoolWorker-16] Creating DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:03:02.928315557Z [2024-05-25 23:03:02,928: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:03:03.032674193Z [2024-05-25 23:03:03,032: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:03:04.988883013Z [2024-05-25 23:03:04,988: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bce0e06b-3f69-4913-9a4e-3494bf081a3b] succeeded in 4.370475721000275s: None 2024-05-25T23:03:05.154907353Z [2024-05-25 23:03:05,153: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae1ea269-c729-4ffd-85f1-afff36568f0a] succeeded in 4.5480660990001525s: None 2024-05-25T23:03:05.332515385Z [2024-05-25 23:03:05,332: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65ee33fb-cd3a-452e-91fb-508d62014a80] succeeded in 4.729142138000043s: None 2024-05-25T23:03:05.380082090Z [2024-05-25 23:03:05,379: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e7e16aa0-d1b4-4cb0-9f28-0685f1df7d61] succeeded in 4.7590459970001575s: None 2024-05-25T23:04:00.483086690Z [2024-05-25 23:04:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6fed5df-58e0-4ee9-adec-d6959a7b9fa6] received 2024-05-25T23:04:00.494072854Z [2024-05-25 23:04:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbe6fad1-2ec7-444c-a85f-4c8fcedfedd5] received 2024-05-25T23:04:00.495497616Z [2024-05-25 23:04:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[683b1520-955e-4b53-b646-80846554df97] received 2024-05-25T23:04:00.497345202Z [2024-05-25 23:04:00,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f03a14b-cdbf-4de1-a814-d043a1979331] received 2024-05-25T23:04:00.499139295Z [2024-05-25 23:04:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[559f7a9e-6d0a-47f4-862d-e4dfc9142fba] received 2024-05-25T23:04:00.513605662Z [2024-05-25 23:04:00,512: INFO/ForkPoolWorker-2] [8f03a14b-cdbf-4de1-a814-d043a1979331] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:04:00.513952690Z [2024-05-25 23:04:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61cb63e9-9764-4a6c-bf36-7dd544fe5c2d] received 2024-05-25T23:04:00.526452663Z [2024-05-25 23:04:00,526: INFO/ForkPoolWorker-1] [683b1520-955e-4b53-b646-80846554df97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:04:00.526472240Z [2024-05-25 23:04:00,526: INFO/ForkPoolWorker-16] [cbe6fad1-2ec7-444c-a85f-4c8fcedfedd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:04:00.528980546Z [2024-05-25 23:04:00,528: INFO/ForkPoolWorker-3] [559f7a9e-6d0a-47f4-862d-e4dfc9142fba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:04:00.530572288Z [2024-05-25 23:04:00,530: INFO/ForkPoolWorker-15] [f6fed5df-58e0-4ee9-adec-d6959a7b9fa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:04:00.532795044Z [2024-05-25 23:04:00,532: INFO/ForkPoolWorker-4] [61cb63e9-9764-4a6c-bf36-7dd544fe5c2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:04:00.941910052Z [2024-05-25 23:04:00,936: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:04:00.958226964Z [2024-05-25 23:04:00,946: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:04:00.994802042Z [2024-05-25 23:04:00,990: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:04:01.078856132Z [2024-05-25 23:04:01,074: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:04:01.259904881Z [2024-05-25 23:04:01,259: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:04:01.509721674Z [2024-05-25 23:04:01,500: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:04:01.513063050Z [2024-05-25 23:04:01,498: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:04:01.753124152Z [2024-05-25 23:04:01,752: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:04:01.760296428Z [2024-05-25 23:04:01,756: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:04:01.791073925Z [2024-05-25 23:04:01,790: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6fed5df-58e0-4ee9-adec-d6959a7b9fa6] succeeded in 1.2959616719999758s: None 2024-05-25T23:04:01.807677542Z [2024-05-25 23:04:01,807: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:04:01.808959019Z [2024-05-25 23:04:01,808: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:04:01.809134462Z [2024-05-25 23:04:01,808: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:04:01.809239291Z [2024-05-25 23:04:01,809: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:04:01.809499705Z [2024-05-25 23:04:01,809: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:04:01.915330733Z [2024-05-25 23:04:01,915: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:04:02.548792081Z [2024-05-25 23:04:02,548: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8f03a14b-cdbf-4de1-a814-d043a1979331] succeeded in 2.0478622370001176s: None 2024-05-25T23:04:02.780426332Z [2024-05-25 23:04:02,780: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-25T23:04:02.783987083Z [2024-05-25 23:04:02,783: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:04:02.810432618Z [2024-05-25 23:04:02,810: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-25T23:04:02.812153047Z [2024-05-25 23:04:02,811: INFO/ForkPoolWorker-4] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:04:02.812327017Z [2024-05-25 23:04:02,812: INFO/ForkPoolWorker-4] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:04:02.812482633Z [2024-05-25 23:04:02,812: INFO/ForkPoolWorker-4] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:04:02.812747749Z [2024-05-25 23:04:02,812: INFO/ForkPoolWorker-4] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:04:02.812953096Z [2024-05-25 23:04:02,812: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-25T23:04:02.813298014Z [2024-05-25 23:04:02,813: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:04:02.813792588Z [2024-05-25 23:04:02,813: INFO/ForkPoolWorker-4] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:04:02.815159758Z [2024-05-25 23:04:02,814: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:04:02.818595231Z [2024-05-25 23:04:02,818: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:04:02.818741560Z [2024-05-25 23:04:02,818: INFO/ForkPoolWorker-4] Creating DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:04:02.855323363Z [2024-05-25 23:04:02,855: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:04:02.862381377Z [2024-05-25 23:04:02,862: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:04:02.862503466Z [2024-05-25 23:04:02,862: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:04:02.862613657Z [2024-05-25 23:04:02,862: INFO/ForkPoolWorker-1] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:04:02.862791349Z [2024-05-25 23:04:02,862: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:04:02.862907211Z [2024-05-25 23:04:02,862: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:04:02.863208531Z [2024-05-25 23:04:02,863: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:04:02.866370864Z [2024-05-25 23:04:02,863: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:04:02.874304081Z [2024-05-25 23:04:02,874: INFO/ForkPoolWorker-1] Creating DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:04:02.895348026Z [2024-05-25 23:04:02,895: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:04:02.951207969Z [2024-05-25 23:04:02,950: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:04:03.106547677Z [2024-05-25 23:04:03,106: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:04:03.111264129Z [2024-05-25 23:04:03,110: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:04:03.153276441Z [2024-05-25 23:04:03,152: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:04:03.154292855Z [2024-05-25 23:04:03,154: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:04:03.154370440Z [2024-05-25 23:04:03,154: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:04:03.154418734Z [2024-05-25 23:04:03,154: INFO/ForkPoolWorker-16] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:04:03.154552467Z [2024-05-25 23:04:03,154: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:04:03.154561299Z [2024-05-25 23:04:03,154: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:04:03.155251553Z [2024-05-25 23:04:03,155: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:04:03.155293696Z [2024-05-25 23:04:03,155: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:04:03.161476654Z [2024-05-25 23:04:03,160: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:04:03.349066589Z [2024-05-25 23:04:03,348: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:04:03.534166311Z [2024-05-25 23:04:03,533: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T23:04:03.539490254Z [2024-05-25 23:04:03,539: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:04:03.603772335Z [2024-05-25 23:04:03,603: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T23:04:03.607147293Z [2024-05-25 23:04:03,606: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:04:03.607450282Z [2024-05-25 23:04:03,607: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:04:03.608883127Z [2024-05-25 23:04:03,608: INFO/ForkPoolWorker-3] Read VIM 4f5e1033-5282-443b-a4d0-25ffec986b89 (basic_08_vim_test) 2024-05-25T23:04:03.609272830Z [2024-05-25 23:04:03,608: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4f5e1033-5282-443b-a4d0-25ffec986b89', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-25T23:04:03.609530043Z [2024-05-25 23:04:03,609: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T23:04:03.610196208Z [2024-05-25 23:04:03,609: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:04:03.610529971Z [2024-05-25 23:04:03,610: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:04:03.616601203Z [2024-05-25 23:04:03,616: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 2024-05-25T23:04:03.709794420Z [2024-05-25 23:04:03,709: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:04:04.693842758Z [2024-05-25 23:04:04,693: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[683b1520-955e-4b53-b646-80846554df97] succeeded in 4.195063646000108s: None 2024-05-25T23:04:04.783114295Z [2024-05-25 23:04:04,782: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[61cb63e9-9764-4a6c-bf36-7dd544fe5c2d] succeeded in 4.261205746000087s: None 2024-05-25T23:04:05.293237076Z [2024-05-25 23:04:05,292: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cbe6fad1-2ec7-444c-a85f-4c8fcedfedd5] succeeded in 4.788771988999997s: None 2024-05-25T23:04:05.668153217Z [2024-05-25 23:04:05,667: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[559f7a9e-6d0a-47f4-862d-e4dfc9142fba] succeeded in 5.159328925999944s: None 2024-05-25T23:05:00.504259532Z [2024-05-25 23:05:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ace8abc-c800-4d09-aae1-b5f7510e454a] received 2024-05-25T23:05:00.511939395Z [2024-05-25 23:05:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[275ca559-2e60-4056-a5e1-c51bd6e75204] received 2024-05-25T23:05:00.520832420Z [2024-05-25 23:05:00,520: INFO/ForkPoolWorker-15] [9ace8abc-c800-4d09-aae1-b5f7510e454a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:00.521510675Z [2024-05-25 23:05:00,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fec64b02-33a6-456f-81d4-2b12367ca65d] received 2024-05-25T23:05:00.539849790Z [2024-05-25 23:05:00,539: INFO/ForkPoolWorker-16] [275ca559-2e60-4056-a5e1-c51bd6e75204] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:00.539965348Z [2024-05-25 23:05:00,539: INFO/ForkPoolWorker-1] [fec64b02-33a6-456f-81d4-2b12367ca65d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:05:00.544322487Z [2024-05-25 23:05:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fdf98bc-fb66-4f7d-8c6b-9c13de65c4d4] received 2024-05-25T23:05:00.546252385Z [2024-05-25 23:05:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37e82c45-c184-445a-b9db-6d60f0389686] received 2024-05-25T23:05:00.548613665Z [2024-05-25 23:05:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23ed456f-7b07-498b-bacb-66e08c4d45fa] received 2024-05-25T23:05:00.552055242Z [2024-05-25 23:05:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[350c5551-8f0d-429e-b82f-a5ab48450c52] received 2024-05-25T23:05:00.565507505Z [2024-05-25 23:05:00,565: INFO/ForkPoolWorker-3] [37e82c45-c184-445a-b9db-6d60f0389686] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:05:00.581735673Z [2024-05-25 23:05:00,581: INFO/ForkPoolWorker-4] [23ed456f-7b07-498b-bacb-66e08c4d45fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:05:00.587866774Z [2024-05-25 23:05:00,587: INFO/ForkPoolWorker-2] [8fdf98bc-fb66-4f7d-8c6b-9c13de65c4d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:05:00.598003260Z [2024-05-25 23:05:00,597: INFO/ForkPoolWorker-5] [350c5551-8f0d-429e-b82f-a5ab48450c52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:05:01.064663814Z [2024-05-25 23:05:01,059: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:05:01.118485171Z [2024-05-25 23:05:01,114: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:01.188227212Z [2024-05-25 23:05:01,184: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:05:01.233692763Z [2024-05-25 23:05:01,229: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:01.313985965Z [2024-05-25 23:05:01,309: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:05:01.522240038Z [2024-05-25 23:05:01,508: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:05:01.548437429Z [2024-05-25 23:05:01,544: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:05:01.714625242Z [2024-05-25 23:05:01,714: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:05:01.718715483Z [2024-05-25 23:05:01,718: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:01.784206126Z [2024-05-25 23:05:01,783: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:05:01.787009052Z [2024-05-25 23:05:01,786: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:05:01.787133549Z [2024-05-25 23:05:01,786: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:05:01.787259253Z [2024-05-25 23:05:01,787: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:05:01.787557910Z [2024-05-25 23:05:01,787: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:05:01.999122686Z [2024-05-25 23:05:01,998: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:05:02.760587875Z [2024-05-25 23:05:02,760: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8fdf98bc-fb66-4f7d-8c6b-9c13de65c4d4] succeeded in 2.2130506649996278s: None 2024-05-25T23:05:02.849921892Z [2024-05-25 23:05:02,849: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:05:02.853223485Z [2024-05-25 23:05:02,852: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:02.918324980Z [2024-05-25 23:05:02,918: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:05:02.919935601Z [2024-05-25 23:05:02,919: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:02.919952236Z [2024-05-25 23:05:02,919: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:02.920064665Z [2024-05-25 23:05:02,919: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:02.920092457Z [2024-05-25 23:05:02,920: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:05:02.920300904Z [2024-05-25 23:05:02,920: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:05:02.920328805Z [2024-05-25 23:05:02,920: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:03.025644810Z [2024-05-25 23:05:03,025: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:05:03.152411353Z [2024-05-25 23:05:03,152: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:05:03.163610932Z [2024-05-25 23:05:03,162: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:03.256045963Z [2024-05-25 23:05:03,255: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:05:03.261194694Z [2024-05-25 23:05:03,260: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:03.261334472Z [2024-05-25 23:05:03,261: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:03.261543596Z [2024-05-25 23:05:03,261: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:03.261693623Z [2024-05-25 23:05:03,261: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:05:03.261996269Z [2024-05-25 23:05:03,261: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:05:03.262504806Z [2024-05-25 23:05:03,261: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:03.381651456Z [2024-05-25 23:05:03,380: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-25T23:05:03.382201836Z [2024-05-25 23:05:03,382: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:05:03.393965650Z [2024-05-25 23:05:03,393: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:03.485415260Z [2024-05-25 23:05:03,483: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-25T23:05:03.485875714Z [2024-05-25 23:05:03,485: INFO/ForkPoolWorker-4] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:03.485887428Z [2024-05-25 23:05:03,485: INFO/ForkPoolWorker-4] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:03.485891303Z [2024-05-25 23:05:03,485: INFO/ForkPoolWorker-4] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:03.485895445Z [2024-05-25 23:05:03,485: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-25T23:05:03.486051796Z [2024-05-25 23:05:03,485: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:05:03.486325935Z [2024-05-25 23:05:03,486: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:03.494255086Z [2024-05-25 23:05:03,494: WARNING/ForkPoolWorker-4] Dag 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:05:03.495056702Z [2024-05-25 23:05:03,494: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:05:03.498449360Z [2024-05-25 23:05:03,498: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-25T23:05:03.508248517Z [2024-05-25 23:05:03,503: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:03.550393921Z [2024-05-25 23:05:03,550: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-25T23:05:03.551690241Z [2024-05-25 23:05:03,551: INFO/ForkPoolWorker-4] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:03.551705154Z [2024-05-25 23:05:03,551: INFO/ForkPoolWorker-4] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:03.551822790Z [2024-05-25 23:05:03,551: INFO/ForkPoolWorker-4] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:03.551843152Z [2024-05-25 23:05:03,551: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-25T23:05:03.552040749Z [2024-05-25 23:05:03,551: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:05:03.552049777Z [2024-05-25 23:05:03,552: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:03.559008486Z [2024-05-25 23:05:03,557: ERROR/ForkPoolWorker-4] [23ed456f-7b07-498b-bacb-66e08c4d45fa] Failed to execute task Dag 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse.. 2024-05-25T23:05:03.559023815Z Traceback (most recent call last): 2024-05-25T23:05:03.559027926Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T23:05:03.559031939Z args.func(args) 2024-05-25T23:05:03.559035652Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T23:05:03.559039247Z return func(*args, **kwargs) 2024-05-25T23:05:03.559042208Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T23:05:03.559069360Z return f(*args, **kwargs) 2024-05-25T23:05:03.559073058Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T23:05:03.559076136Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T23:05:03.559079065Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T23:05:03.559085757Z raise AirflowException( 2024-05-25T23:05:03.559089808Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse. 2024-05-25T23:05:03.615969769Z [2024-05-25 23:05:03,615: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[23ed456f-7b07-498b-bacb-66e08c4d45fa] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 23ed456f-7b07-498b-bacb-66e08c4d45fa') 2024-05-25T23:05:03.615988780Z Traceback (most recent call last): 2024-05-25T23:05:03.615993135Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T23:05:03.615996218Z R = retval = fun(*args, **kwargs) 2024-05-25T23:05:03.615999298Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T23:05:03.616002944Z return self.run(*args, **kwargs) 2024-05-25T23:05:03.616006566Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T23:05:03.616009939Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T23:05:03.616012810Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T23:05:03.616016725Z raise AirflowException(msg) 2024-05-25T23:05:03.616020201Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 23ed456f-7b07-498b-bacb-66e08c4d45fa 2024-05-25T23:05:03.885044550Z [2024-05-25 23:05:03,884: INFO/ForkPoolWorker-5] Getting VIM list 2024-05-25T23:05:03.888560384Z [2024-05-25 23:05:03,888: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:03.910886974Z [2024-05-25 23:05:03,910: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-25T23:05:03.912465026Z [2024-05-25 23:05:03,912: INFO/ForkPoolWorker-5] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:03.912595246Z [2024-05-25 23:05:03,912: INFO/ForkPoolWorker-5] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:03.912817839Z [2024-05-25 23:05:03,912: INFO/ForkPoolWorker-5] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:03.912939592Z [2024-05-25 23:05:03,912: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-05-25T23:05:03.913206279Z [2024-05-25 23:05:03,913: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:05:03.913327214Z [2024-05-25 23:05:03,913: INFO/ForkPoolWorker-5] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:03.993743136Z [2024-05-25 23:05:03,993: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:05:04.124702000Z [2024-05-25 23:05:04,124: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[275ca559-2e60-4056-a5e1-c51bd6e75204] succeeded in 3.5955715099998997s: None 2024-05-25T23:05:04.406797110Z [2024-05-25 23:05:04,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5585b7ac-7dd8-4464-8a3a-7c3094a84951] received 2024-05-25T23:05:04.421027278Z [2024-05-25 23:05:04,420: INFO/ForkPoolWorker-16] [5585b7ac-7dd8-4464-8a3a-7c3094a84951] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:04.596165398Z [2024-05-25 23:05:04,595: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T23:05:04.599280653Z [2024-05-25 23:05:04,598: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:04.619427415Z [2024-05-25 23:05:04,619: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T23:05:04.620609404Z [2024-05-25 23:05:04,620: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:04.620709739Z [2024-05-25 23:05:04,620: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:04.621095024Z [2024-05-25 23:05:04,620: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:04.621445775Z [2024-05-25 23:05:04,621: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T23:05:04.621705602Z [2024-05-25 23:05:04,621: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:05:04.622056410Z [2024-05-25 23:05:04,621: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:04.628520980Z [2024-05-25 23:05:04,628: WARNING/ForkPoolWorker-3] Dag 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:05:04.629568908Z [2024-05-25 23:05:04,628: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:05:04.630584463Z [2024-05-25 23:05:04,630: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T23:05:04.633175878Z [2024-05-25 23:05:04,632: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:04.647899189Z [2024-05-25 23:05:04,647: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:05:04.652591169Z [2024-05-25 23:05:04,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:04.680274307Z [2024-05-25 23:05:04,680: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:05:04.681337949Z [2024-05-25 23:05:04,681: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T23:05:04.681768578Z [2024-05-25 23:05:04,681: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:04.681855561Z [2024-05-25 23:05:04,681: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:04.682053220Z [2024-05-25 23:05:04,681: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:04.682143417Z [2024-05-25 23:05:04,682: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:05:04.682652450Z [2024-05-25 23:05:04,682: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:05:04.682735830Z [2024-05-25 23:05:04,682: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:04.690303984Z [2024-05-25 23:05:04,690: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:04.691635357Z [2024-05-25 23:05:04,691: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:04.694015338Z [2024-05-25 23:05:04,691: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:04.694253688Z [2024-05-25 23:05:04,694: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:04.695158946Z [2024-05-25 23:05:04,694: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:05:04.695953621Z [2024-05-25 23:05:04,695: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:04.696652387Z [2024-05-25 23:05:04,696: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T23:05:04.699783179Z [2024-05-25 23:05:04,699: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:05:04.699912232Z [2024-05-25 23:05:04,699: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:04.700287285Z [2024-05-25 23:05:04,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:04.712909178Z [2024-05-25 23:05:04,707: ERROR/ForkPoolWorker-3] [37e82c45-c184-445a-b9db-6d60f0389686] Failed to execute task Dag 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse.. 2024-05-25T23:05:04.712922216Z Traceback (most recent call last): 2024-05-25T23:05:04.712926184Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T23:05:04.712929763Z args.func(args) 2024-05-25T23:05:04.712933502Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T23:05:04.712936990Z return func(*args, **kwargs) 2024-05-25T23:05:04.712939994Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T23:05:04.712942986Z return f(*args, **kwargs) 2024-05-25T23:05:04.712946299Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T23:05:04.712949434Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T23:05:04.712952353Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T23:05:04.712955314Z raise AirflowException( 2024-05-25T23:05:04.712958843Z airflow.exceptions.AirflowException: Dag 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse. 2024-05-25T23:05:04.724274938Z [2024-05-25 23:05:04,724: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:05:04.725741400Z [2024-05-25 23:05:04,725: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:04.725864753Z [2024-05-25 23:05:04,725: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:04.726067874Z [2024-05-25 23:05:04,725: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:04.726144756Z [2024-05-25 23:05:04,726: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:05:04.726420125Z [2024-05-25 23:05:04,726: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:05:04.726797554Z [2024-05-25 23:05:04,726: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:04.730420856Z [2024-05-25 23:05:04,729: ERROR/ForkPoolWorker-15] [9ace8abc-c800-4d09-aae1-b5f7510e454a] Failed to execute task Dag 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse.. 2024-05-25T23:05:04.730435532Z Traceback (most recent call last): 2024-05-25T23:05:04.730439538Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T23:05:04.730443069Z args.func(args) 2024-05-25T23:05:04.730446615Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T23:05:04.730450694Z return func(*args, **kwargs) 2024-05-25T23:05:04.730453658Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T23:05:04.730470278Z return f(*args, **kwargs) 2024-05-25T23:05:04.730473280Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T23:05:04.730476218Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T23:05:04.730479123Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T23:05:04.730482293Z raise AirflowException( 2024-05-25T23:05:04.730485828Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse. 2024-05-25T23:05:04.813517523Z [2024-05-25 23:05:04,813: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[37e82c45-c184-445a-b9db-6d60f0389686] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 37e82c45-c184-445a-b9db-6d60f0389686') 2024-05-25T23:05:04.813531349Z Traceback (most recent call last): 2024-05-25T23:05:04.813535390Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T23:05:04.813538669Z R = retval = fun(*args, **kwargs) 2024-05-25T23:05:04.813541759Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T23:05:04.813544857Z return self.run(*args, **kwargs) 2024-05-25T23:05:04.813548571Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T23:05:04.813555983Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T23:05:04.813559117Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T23:05:04.813563294Z raise AirflowException(msg) 2024-05-25T23:05:04.813577580Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 37e82c45-c184-445a-b9db-6d60f0389686 2024-05-25T23:05:04.819750242Z [2024-05-25 23:05:04,819: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ace8abc-c800-4d09-aae1-b5f7510e454a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9ace8abc-c800-4d09-aae1-b5f7510e454a') 2024-05-25T23:05:04.819765399Z Traceback (most recent call last): 2024-05-25T23:05:04.819769259Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T23:05:04.819772527Z R = retval = fun(*args, **kwargs) 2024-05-25T23:05:04.819775554Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T23:05:04.819778683Z return self.run(*args, **kwargs) 2024-05-25T23:05:04.819782222Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T23:05:04.819785871Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T23:05:04.819788790Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T23:05:04.819792052Z raise AirflowException(msg) 2024-05-25T23:05:04.819795434Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9ace8abc-c800-4d09-aae1-b5f7510e454a 2024-05-25T23:05:05.008295768Z [2024-05-25 23:05:05,005: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:05.700408344Z [2024-05-25 23:05:05,700: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fec64b02-33a6-456f-81d4-2b12367ca65d] succeeded in 5.175958719999926s: None 2024-05-25T23:05:05.914102347Z [2024-05-25 23:05:05,913: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[350c5551-8f0d-429e-b82f-a5ab48450c52] succeeded in 5.357333326000116s: None 2024-05-25T23:05:06.605969485Z [2024-05-25 23:05:06,605: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:05:06.610033905Z [2024-05-25 23:05:06,609: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:06.649136715Z [2024-05-25 23:05:06,648: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:05:06.653622869Z [2024-05-25 23:05:06,653: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:06.653830144Z [2024-05-25 23:05:06,653: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:06.654165365Z [2024-05-25 23:05:06,653: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:06.654367480Z [2024-05-25 23:05:06,654: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:05:06.654855337Z [2024-05-25 23:05:06,654: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:05:06.655030216Z [2024-05-25 23:05:06,654: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:06.774681332Z [2024-05-25 23:05:06,774: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:05:07.528045141Z [2024-05-25 23:05:07,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5585b7ac-7dd8-4464-8a3a-7c3094a84951] succeeded in 3.119431230000373s: None 2024-05-25T23:05:08.474083518Z [2024-05-25 23:05:08,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f907e41-69e7-4144-b607-e92befe32cd7] received 2024-05-25T23:05:08.493894231Z [2024-05-25 23:05:08,493: INFO/ForkPoolWorker-15] [7f907e41-69e7-4144-b607-e92befe32cd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:05:08.762919080Z [2024-05-25 23:05:08,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:09.827485805Z [2024-05-25 23:05:09,826: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:05:09.830474815Z [2024-05-25 23:05:09,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:09.852137204Z [2024-05-25 23:05:09,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:05:09.853489798Z [2024-05-25 23:05:09,853: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:09.853535911Z [2024-05-25 23:05:09,853: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:09.853730273Z [2024-05-25 23:05:09,853: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:09.853745274Z [2024-05-25 23:05:09,853: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:05:09.854007884Z [2024-05-25 23:05:09,853: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:05:09.854042946Z [2024-05-25 23:05:09,853: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:09.962759839Z [2024-05-25 23:05:09,962: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:05:11.485882161Z [2024-05-25 23:05:11,485: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f907e41-69e7-4144-b607-e92befe32cd7] succeeded in 3.009251580000182s: None 2024-05-25T23:05:12.386192154Z [2024-05-25 23:05:12,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93bd3ef2-2c60-4767-94a4-227e75a44d12] received 2024-05-25T23:05:12.394557374Z [2024-05-25 23:05:12,394: INFO/ForkPoolWorker-15] [93bd3ef2-2c60-4767-94a4-227e75a44d12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:12.689105716Z [2024-05-25 23:05:12,686: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:13.846498357Z [2024-05-25 23:05:13,845: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:05:13.849583934Z [2024-05-25 23:05:13,849: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:13.878179898Z [2024-05-25 23:05:13,877: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:05:13.879889743Z [2024-05-25 23:05:13,879: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:13.880009497Z [2024-05-25 23:05:13,879: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:13.880296149Z [2024-05-25 23:05:13,880: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:13.880433585Z [2024-05-25 23:05:13,880: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:05:13.880802656Z [2024-05-25 23:05:13,880: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:05:13.880979537Z [2024-05-25 23:05:13,880: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:13.996118687Z [2024-05-25 23:05:13,995: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:05:14.649756278Z [2024-05-25 23:05:14,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93bd3ef2-2c60-4767-94a4-227e75a44d12] succeeded in 2.2616318769996724s: None 2024-05-25T23:05:15.485500367Z [2024-05-25 23:05:15,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71c27f76-7650-4ac3-961d-dae38f8bcaf2] received 2024-05-25T23:05:15.503298797Z [2024-05-25 23:05:15,503: INFO/ForkPoolWorker-15] [71c27f76-7650-4ac3-961d-dae38f8bcaf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:05:15.920694799Z [2024-05-25 23:05:15,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:05:16.392067558Z [2024-05-25 23:05:16,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f984f08-9bd8-49b7-827e-d136734aafac] received 2024-05-25T23:05:16.399791068Z [2024-05-25 23:05:16,399: INFO/ForkPoolWorker-16] [2f984f08-9bd8-49b7-827e-d136734aafac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:16.403302054Z [2024-05-25 23:05:16,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e6a627c-395e-4253-b76a-5e864c87eb37] received 2024-05-25T23:05:16.409976632Z [2024-05-25 23:05:16,409: INFO/ForkPoolWorker-1] [2e6a627c-395e-4253-b76a-5e864c87eb37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:05:16.738363826Z [2024-05-25 23:05:16,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:05:16.769939619Z [2024-05-25 23:05:16,766: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:17.139339567Z [2024-05-25 23:05:17,138: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:05:17.144160223Z [2024-05-25 23:05:17,143: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:17.169021838Z [2024-05-25 23:05:17,168: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:05:17.170436432Z [2024-05-25 23:05:17,170: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:17.170460477Z [2024-05-25 23:05:17,170: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:17.170640949Z [2024-05-25 23:05:17,170: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:17.170656982Z [2024-05-25 23:05:17,170: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:05:17.170944421Z [2024-05-25 23:05:17,170: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:05:17.170959005Z [2024-05-25 23:05:17,170: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:17.179734797Z [2024-05-25 23:05:17,179: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:05:17.181076729Z [2024-05-25 23:05:17,179: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:05:17.181832292Z [2024-05-25 23:05:17,181: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:05:17.184552565Z [2024-05-25 23:05:17,184: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:17.200419988Z [2024-05-25 23:05:17,200: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:05:17.202510888Z [2024-05-25 23:05:17,202: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:17.202533588Z [2024-05-25 23:05:17,202: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:17.202622351Z [2024-05-25 23:05:17,202: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:17.202657408Z [2024-05-25 23:05:17,202: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:05:17.202896785Z [2024-05-25 23:05:17,202: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:05:17.202908204Z [2024-05-25 23:05:17,202: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:17.207029611Z [2024-05-25 23:05:17,206: ERROR/ForkPoolWorker-15] [71c27f76-7650-4ac3-961d-dae38f8bcaf2] Failed to execute task Dag 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse.. 2024-05-25T23:05:17.207046039Z Traceback (most recent call last): 2024-05-25T23:05:17.207050428Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T23:05:17.207054596Z args.func(args) 2024-05-25T23:05:17.207058568Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T23:05:17.207062884Z return func(*args, **kwargs) 2024-05-25T23:05:17.207066215Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T23:05:17.207069700Z return f(*args, **kwargs) 2024-05-25T23:05:17.207073021Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T23:05:17.207076333Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T23:05:17.207079939Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T23:05:17.207083588Z raise AirflowException( 2024-05-25T23:05:17.207088119Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse. 2024-05-25T23:05:17.242667468Z [2024-05-25 23:05:17,242: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71c27f76-7650-4ac3-961d-dae38f8bcaf2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 71c27f76-7650-4ac3-961d-dae38f8bcaf2') 2024-05-25T23:05:17.242712976Z Traceback (most recent call last): 2024-05-25T23:05:17.242736462Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T23:05:17.242742780Z R = retval = fun(*args, **kwargs) 2024-05-25T23:05:17.242747765Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T23:05:17.242752221Z return self.run(*args, **kwargs) 2024-05-25T23:05:17.242757177Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T23:05:17.242763297Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T23:05:17.242768384Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T23:05:17.242773817Z raise AirflowException(msg) 2024-05-25T23:05:17.242779324Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 71c27f76-7650-4ac3-961d-dae38f8bcaf2 2024-05-25T23:05:17.983707020Z [2024-05-25 23:05:17,983: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:05:17.986968894Z [2024-05-25 23:05:17,986: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:17.991293622Z [2024-05-25 23:05:17,990: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:05:17.995590638Z [2024-05-25 23:05:17,995: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:18.008185239Z [2024-05-25 23:05:18,007: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:05:18.009670970Z [2024-05-25 23:05:18,009: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:18.009682770Z [2024-05-25 23:05:18,009: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:18.009942518Z [2024-05-25 23:05:18,009: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:18.009951565Z [2024-05-25 23:05:18,009: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:05:18.010090052Z [2024-05-25 23:05:18,009: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:05:18.010097143Z [2024-05-25 23:05:18,010: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:18.018852327Z [2024-05-25 23:05:18,018: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:18.019391084Z [2024-05-25 23:05:18,018: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:05:18.020304293Z [2024-05-25 23:05:18,020: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:05:18.022763784Z [2024-05-25 23:05:18,022: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:18.034360683Z [2024-05-25 23:05:18,034: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:05:18.034954570Z [2024-05-25 23:05:18,034: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:05:18.036094097Z [2024-05-25 23:05:18,035: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:18.036108868Z [2024-05-25 23:05:18,035: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:18.036229567Z [2024-05-25 23:05:18,036: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:18.036236763Z [2024-05-25 23:05:18,036: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:05:18.036432522Z [2024-05-25 23:05:18,036: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:05:18.036439831Z [2024-05-25 23:05:18,035: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:18.036449148Z [2024-05-25 23:05:18,036: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:18.036802838Z [2024-05-25 23:05:18,036: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:18.037078109Z [2024-05-25 23:05:18,036: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:18.037280604Z [2024-05-25 23:05:18,037: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:05:18.037814536Z [2024-05-25 23:05:18,037: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:05:18.038033656Z [2024-05-25 23:05:18,037: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:18.040073228Z [2024-05-25 23:05:18,039: ERROR/ForkPoolWorker-16] [2f984f08-9bd8-49b7-827e-d136734aafac] Failed to execute task Dag 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse.. 2024-05-25T23:05:18.040093013Z Traceback (most recent call last): 2024-05-25T23:05:18.040098218Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T23:05:18.040103063Z args.func(args) 2024-05-25T23:05:18.040107696Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T23:05:18.040112486Z return func(*args, **kwargs) 2024-05-25T23:05:18.040163099Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T23:05:18.040168478Z return f(*args, **kwargs) 2024-05-25T23:05:18.040173089Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T23:05:18.040177526Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T23:05:18.040181745Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T23:05:18.040186083Z raise AirflowException( 2024-05-25T23:05:18.040191149Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse. 2024-05-25T23:05:18.045592601Z [2024-05-25 23:05:18,045: WARNING/ForkPoolWorker-1] Dag 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:05:18.047894859Z [2024-05-25 23:05:18,047: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:05:18.049103583Z [2024-05-25 23:05:18,048: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:05:18.052588746Z [2024-05-25 23:05:18,051: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:05:18.065086911Z [2024-05-25 23:05:18,064: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:05:18.071476276Z [2024-05-25 23:05:18,071: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:05:18.071489495Z [2024-05-25 23:05:18,071: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:05:18.071715534Z [2024-05-25 23:05:18,071: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:05:18.071877117Z [2024-05-25 23:05:18,071: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:05:18.072545321Z [2024-05-25 23:05:18,072: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:05:18.073079396Z [2024-05-25 23:05:18,072: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:05:18.076427355Z [2024-05-25 23:05:18,075: ERROR/ForkPoolWorker-1] [2e6a627c-395e-4253-b76a-5e864c87eb37] Failed to execute task Dag 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse.. 2024-05-25T23:05:18.076440301Z Traceback (most recent call last): 2024-05-25T23:05:18.076444114Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T23:05:18.076447950Z args.func(args) 2024-05-25T23:05:18.076451772Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T23:05:18.076455519Z return func(*args, **kwargs) 2024-05-25T23:05:18.076458516Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T23:05:18.076461653Z return f(*args, **kwargs) 2024-05-25T23:05:18.076464579Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T23:05:18.076467527Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T23:05:18.076470414Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T23:05:18.076473296Z raise AirflowException( 2024-05-25T23:05:18.076489178Z airflow.exceptions.AirflowException: Dag 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89' could not be found; either it does not exist or it failed to parse. 2024-05-25T23:05:18.080546620Z [2024-05-25 23:05:18,080: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f984f08-9bd8-49b7-827e-d136734aafac] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2f984f08-9bd8-49b7-827e-d136734aafac') 2024-05-25T23:05:18.080571872Z Traceback (most recent call last): 2024-05-25T23:05:18.080575573Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T23:05:18.080578606Z R = retval = fun(*args, **kwargs) 2024-05-25T23:05:18.080581504Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T23:05:18.080584474Z return self.run(*args, **kwargs) 2024-05-25T23:05:18.080588160Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T23:05:18.080591724Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T23:05:18.080621672Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T23:05:18.080626228Z raise AirflowException(msg) 2024-05-25T23:05:18.080646136Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2f984f08-9bd8-49b7-827e-d136734aafac 2024-05-25T23:05:18.112258923Z [2024-05-25 23:05:18,111: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e6a627c-395e-4253-b76a-5e864c87eb37] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2e6a627c-395e-4253-b76a-5e864c87eb37') 2024-05-25T23:05:18.112307807Z Traceback (most recent call last): 2024-05-25T23:05:18.112316450Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T23:05:18.112322636Z R = retval = fun(*args, **kwargs) 2024-05-25T23:05:18.112328397Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T23:05:18.112334434Z return self.run(*args, **kwargs) 2024-05-25T23:05:18.112340932Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T23:05:18.112347570Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T23:05:18.112353585Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T23:05:18.112359921Z raise AirflowException(msg) 2024-05-25T23:05:18.112397109Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2e6a627c-395e-4253-b76a-5e864c87eb37 2024-05-25T23:06:00.598926084Z [2024-05-25 23:06:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa5069de-250e-4464-a991-d011922cf9dd] received 2024-05-25T23:06:00.602057814Z [2024-05-25 23:06:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[355ad80d-f67a-4cbd-b8cf-0a2c3fbb3440] received 2024-05-25T23:06:00.609831712Z [2024-05-25 23:06:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54014c9f-713f-4161-9486-202db7e84c35] received 2024-05-25T23:06:00.616168797Z [2024-05-25 23:06:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdf12232-f8a0-4fcb-a8f8-1c58b1047b05] received 2024-05-25T23:06:00.625191283Z [2024-05-25 23:06:00,624: INFO/ForkPoolWorker-15] [aa5069de-250e-4464-a991-d011922cf9dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:06:00.632019935Z [2024-05-25 23:06:00,631: INFO/ForkPoolWorker-1] [54014c9f-713f-4161-9486-202db7e84c35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:06:00.632379184Z [2024-05-25 23:06:00,632: INFO/ForkPoolWorker-16] [355ad80d-f67a-4cbd-b8cf-0a2c3fbb3440] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:06:00.638946069Z [2024-05-25 23:06:00,638: INFO/ForkPoolWorker-2] [cdf12232-f8a0-4fcb-a8f8-1c58b1047b05] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:06:01.019674939Z [2024-05-25 23:06:01,016: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:06:01.020108361Z [2024-05-25 23:06:01,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:06:01.037528704Z [2024-05-25 23:06:01,033: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:06:01.087578361Z [2024-05-25 23:06:01,083: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:06:01.251429190Z [2024-05-25 23:06:01,250: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:06:01.256274811Z [2024-05-25 23:06:01,255: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:06:01.296199311Z [2024-05-25 23:06:01,295: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:06:01.298976030Z [2024-05-25 23:06:01,298: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:06:01.300235392Z [2024-05-25 23:06:01,300: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:06:01.300424617Z [2024-05-25 23:06:01,300: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:06:01.300452026Z [2024-05-25 23:06:01,300: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:06:01.300751779Z [2024-05-25 23:06:01,300: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:06:01.409125474Z [2024-05-25 23:06:01,408: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:06:01.883021218Z [2024-05-25 23:06:01,882: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa5069de-250e-4464-a991-d011922cf9dd] succeeded in 1.2815317740000864s: None 2024-05-25T23:06:02.047122833Z [2024-05-25 23:06:02,046: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cdf12232-f8a0-4fcb-a8f8-1c58b1047b05] succeeded in 1.4285241669999778s: None 2024-05-25T23:06:02.325809979Z [2024-05-25 23:06:02,325: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:06:02.329149614Z [2024-05-25 23:06:02,328: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:06:02.353083657Z [2024-05-25 23:06:02,352: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:06:02.354555454Z [2024-05-25 23:06:02,354: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:06:02.354756051Z [2024-05-25 23:06:02,354: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:06:02.355021955Z [2024-05-25 23:06:02,354: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:06:02.355180297Z [2024-05-25 23:06:02,355: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:06:02.355573009Z [2024-05-25 23:06:02,355: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:06:02.355841049Z [2024-05-25 23:06:02,355: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:06:02.362967829Z [2024-05-25 23:06:02,362: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:06:02.366297819Z [2024-05-25 23:06:02,365: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:06:02.384770885Z [2024-05-25 23:06:02,384: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:06:02.386326322Z [2024-05-25 23:06:02,386: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:06:02.386354030Z [2024-05-25 23:06:02,386: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:06:02.386402127Z [2024-05-25 23:06:02,386: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:06:02.386566016Z [2024-05-25 23:06:02,386: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:06:02.386768789Z [2024-05-25 23:06:02,386: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:06:02.386826589Z [2024-05-25 23:06:02,386: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:06:02.440440874Z [2024-05-25 23:06:02,439: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:06:02.482644253Z [2024-05-25 23:06:02,482: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:06:03.881672475Z [2024-05-25 23:06:03,881: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[54014c9f-713f-4161-9486-202db7e84c35] succeeded in 3.26896031699971s: None 2024-05-25T23:06:04.598306728Z [2024-05-25 23:06:04,597: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[355ad80d-f67a-4cbd-b8cf-0a2c3fbb3440] succeeded in 3.9917293379999137s: None 2024-05-25T23:07:00.446630408Z [2024-05-25 23:07:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50f6a00d-7983-452e-843c-319bb156c707] received 2024-05-25T23:07:00.461470534Z [2024-05-25 23:07:00,461: INFO/ForkPoolWorker-15] [50f6a00d-7983-452e-843c-319bb156c707] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:07:00.481595811Z [2024-05-25 23:07:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fef0717-5235-403f-b3e4-109c939491b7] received 2024-05-25T23:07:00.490736034Z [2024-05-25 23:07:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b90e8bb4-fa6b-48dd-ab03-0bf86ffdd36e] received 2024-05-25T23:07:00.498496223Z [2024-05-25 23:07:00,498: INFO/ForkPoolWorker-16] [4fef0717-5235-403f-b3e4-109c939491b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:07:00.505139065Z [2024-05-25 23:07:00,504: INFO/ForkPoolWorker-1] [b90e8bb4-fa6b-48dd-ab03-0bf86ffdd36e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:07:00.873712143Z [2024-05-25 23:07:00,869: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:07:00.909605280Z [2024-05-25 23:07:00,904: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:07:00.922353795Z [2024-05-25 23:07:00,917: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:07:01.150904102Z [2024-05-25 23:07:01,150: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:07:01.157267371Z [2024-05-25 23:07:01,156: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:07:01.195104583Z [2024-05-25 23:07:01,194: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:07:01.196323445Z [2024-05-25 23:07:01,196: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:07:01.196462479Z [2024-05-25 23:07:01,196: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:07:01.196565343Z [2024-05-25 23:07:01,196: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:07:01.197069174Z [2024-05-25 23:07:01,196: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:07:01.296476729Z [2024-05-25 23:07:01,296: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:07:01.992623904Z [2024-05-25 23:07:01,992: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fef0717-5235-403f-b3e4-109c939491b7] succeeded in 1.5069839410002714s: None 2024-05-25T23:07:02.277162288Z [2024-05-25 23:07:02,276: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:07:02.280393701Z [2024-05-25 23:07:02,279: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:07:02.308952585Z [2024-05-25 23:07:02,308: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:07:02.310105639Z [2024-05-25 23:07:02,309: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:07:02.310124961Z [2024-05-25 23:07:02,310: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:07:02.310281944Z [2024-05-25 23:07:02,310: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:07:02.310408950Z [2024-05-25 23:07:02,310: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:07:02.311397366Z [2024-05-25 23:07:02,311: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:07:02.311566209Z [2024-05-25 23:07:02,311: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:07:02.409171192Z [2024-05-25 23:07:02,408: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:07:02.413450035Z [2024-05-25 23:07:02,413: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:07:02.416856670Z [2024-05-25 23:07:02,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:07:02.444058177Z [2024-05-25 23:07:02,443: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:07:02.451346778Z [2024-05-25 23:07:02,451: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:07:02.451386223Z [2024-05-25 23:07:02,451: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:07:02.451454340Z [2024-05-25 23:07:02,451: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:07:02.451472965Z [2024-05-25 23:07:02,451: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:07:02.451795192Z [2024-05-25 23:07:02,451: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:07:02.451802550Z [2024-05-25 23:07:02,451: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:07:02.555378316Z [2024-05-25 23:07:02,555: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:07:04.299546966Z [2024-05-25 23:07:04,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50f6a00d-7983-452e-843c-319bb156c707] succeeded in 3.847076639000079s: None 2024-05-25T23:07:04.840515676Z [2024-05-25 23:07:04,840: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b90e8bb4-fa6b-48dd-ab03-0bf86ffdd36e] succeeded in 4.347032522000063s: None 2024-05-25T23:08:00.451606629Z [2024-05-25 23:08:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d887065d-5eff-429e-bc74-1c63d67fbfd2] received 2024-05-25T23:08:00.455586686Z [2024-05-25 23:08:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14539b88-2c2f-4543-92dd-d4725255d570] received 2024-05-25T23:08:00.463014289Z [2024-05-25 23:08:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa4aba12-1ff3-463d-93c3-d33dbec843d4] received 2024-05-25T23:08:00.464479785Z [2024-05-25 23:08:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1c4a5e1-216e-47d5-9381-d2eb111a2294] received 2024-05-25T23:08:00.479066653Z [2024-05-25 23:08:00,478: INFO/ForkPoolWorker-15] [d887065d-5eff-429e-bc74-1c63d67fbfd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:08:00.480985122Z [2024-05-25 23:08:00,480: INFO/ForkPoolWorker-1] [fa4aba12-1ff3-463d-93c3-d33dbec843d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:08:00.481479415Z [2024-05-25 23:08:00,481: INFO/ForkPoolWorker-2] [f1c4a5e1-216e-47d5-9381-d2eb111a2294] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:08:00.482847992Z [2024-05-25 23:08:00,482: INFO/ForkPoolWorker-16] [14539b88-2c2f-4543-92dd-d4725255d570] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:08:00.820202379Z [2024-05-25 23:08:00,815: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:08:00.839999313Z [2024-05-25 23:08:00,836: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:08:00.902606800Z [2024-05-25 23:08:00,898: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:08:00.910425853Z [2024-05-25 23:08:00,906: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:08:01.065757245Z [2024-05-25 23:08:01,065: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:08:01.069673995Z [2024-05-25 23:08:01,069: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:08:01.099500422Z [2024-05-25 23:08:01,099: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:08:01.102447225Z [2024-05-25 23:08:01,102: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:08:01.103880859Z [2024-05-25 23:08:01,103: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:08:01.104033699Z [2024-05-25 23:08:01,103: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:08:01.104205968Z [2024-05-25 23:08:01,104: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:08:01.104380967Z [2024-05-25 23:08:01,104: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:08:01.243254381Z [2024-05-25 23:08:01,243: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:08:01.690318560Z [2024-05-25 23:08:01,689: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d887065d-5eff-429e-bc74-1c63d67fbfd2] succeeded in 1.232643156999984s: None 2024-05-25T23:08:01.972713005Z [2024-05-25 23:08:01,972: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f1c4a5e1-216e-47d5-9381-d2eb111a2294] succeeded in 1.5056478329997844s: None 2024-05-25T23:08:02.068040954Z [2024-05-25 23:08:02,067: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:08:02.071306393Z [2024-05-25 23:08:02,070: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:08:02.087204603Z [2024-05-25 23:08:02,087: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:08:02.088460650Z [2024-05-25 23:08:02,088: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:08:02.088571653Z [2024-05-25 23:08:02,088: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:08:02.088770624Z [2024-05-25 23:08:02,088: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:08:02.088871006Z [2024-05-25 23:08:02,088: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:08:02.089122625Z [2024-05-25 23:08:02,089: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:08:02.089235637Z [2024-05-25 23:08:02,089: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:08:02.147289452Z [2024-05-25 23:08:02,146: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:08:02.151589176Z [2024-05-25 23:08:02,151: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:08:02.173041457Z [2024-05-25 23:08:02,172: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:08:02.173728323Z [2024-05-25 23:08:02,173: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:08:02.175270910Z [2024-05-25 23:08:02,175: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:08:02.175585357Z [2024-05-25 23:08:02,175: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:08:02.175907687Z [2024-05-25 23:08:02,175: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:08:02.176152814Z [2024-05-25 23:08:02,176: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:08:02.177121373Z [2024-05-25 23:08:02,176: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:08:02.177301955Z [2024-05-25 23:08:02,177: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:08:02.273930637Z [2024-05-25 23:08:02,273: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:08:03.803471369Z [2024-05-25 23:08:03,803: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fa4aba12-1ff3-463d-93c3-d33dbec843d4] succeeded in 3.3369264130001284s: None 2024-05-25T23:08:04.012255655Z [2024-05-25 23:08:04,011: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[14539b88-2c2f-4543-92dd-d4725255d570] succeeded in 3.553944409000451s: None 2024-05-25T23:09:00.267386217Z [2024-05-25 23:09:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e71d16a-a374-483b-a2f8-f5bc2d032931] received 2024-05-25T23:09:00.272160705Z [2024-05-25 23:09:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[534ad87a-97db-4cb5-961d-a999241442e8] received 2024-05-25T23:09:00.283038493Z [2024-05-25 23:09:00,282: INFO/ForkPoolWorker-15] [9e71d16a-a374-483b-a2f8-f5bc2d032931] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:09:00.286914438Z [2024-05-25 23:09:00,286: INFO/ForkPoolWorker-16] [534ad87a-97db-4cb5-961d-a999241442e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:09:00.287919288Z [2024-05-25 23:09:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3f47169-ca12-42f2-b502-1caa752f984e] received 2024-05-25T23:09:00.297730970Z [2024-05-25 23:09:00,297: INFO/ForkPoolWorker-1] [e3f47169-ca12-42f2-b502-1caa752f984e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:09:00.599171091Z [2024-05-25 23:09:00,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:09:00.611474189Z [2024-05-25 23:09:00,607: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:09:00.665114825Z [2024-05-25 23:09:00,657: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:09:00.869533280Z [2024-05-25 23:09:00,869: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:09:00.874321727Z [2024-05-25 23:09:00,873: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:09:00.903254855Z [2024-05-25 23:09:00,903: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:09:00.904594049Z [2024-05-25 23:09:00,904: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:09:00.904785730Z [2024-05-25 23:09:00,904: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:09:00.904888099Z [2024-05-25 23:09:00,904: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:09:00.905182023Z [2024-05-25 23:09:00,905: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:09:01.019001297Z [2024-05-25 23:09:01,018: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:09:01.642054579Z [2024-05-25 23:09:01,641: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e3f47169-ca12-42f2-b502-1caa752f984e] succeeded in 1.3514037729996744s: None 2024-05-25T23:09:01.848171781Z [2024-05-25 23:09:01,847: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:09:01.851557414Z [2024-05-25 23:09:01,850: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:09:01.859755967Z [2024-05-25 23:09:01,859: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:09:01.863272966Z [2024-05-25 23:09:01,862: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:09:01.872296720Z [2024-05-25 23:09:01,872: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:09:01.873850307Z [2024-05-25 23:09:01,873: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:09:01.873874967Z [2024-05-25 23:09:01,873: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:09:01.873884926Z [2024-05-25 23:09:01,873: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:09:01.874015129Z [2024-05-25 23:09:01,873: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:09:01.874385371Z [2024-05-25 23:09:01,874: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:09:01.874623134Z [2024-05-25 23:09:01,874: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:09:01.880390804Z [2024-05-25 23:09:01,880: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:09:01.881585219Z [2024-05-25 23:09:01,881: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:09:01.881599300Z [2024-05-25 23:09:01,881: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:09:01.881806385Z [2024-05-25 23:09:01,881: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:09:01.881820457Z [2024-05-25 23:09:01,881: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:09:01.882109691Z [2024-05-25 23:09:01,881: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:09:01.882121203Z [2024-05-25 23:09:01,882: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:09:01.954372231Z [2024-05-25 23:09:01,954: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:09:01.976166045Z [2024-05-25 23:09:01,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:09:03.462591136Z [2024-05-25 23:09:03,462: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e71d16a-a374-483b-a2f8-f5bc2d032931] succeeded in 3.1873486230001618s: None 2024-05-25T23:09:03.729029603Z [2024-05-25 23:09:03,728: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[534ad87a-97db-4cb5-961d-a999241442e8] succeeded in 3.453037776000201s: None 2024-05-25T23:10:00.810837145Z [2024-05-25 23:10:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3227007-f23f-4aa3-98c9-9bdd2c7e8fdc] received 2024-05-25T23:10:00.815242784Z [2024-05-25 23:10:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[193b035e-2972-4189-84c2-34d4d9db1c1d] received 2024-05-25T23:10:00.816662161Z [2024-05-25 23:10:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e92e676-7e21-4747-8bf3-2b9e4ac96b60] received 2024-05-25T23:10:00.824482768Z [2024-05-25 23:10:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4edee28-632a-42cc-96b8-c74501677629] received 2024-05-25T23:10:00.828117096Z [2024-05-25 23:10:00,827: INFO/ForkPoolWorker-15] [e3227007-f23f-4aa3-98c9-9bdd2c7e8fdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:10:00.831479788Z [2024-05-25 23:10:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7547261a-82bf-4c5b-8c14-9b578f87fb14] received 2024-05-25T23:10:00.832447381Z [2024-05-25 23:10:00,831: INFO/ForkPoolWorker-1] [8e92e676-7e21-4747-8bf3-2b9e4ac96b60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:10:00.840268933Z [2024-05-25 23:10:00,836: INFO/ForkPoolWorker-16] [193b035e-2972-4189-84c2-34d4d9db1c1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:10:00.848772776Z [2024-05-25 23:10:00,848: INFO/ForkPoolWorker-2] [c4edee28-632a-42cc-96b8-c74501677629] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:10:00.851128119Z [2024-05-25 23:10:00,850: INFO/ForkPoolWorker-3] [7547261a-82bf-4c5b-8c14-9b578f87fb14] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:10:01.194748206Z [2024-05-25 23:10:01,190: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:10:01.240811079Z [2024-05-25 23:10:01,236: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:10:01.339027571Z [2024-05-25 23:10:01,324: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:10:01.379398633Z [2024-05-25 23:10:01,375: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:10:01.417663608Z [2024-05-25 23:10:01,413: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:10:01.532509521Z [2024-05-25 23:10:01,532: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T23:10:01.536630287Z [2024-05-25 23:10:01,536: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:10:01.571510502Z [2024-05-25 23:10:01,571: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T23:10:01.574783247Z [2024-05-25 23:10:01,574: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:10:01.575588751Z [2024-05-25 23:10:01,574: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:10:01.576207289Z [2024-05-25 23:10:01,575: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T23:10:01.576784271Z [2024-05-25 23:10:01,576: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:10:01.665268370Z [2024-05-25 23:10:01,665: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:10:01.819817528Z [2024-05-25 23:10:01,819: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:10:02.480403338Z [2024-05-25 23:10:02,480: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7547261a-82bf-4c5b-8c14-9b578f87fb14] succeeded in 1.6456024750000324s: None 2024-05-25T23:10:02.512512374Z [2024-05-25 23:10:02,512: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c4edee28-632a-42cc-96b8-c74501677629] succeeded in 1.6837146980001307s: None 2024-05-25T23:10:02.822313932Z [2024-05-25 23:10:02,821: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:10:02.826117352Z [2024-05-25 23:10:02,825: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:10:02.843076466Z [2024-05-25 23:10:02,842: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:10:02.844258168Z [2024-05-25 23:10:02,844: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:10:02.844298790Z [2024-05-25 23:10:02,844: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:10:02.844411296Z [2024-05-25 23:10:02,844: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:10:02.844446361Z [2024-05-25 23:10:02,844: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:10:02.844700557Z [2024-05-25 23:10:02,844: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:10:02.844719339Z [2024-05-25 23:10:02,844: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:10:02.850563802Z [2024-05-25 23:10:02,850: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:10:02.853940956Z [2024-05-25 23:10:02,853: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:10:02.880393873Z [2024-05-25 23:10:02,880: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:10:02.881677962Z [2024-05-25 23:10:02,881: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:10:02.881855866Z [2024-05-25 23:10:02,881: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:10:02.882104816Z [2024-05-25 23:10:02,881: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:10:02.882311778Z [2024-05-25 23:10:02,882: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:10:02.882642727Z [2024-05-25 23:10:02,882: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:10:02.882809195Z [2024-05-25 23:10:02,882: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:10:02.897249233Z [2024-05-25 23:10:02,896: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:10:02.901729629Z [2024-05-25 23:10:02,901: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:10:02.918015482Z [2024-05-25 23:10:02,917: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:10:02.924858949Z [2024-05-25 23:10:02,924: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:10:02.926108038Z [2024-05-25 23:10:02,925: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:10:02.926187875Z [2024-05-25 23:10:02,926: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:10:02.926369574Z [2024-05-25 23:10:02,926: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:10:02.926739057Z [2024-05-25 23:10:02,926: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:10:02.926993064Z [2024-05-25 23:10:02,926: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:10:02.927011881Z [2024-05-25 23:10:02,926: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:10:02.981434460Z [2024-05-25 23:10:02,980: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:10:03.013854673Z [2024-05-25 23:10:03,013: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:10:03.680405659Z [2024-05-25 23:10:03,678: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[193b035e-2972-4189-84c2-34d4d9db1c1d] succeeded in 2.8600654869997015s: None 2024-05-25T23:10:03.701713907Z [2024-05-25 23:10:03,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7bcd0e4-affa-40f4-bf7f-01b57af1888e] received 2024-05-25T23:10:03.721761390Z [2024-05-25 23:10:03,721: INFO/ForkPoolWorker-16] [c7bcd0e4-affa-40f4-bf7f-01b57af1888e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:10:04.094573502Z [2024-05-25 23:10:04,091: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:10:04.452476222Z [2024-05-25 23:10:04,451: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3227007-f23f-4aa3-98c9-9bdd2c7e8fdc] succeeded in 3.638324834999821s: None 2024-05-25T23:10:05.342839553Z [2024-05-25 23:10:05,342: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:10:05.346588778Z [2024-05-25 23:10:05,346: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:10:05.392932738Z [2024-05-25 23:10:05,392: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:10:05.396732668Z [2024-05-25 23:10:05,396: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:10:05.396761996Z [2024-05-25 23:10:05,396: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:10:05.396903450Z [2024-05-25 23:10:05,396: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:10:05.396959435Z [2024-05-25 23:10:05,396: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:10:05.397219958Z [2024-05-25 23:10:05,397: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:10:05.397273113Z [2024-05-25 23:10:05,397: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:10:05.467672881Z [2024-05-25 23:10:05,464: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:10:06.106955849Z [2024-05-25 23:10:06,106: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7bcd0e4-affa-40f4-bf7f-01b57af1888e] succeeded in 2.4017115179999564s: None 2024-05-25T23:10:06.128579644Z [2024-05-25 23:10:06,128: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8e92e676-7e21-4747-8bf3-2b9e4ac96b60] succeeded in 5.308970529999897s: None 2024-05-25T23:10:06.361673797Z [2024-05-25 23:10:06,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af15b66d-f44f-4358-affe-d886e54089c1] received 2024-05-25T23:10:06.369956273Z [2024-05-25 23:10:06,369: INFO/ForkPoolWorker-15] [af15b66d-f44f-4358-affe-d886e54089c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:10:06.699217747Z [2024-05-25 23:10:06,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:10:07.781537886Z [2024-05-25 23:10:07,781: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:10:07.784641604Z [2024-05-25 23:10:07,784: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:10:07.804518957Z [2024-05-25 23:10:07,804: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:10:07.806504403Z [2024-05-25 23:10:07,806: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:10:07.806535150Z [2024-05-25 23:10:07,806: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:10:07.806719426Z [2024-05-25 23:10:07,806: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:10:07.806739158Z [2024-05-25 23:10:07,806: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:10:07.807180001Z [2024-05-25 23:10:07,807: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:10:07.807236197Z [2024-05-25 23:10:07,807: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:10:07.900601722Z [2024-05-25 23:10:07,900: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:10:08.560384789Z [2024-05-25 23:10:08,559: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af15b66d-f44f-4358-affe-d886e54089c1] succeeded in 2.1959968020000815s: None 2024-05-25T23:10:08.765246495Z [2024-05-25 23:10:08,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd45c7df-a384-4bb1-83bb-7869a6e21ed0] received 2024-05-25T23:10:08.777706546Z [2024-05-25 23:10:08,777: INFO/ForkPoolWorker-15] [cd45c7df-a384-4bb1-83bb-7869a6e21ed0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:10:09.073876535Z [2024-05-25 23:10:09,070: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:10:10.110648870Z [2024-05-25 23:10:10,110: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:10:10.113506904Z [2024-05-25 23:10:10,113: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:10:10.139617651Z [2024-05-25 23:10:10,139: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:10:10.142370274Z [2024-05-25 23:10:10,141: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:10:10.143092547Z [2024-05-25 23:10:10,142: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:10:10.143496374Z [2024-05-25 23:10:10,143: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:10:10.143756602Z [2024-05-25 23:10:10,143: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:10:10.144407490Z [2024-05-25 23:10:10,144: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:10:10.144572328Z [2024-05-25 23:10:10,144: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:10:10.241102451Z [2024-05-25 23:10:10,240: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:10:10.886637182Z [2024-05-25 23:10:10,886: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd45c7df-a384-4bb1-83bb-7869a6e21ed0] succeeded in 2.1191459209999266s: None 2024-05-25T23:11:00.746073262Z [2024-05-25 23:11:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[170957db-d978-45e9-a0dc-fb25ec263c01] received 2024-05-25T23:11:00.754582739Z [2024-05-25 23:11:00,753: INFO/ForkPoolWorker-15] [170957db-d978-45e9-a0dc-fb25ec263c01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:11:00.769566412Z [2024-05-25 23:11:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13ba1389-0b20-4285-bdf0-19601e0978c0] received 2024-05-25T23:11:00.781252622Z [2024-05-25 23:11:00,776: INFO/ForkPoolWorker-16] [13ba1389-0b20-4285-bdf0-19601e0978c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:11:00.785330475Z [2024-05-25 23:11:00,784: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbad3789-64b2-420c-8b92-c163bc20cd79] received 2024-05-25T23:11:00.793984222Z [2024-05-25 23:11:00,793: INFO/ForkPoolWorker-1] [bbad3789-64b2-420c-8b92-c163bc20cd79] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:11:01.109151546Z [2024-05-25 23:11:01,105: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:11:01.118082766Z [2024-05-25 23:11:01,111: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:11:01.141316747Z [2024-05-25 23:11:01,137: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:11:01.355074026Z [2024-05-25 23:11:01,354: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:11:01.363847140Z [2024-05-25 23:11:01,363: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:11:01.385615183Z [2024-05-25 23:11:01,385: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:11:01.386565786Z [2024-05-25 23:11:01,386: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:11:01.386702740Z [2024-05-25 23:11:01,386: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:11:01.386788479Z [2024-05-25 23:11:01,386: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:11:01.386978795Z [2024-05-25 23:11:01,386: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:11:01.494608205Z [2024-05-25 23:11:01,494: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:11:02.114603554Z [2024-05-25 23:11:02,114: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bbad3789-64b2-420c-8b92-c163bc20cd79] succeeded in 1.3282890419995965s: None 2024-05-25T23:11:02.391239327Z [2024-05-25 23:11:02,390: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:11:02.394720392Z [2024-05-25 23:11:02,394: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:11:02.423312078Z [2024-05-25 23:11:02,422: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:11:02.425801704Z [2024-05-25 23:11:02,425: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:11:02.425922779Z [2024-05-25 23:11:02,425: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:11:02.426177377Z [2024-05-25 23:11:02,425: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:11:02.426289134Z [2024-05-25 23:11:02,426: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:11:02.426808507Z [2024-05-25 23:11:02,426: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:11:02.426951130Z [2024-05-25 23:11:02,426: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:11:02.435212455Z [2024-05-25 23:11:02,434: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:11:02.440360596Z [2024-05-25 23:11:02,439: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:11:02.459042688Z [2024-05-25 23:11:02,458: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:11:02.460869517Z [2024-05-25 23:11:02,460: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:11:02.460967901Z [2024-05-25 23:11:02,460: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:11:02.461184338Z [2024-05-25 23:11:02,460: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:11:02.461206290Z [2024-05-25 23:11:02,460: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:11:02.461221218Z [2024-05-25 23:11:02,460: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:11:02.461277185Z [2024-05-25 23:11:02,460: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:11:02.533676776Z [2024-05-25 23:11:02,533: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:11:02.550151959Z [2024-05-25 23:11:02,549: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:11:04.087189161Z [2024-05-25 23:11:04,086: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[13ba1389-0b20-4285-bdf0-19601e0978c0] succeeded in 3.3157455479999953s: None 2024-05-25T23:11:04.486287679Z [2024-05-25 23:11:04,484: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[170957db-d978-45e9-a0dc-fb25ec263c01] succeeded in 3.741776358000152s: None 2024-05-25T23:12:00.775612334Z [2024-05-25 23:12:00,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[666139cb-72be-4b90-a223-1f2b1370f5ab] received 2024-05-25T23:12:00.783065957Z [2024-05-25 23:12:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16b25423-c077-4eec-ba13-c36dfccc3d14] received 2024-05-25T23:12:00.783103261Z [2024-05-25 23:12:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23632e12-0ff3-4b2f-9130-d5cc2d11b2a7] received 2024-05-25T23:12:00.787714911Z [2024-05-25 23:12:00,784: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc18a3a8-4934-4cf3-bbd6-8f90b1a98939] received 2024-05-25T23:12:00.797338660Z [2024-05-25 23:12:00,796: INFO/ForkPoolWorker-1] [23632e12-0ff3-4b2f-9130-d5cc2d11b2a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:12:00.804854460Z [2024-05-25 23:12:00,804: INFO/ForkPoolWorker-15] [666139cb-72be-4b90-a223-1f2b1370f5ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:12:00.814322341Z [2024-05-25 23:12:00,813: INFO/ForkPoolWorker-16] [16b25423-c077-4eec-ba13-c36dfccc3d14] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:12:00.815291321Z [2024-05-25 23:12:00,814: INFO/ForkPoolWorker-2] [fc18a3a8-4934-4cf3-bbd6-8f90b1a98939] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:12:01.104371549Z [2024-05-25 23:12:01,100: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:12:01.184547299Z [2024-05-25 23:12:01,180: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:12:01.224082484Z [2024-05-25 23:12:01,219: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:12:01.273262154Z [2024-05-25 23:12:01,267: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:12:01.459855677Z [2024-05-25 23:12:01,459: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:12:01.463944035Z [2024-05-25 23:12:01,463: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:12:01.504573213Z [2024-05-25 23:12:01,504: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:12:01.507483584Z [2024-05-25 23:12:01,507: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:12:01.507504214Z [2024-05-25 23:12:01,507: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:12:01.507806360Z [2024-05-25 23:12:01,507: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:12:01.508085592Z [2024-05-25 23:12:01,507: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:12:01.527784860Z [2024-05-25 23:12:01,527: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:12:01.636661052Z [2024-05-25 23:12:01,636: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:12:02.251437578Z [2024-05-25 23:12:02,251: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23632e12-0ff3-4b2f-9130-d5cc2d11b2a7] succeeded in 1.4644392749996769s: None 2024-05-25T23:12:02.283435290Z [2024-05-25 23:12:02,283: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[16b25423-c077-4eec-ba13-c36dfccc3d14] succeeded in 1.5004786979998244s: None 2024-05-25T23:12:02.646960410Z [2024-05-25 23:12:02,646: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:12:02.650402698Z [2024-05-25 23:12:02,649: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:12:02.670679253Z [2024-05-25 23:12:02,670: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:12:02.671925669Z [2024-05-25 23:12:02,671: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:12:02.672068303Z [2024-05-25 23:12:02,671: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:12:02.672210560Z [2024-05-25 23:12:02,672: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:12:02.672287150Z [2024-05-25 23:12:02,672: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:12:02.672585942Z [2024-05-25 23:12:02,672: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:12:02.672729559Z [2024-05-25 23:12:02,672: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:12:02.733023216Z [2024-05-25 23:12:02,732: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:12:02.736830868Z [2024-05-25 23:12:02,736: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:12:02.763152088Z [2024-05-25 23:12:02,762: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:12:02.766802080Z [2024-05-25 23:12:02,766: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:12:02.768071599Z [2024-05-25 23:12:02,767: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:12:02.768108051Z [2024-05-25 23:12:02,767: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:12:02.768145125Z [2024-05-25 23:12:02,767: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:12:02.768158781Z [2024-05-25 23:12:02,767: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:12:02.768385689Z [2024-05-25 23:12:02,768: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:12:02.768481328Z [2024-05-25 23:12:02,768: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:12:02.869828844Z [2024-05-25 23:12:02,869: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:12:04.838882128Z [2024-05-25 23:12:04,838: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc18a3a8-4934-4cf3-bbd6-8f90b1a98939] succeeded in 4.045522480999807s: None 2024-05-25T23:12:04.865418688Z [2024-05-25 23:12:04,865: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[666139cb-72be-4b90-a223-1f2b1370f5ab] succeeded in 4.086663356999907s: None 2024-05-25T23:13:00.556321992Z [2024-05-25 23:13:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77170c91-508a-42d9-bba3-477bfafd2205] received 2024-05-25T23:13:00.565705464Z [2024-05-25 23:13:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[053d0fbe-69e1-4a08-a9f6-66519a339d19] received 2024-05-25T23:13:00.573306915Z [2024-05-25 23:13:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d525d8f8-126b-4f84-b24e-39d29aeed5de] received 2024-05-25T23:13:00.627768154Z [2024-05-25 23:13:00,627: INFO/ForkPoolWorker-15] [77170c91-508a-42d9-bba3-477bfafd2205] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:13:00.632534542Z [2024-05-25 23:13:00,632: INFO/ForkPoolWorker-16] [053d0fbe-69e1-4a08-a9f6-66519a339d19] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:13:00.636732576Z [2024-05-25 23:13:00,636: INFO/ForkPoolWorker-1] [d525d8f8-126b-4f84-b24e-39d29aeed5de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:13:01.774921921Z [2024-05-25 23:13:01,759: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:13:02.152464135Z [2024-05-25 23:13:02,085: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:13:02.404200956Z [2024-05-25 23:13:02,396: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:13:03.399638178Z [2024-05-25 23:13:03,397: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:13:03.415673888Z [2024-05-25 23:13:03,412: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:13:03.619737166Z [2024-05-25 23:13:03,617: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:13:03.622273982Z [2024-05-25 23:13:03,622: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:13:03.639512642Z [2024-05-25 23:13:03,622: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:13:03.639549550Z [2024-05-25 23:13:03,639: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:13:03.639553907Z [2024-05-25 23:13:03,639: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:13:04.056976589Z [2024-05-25 23:13:04,056: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:13:08.163938311Z [2024-05-25 23:13:08,160: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[053d0fbe-69e1-4a08-a9f6-66519a339d19] succeeded in 7.5850981130001855s: None 2024-05-25T23:13:09.216499849Z [2024-05-25 23:13:09,216: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:13:09.220084331Z [2024-05-25 23:13:09,219: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:13:09.312159059Z [2024-05-25 23:13:09,311: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:13:09.322320724Z [2024-05-25 23:13:09,322: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:13:09.322497868Z [2024-05-25 23:13:09,322: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:13:09.323063696Z [2024-05-25 23:13:09,322: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:13:09.323226761Z [2024-05-25 23:13:09,323: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:13:09.325413528Z [2024-05-25 23:13:09,325: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:13:09.325659295Z [2024-05-25 23:13:09,325: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:13:09.605200288Z [2024-05-25 23:13:09,604: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:13:09.758674433Z [2024-05-25 23:13:09,758: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:13:09.773591337Z [2024-05-25 23:13:09,772: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:13:09.946730005Z [2024-05-25 23:13:09,946: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:13:09.962599113Z [2024-05-25 23:13:09,962: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:13:09.964632759Z [2024-05-25 23:13:09,962: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:13:09.967237639Z [2024-05-25 23:13:09,966: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:13:09.970514861Z [2024-05-25 23:13:09,967: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:13:09.970923339Z [2024-05-25 23:13:09,970: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:13:09.974231540Z [2024-05-25 23:13:09,970: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:13:10.276833585Z [2024-05-25 23:13:10,276: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:13:12.047669845Z [2024-05-25 23:13:12,047: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77170c91-508a-42d9-bba3-477bfafd2205] succeeded in 11.462937844999942s: None 2024-05-25T23:13:12.493713358Z [2024-05-25 23:13:12,490: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d525d8f8-126b-4f84-b24e-39d29aeed5de] succeeded in 11.87987410200003s: None 2024-05-25T23:14:00.433523378Z [2024-05-25 23:14:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dc0815f-aaf1-496b-8c09-25913f95e15c] received 2024-05-25T23:14:00.453457861Z [2024-05-25 23:14:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[811cc430-d525-4961-b9a4-5b0fcefc4a6c] received 2024-05-25T23:14:00.455513191Z [2024-05-25 23:14:00,455: INFO/ForkPoolWorker-15] [1dc0815f-aaf1-496b-8c09-25913f95e15c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:14:00.473274566Z [2024-05-25 23:14:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bbeefb0-963b-47c0-9638-ac8eb1404d35] received 2024-05-25T23:14:00.481917898Z [2024-05-25 23:14:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e839784d-28ae-4d10-aa50-d06b74cb5e40] received 2024-05-25T23:14:00.515465527Z [2024-05-25 23:14:00,514: INFO/ForkPoolWorker-2] [e839784d-28ae-4d10-aa50-d06b74cb5e40] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:14:00.519586592Z [2024-05-25 23:14:00,519: INFO/ForkPoolWorker-1] [2bbeefb0-963b-47c0-9638-ac8eb1404d35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:14:00.519619579Z [2024-05-25 23:14:00,517: INFO/ForkPoolWorker-16] [811cc430-d525-4961-b9a4-5b0fcefc4a6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:14:01.100294483Z [2024-05-25 23:14:01,096: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:14:01.156405759Z [2024-05-25 23:14:01,151: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:14:01.160466855Z [2024-05-25 23:14:01,145: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:14:01.210023558Z [2024-05-25 23:14:01,204: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:14:01.394990953Z [2024-05-25 23:14:01,394: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:14:01.400504075Z [2024-05-25 23:14:01,400: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:14:01.443267688Z [2024-05-25 23:14:01,443: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:14:01.445223870Z [2024-05-25 23:14:01,444: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:14:01.445349931Z [2024-05-25 23:14:01,445: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:14:01.445362188Z [2024-05-25 23:14:01,445: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:14:01.445509389Z [2024-05-25 23:14:01,445: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:14:01.576790224Z [2024-05-25 23:14:01,576: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:14:01.618842049Z [2024-05-25 23:14:01,617: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:14:02.250899884Z [2024-05-25 23:14:02,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1dc0815f-aaf1-496b-8c09-25913f95e15c] succeeded in 1.814941299000111s: None 2024-05-25T23:14:02.383634670Z [2024-05-25 23:14:02,383: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e839784d-28ae-4d10-aa50-d06b74cb5e40] succeeded in 1.8938028289999238s: None 2024-05-25T23:14:02.831772570Z [2024-05-25 23:14:02,831: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:14:02.835288679Z [2024-05-25 23:14:02,834: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:14:02.854255465Z [2024-05-25 23:14:02,854: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:14:02.855701975Z [2024-05-25 23:14:02,855: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:14:02.855857278Z [2024-05-25 23:14:02,855: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:14:02.856061208Z [2024-05-25 23:14:02,855: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:14:02.856199592Z [2024-05-25 23:14:02,856: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:14:02.856609226Z [2024-05-25 23:14:02,856: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:14:02.856789827Z [2024-05-25 23:14:02,856: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:14:02.898942519Z [2024-05-25 23:14:02,898: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:14:02.902243828Z [2024-05-25 23:14:02,901: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:14:02.929697757Z [2024-05-25 23:14:02,929: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:14:02.931367021Z [2024-05-25 23:14:02,931: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:14:02.931558483Z [2024-05-25 23:14:02,931: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:14:02.931768528Z [2024-05-25 23:14:02,931: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:14:02.931898226Z [2024-05-25 23:14:02,931: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:14:02.932348551Z [2024-05-25 23:14:02,932: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:14:02.932476632Z [2024-05-25 23:14:02,932: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:14:02.948098669Z [2024-05-25 23:14:02,947: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:14:03.039463185Z [2024-05-25 23:14:03,039: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:14:04.898810415Z [2024-05-25 23:14:04,898: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[811cc430-d525-4961-b9a4-5b0fcefc4a6c] succeeded in 4.427997773000243s: None 2024-05-25T23:14:05.291051936Z [2024-05-25 23:14:05,290: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2bbeefb0-963b-47c0-9638-ac8eb1404d35] succeeded in 4.807988757000203s: None 2024-05-25T23:15:00.896219691Z [2024-05-25 23:15:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37f57eda-8bdb-42ab-9042-d9a3c254ed47] received 2024-05-25T23:15:00.900200784Z [2024-05-25 23:15:00,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a91bd5b-52cc-496a-912f-6313b3e8f99f] received 2024-05-25T23:15:00.913004880Z [2024-05-25 23:15:00,912: INFO/ForkPoolWorker-16] [0a91bd5b-52cc-496a-912f-6313b3e8f99f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:15:00.915988732Z [2024-05-25 23:15:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1ebfe58-623a-44fe-ae2b-2d4cac792fe6] received 2024-05-25T23:15:00.916002255Z [2024-05-25 23:15:00,915: INFO/ForkPoolWorker-15] [37f57eda-8bdb-42ab-9042-d9a3c254ed47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:15:00.923249080Z [2024-05-25 23:15:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[faf435fc-2eb7-4992-9e1b-8b60aa6c0be8] received 2024-05-25T23:15:00.934502696Z [2024-05-25 23:15:00,934: INFO/ForkPoolWorker-2] [faf435fc-2eb7-4992-9e1b-8b60aa6c0be8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:15:00.938031285Z [2024-05-25 23:15:00,937: INFO/ForkPoolWorker-1] [a1ebfe58-623a-44fe-ae2b-2d4cac792fe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:15:01.597587700Z [2024-05-25 23:15:01,593: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:15:01.601379734Z [2024-05-25 23:15:01,589: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:15:01.909022124Z [2024-05-25 23:15:01,899: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:15:01.928918004Z [2024-05-25 23:15:01,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:15:02.223289084Z [2024-05-25 23:15:02,222: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:15:02.232045856Z [2024-05-25 23:15:02,231: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:15:02.269154045Z [2024-05-25 23:15:02,268: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:15:02.270402581Z [2024-05-25 23:15:02,270: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:15:02.270557642Z [2024-05-25 23:15:02,270: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:15:02.270632351Z [2024-05-25 23:15:02,270: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:15:02.271185866Z [2024-05-25 23:15:02,271: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:15:02.395300366Z [2024-05-25 23:15:02,395: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:15:02.962447210Z [2024-05-25 23:15:02,961: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[faf435fc-2eb7-4992-9e1b-8b60aa6c0be8] succeeded in 2.0360326780000833s: None 2024-05-25T23:15:03.132965843Z [2024-05-25 23:15:03,132: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:15:03.136910113Z [2024-05-25 23:15:03,136: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:15:03.172406159Z [2024-05-25 23:15:03,172: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:15:03.191036717Z [2024-05-25 23:15:03,185: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:15:03.191057060Z [2024-05-25 23:15:03,185: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:15:03.191060847Z [2024-05-25 23:15:03,185: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:15:03.191064495Z [2024-05-25 23:15:03,185: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:15:03.191067440Z [2024-05-25 23:15:03,186: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:15:03.191070796Z [2024-05-25 23:15:03,186: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:15:03.280493959Z [2024-05-25 23:15:03,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:15:03.332992650Z [2024-05-25 23:15:03,332: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:15:03.336064584Z [2024-05-25 23:15:03,335: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:15:03.365748217Z [2024-05-25 23:15:03,365: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:15:03.369057062Z [2024-05-25 23:15:03,368: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:15:03.369161036Z [2024-05-25 23:15:03,369: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:15:03.369301830Z [2024-05-25 23:15:03,369: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:15:03.369445349Z [2024-05-25 23:15:03,369: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:15:03.369714888Z [2024-05-25 23:15:03,369: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:15:03.370164566Z [2024-05-25 23:15:03,370: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:15:03.459622935Z [2024-05-25 23:15:03,459: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:15:03.465420048Z [2024-05-25 23:15:03,464: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:15:03.475279756Z [2024-05-25 23:15:03,475: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:15:03.508339829Z [2024-05-25 23:15:03,508: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:15:03.512816220Z [2024-05-25 23:15:03,512: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:15:03.512984462Z [2024-05-25 23:15:03,512: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:15:03.513223567Z [2024-05-25 23:15:03,512: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:15:03.513355526Z [2024-05-25 23:15:03,513: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:15:03.513653772Z [2024-05-25 23:15:03,513: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:15:03.513803216Z [2024-05-25 23:15:03,513: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:15:03.763593653Z [2024-05-25 23:15:03,763: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:15:04.650084035Z [2024-05-25 23:15:04,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37f57eda-8bdb-42ab-9042-d9a3c254ed47] succeeded in 3.748278269000366s: None 2024-05-25T23:15:05.232692756Z [2024-05-25 23:15:05,232: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a1ebfe58-623a-44fe-ae2b-2d4cac792fe6] succeeded in 4.314159453999764s: None 2024-05-25T23:15:05.265892465Z [2024-05-25 23:15:05,265: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0a91bd5b-52cc-496a-912f-6313b3e8f99f] succeeded in 4.363102743000127s: None 2024-05-25T23:15:05.420338099Z [2024-05-25 23:15:05,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c279a85-d330-4685-bc7e-f1f9caacaa5f] received 2024-05-25T23:15:05.439762410Z [2024-05-25 23:15:05,439: INFO/ForkPoolWorker-15] [5c279a85-d330-4685-bc7e-f1f9caacaa5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:15:05.847940308Z [2024-05-25 23:15:05,844: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:15:07.072030519Z [2024-05-25 23:15:07,071: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:15:07.075383910Z [2024-05-25 23:15:07,074: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:15:07.121577690Z [2024-05-25 23:15:07,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:15:07.126485333Z [2024-05-25 23:15:07,125: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:15:07.126598811Z [2024-05-25 23:15:07,126: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:15:07.126769932Z [2024-05-25 23:15:07,126: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:15:07.126816410Z [2024-05-25 23:15:07,126: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:15:07.127194976Z [2024-05-25 23:15:07,127: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:15:07.127207813Z [2024-05-25 23:15:07,127: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:15:07.238763405Z [2024-05-25 23:15:07,238: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:15:07.967595518Z [2024-05-25 23:15:07,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c279a85-d330-4685-bc7e-f1f9caacaa5f] succeeded in 2.5441185300001052s: None 2024-05-25T23:15:08.600492151Z [2024-05-25 23:15:08,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[590c6577-9023-47a8-a41a-5667e56518c0] received 2024-05-25T23:15:08.614806245Z [2024-05-25 23:15:08,614: INFO/ForkPoolWorker-15] [590c6577-9023-47a8-a41a-5667e56518c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:15:08.924161482Z [2024-05-25 23:15:08,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:15:10.068146566Z [2024-05-25 23:15:10,067: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:15:10.071439895Z [2024-05-25 23:15:10,070: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:15:10.102381853Z [2024-05-25 23:15:10,102: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:15:10.104682127Z [2024-05-25 23:15:10,104: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:15:10.104934012Z [2024-05-25 23:15:10,104: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:15:10.105333714Z [2024-05-25 23:15:10,104: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:15:10.105534678Z [2024-05-25 23:15:10,105: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:15:10.105984945Z [2024-05-25 23:15:10,105: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:15:10.106241093Z [2024-05-25 23:15:10,106: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:15:10.217997331Z [2024-05-25 23:15:10,217: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:15:10.879886607Z [2024-05-25 23:15:10,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[590c6577-9023-47a8-a41a-5667e56518c0] succeeded in 2.2748603119998734s: None 2024-05-25T23:15:11.011951779Z [2024-05-25 23:15:11,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e15137d-7506-40d3-bdae-01ca2b6d00ec] received 2024-05-25T23:15:11.020993541Z [2024-05-25 23:15:11,020: INFO/ForkPoolWorker-15] [9e15137d-7506-40d3-bdae-01ca2b6d00ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:15:11.319559406Z [2024-05-25 23:15:11,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:15:12.492400530Z [2024-05-25 23:15:12,491: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:15:12.495729153Z [2024-05-25 23:15:12,495: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:15:12.517953455Z [2024-05-25 23:15:12,517: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:15:12.520092482Z [2024-05-25 23:15:12,519: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:15:12.520118790Z [2024-05-25 23:15:12,519: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:15:12.520359657Z [2024-05-25 23:15:12,520: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:15:12.520557981Z [2024-05-25 23:15:12,520: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:15:12.521215916Z [2024-05-25 23:15:12,520: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:15:12.521446514Z [2024-05-25 23:15:12,521: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:15:12.608238962Z [2024-05-25 23:15:12,607: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:15:13.252535400Z [2024-05-25 23:15:13,251: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e15137d-7506-40d3-bdae-01ca2b6d00ec] succeeded in 2.23627975699992s: None 2024-05-25T23:16:01.292703250Z [2024-05-25 23:16:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fa0ee8e-9405-45df-b2b0-7de7e685d067] received 2024-05-25T23:16:01.299114563Z [2024-05-25 23:16:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4b2f1b2-a6a0-4765-ac79-06bc0a3cd0f2] received 2024-05-25T23:16:01.303509352Z [2024-05-25 23:16:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[795f01a5-b04a-4977-8d8f-6a83b6bcb111] received 2024-05-25T23:16:01.306268508Z [2024-05-25 23:16:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bdfd2e1-a87d-4279-8a5f-e17f36a9e2ca] received 2024-05-25T23:16:01.307116234Z [2024-05-25 23:16:01,306: INFO/ForkPoolWorker-15] [9fa0ee8e-9405-45df-b2b0-7de7e685d067] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:16:01.333501980Z [2024-05-25 23:16:01,333: INFO/ForkPoolWorker-16] [e4b2f1b2-a6a0-4765-ac79-06bc0a3cd0f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:16:01.334325953Z [2024-05-25 23:16:01,334: INFO/ForkPoolWorker-2] [1bdfd2e1-a87d-4279-8a5f-e17f36a9e2ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:16:01.338000105Z [2024-05-25 23:16:01,337: INFO/ForkPoolWorker-1] [795f01a5-b04a-4977-8d8f-6a83b6bcb111] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:16:01.642943483Z [2024-05-25 23:16:01,638: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:16:01.673137990Z [2024-05-25 23:16:01,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:16:01.687296254Z [2024-05-25 23:16:01,682: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:16:01.872111937Z [2024-05-25 23:16:01,867: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:16:02.012062198Z [2024-05-25 23:16:02,003: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:16:02.158417843Z [2024-05-25 23:16:02,157: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:16:02.169061177Z [2024-05-25 23:16:02,168: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:16:02.220910852Z [2024-05-25 23:16:02,220: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:16:02.224090230Z [2024-05-25 23:16:02,223: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:16:02.224642575Z [2024-05-25 23:16:02,224: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:16:02.224762221Z [2024-05-25 23:16:02,224: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:16:02.225077196Z [2024-05-25 23:16:02,224: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:16:02.325080185Z [2024-05-25 23:16:02,324: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:16:02.701630997Z [2024-05-25 23:16:02,701: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fa0ee8e-9405-45df-b2b0-7de7e685d067] succeeded in 1.4043085100001917s: None 2024-05-25T23:16:02.957822769Z [2024-05-25 23:16:02,957: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[795f01a5-b04a-4977-8d8f-6a83b6bcb111] succeeded in 1.6522613110000748s: None 2024-05-25T23:16:03.054165240Z [2024-05-25 23:16:03,053: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:16:03.058149719Z [2024-05-25 23:16:03,057: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:16:03.069786291Z [2024-05-25 23:16:03,069: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:16:03.072945510Z [2024-05-25 23:16:03,072: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:16:03.088924733Z [2024-05-25 23:16:03,088: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:16:03.090787792Z [2024-05-25 23:16:03,090: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:16:03.090797210Z [2024-05-25 23:16:03,090: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:16:03.091280790Z [2024-05-25 23:16:03,090: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:16:03.091306124Z [2024-05-25 23:16:03,091: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:16:03.091664237Z [2024-05-25 23:16:03,091: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:16:03.091672274Z [2024-05-25 23:16:03,091: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:16:03.098546475Z [2024-05-25 23:16:03,098: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:16:03.100089740Z [2024-05-25 23:16:03,099: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:16:03.100342530Z [2024-05-25 23:16:03,100: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:16:03.100560425Z [2024-05-25 23:16:03,100: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:16:03.100740459Z [2024-05-25 23:16:03,100: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:16:03.101072689Z [2024-05-25 23:16:03,100: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:16:03.101536977Z [2024-05-25 23:16:03,101: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:16:03.234035347Z [2024-05-25 23:16:03,233: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:16:03.286010181Z [2024-05-25 23:16:03,285: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:16:05.552013959Z [2024-05-25 23:16:05,543: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e4b2f1b2-a6a0-4765-ac79-06bc0a3cd0f2] succeeded in 4.242370040999958s: None 2024-05-25T23:16:05.577659563Z [2024-05-25 23:16:05,574: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1bdfd2e1-a87d-4279-8a5f-e17f36a9e2ca] succeeded in 4.265173324999978s: None 2024-05-25T23:17:00.900379443Z [2024-05-25 23:17:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bebb69a6-cc4b-405b-abae-fa78ab3da378] received 2024-05-25T23:17:00.901852834Z [2024-05-25 23:17:00,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a46efd9-54e0-4ba7-8875-d675b988203e] received 2024-05-25T23:17:00.911118281Z [2024-05-25 23:17:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea2c25c7-6dbb-4933-8f49-f58d724bfee1] received 2024-05-25T23:17:00.916987026Z [2024-05-25 23:17:00,916: INFO/ForkPoolWorker-15] [bebb69a6-cc4b-405b-abae-fa78ab3da378] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:17:00.921577388Z [2024-05-25 23:17:00,921: INFO/ForkPoolWorker-16] [9a46efd9-54e0-4ba7-8875-d675b988203e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:17:00.922167294Z [2024-05-25 23:17:00,921: INFO/ForkPoolWorker-1] [ea2c25c7-6dbb-4933-8f49-f58d724bfee1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:17:01.252964428Z [2024-05-25 23:17:01,248: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:17:01.269603965Z [2024-05-25 23:17:01,264: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:17:01.388279210Z [2024-05-25 23:17:01,384: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:17:01.433825053Z [2024-05-25 23:17:01,433: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:17:01.437924902Z [2024-05-25 23:17:01,437: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:17:01.473243279Z [2024-05-25 23:17:01,472: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:17:01.476630626Z [2024-05-25 23:17:01,476: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:17:01.477025927Z [2024-05-25 23:17:01,476: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:17:01.477279540Z [2024-05-25 23:17:01,477: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:17:01.477736396Z [2024-05-25 23:17:01,477: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:17:01.570476892Z [2024-05-25 23:17:01,570: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:17:02.131434241Z [2024-05-25 23:17:02,130: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9a46efd9-54e0-4ba7-8875-d675b988203e] succeeded in 1.2199609949998376s: None 2024-05-25T23:17:02.569928030Z [2024-05-25 23:17:02,569: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:17:02.573282288Z [2024-05-25 23:17:02,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:17:02.599935985Z [2024-05-25 23:17:02,599: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:17:02.601522608Z [2024-05-25 23:17:02,601: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:17:02.601785890Z [2024-05-25 23:17:02,601: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:17:02.602004458Z [2024-05-25 23:17:02,601: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:17:02.602158360Z [2024-05-25 23:17:02,602: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:17:02.602568874Z [2024-05-25 23:17:02,602: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:17:02.602708901Z [2024-05-25 23:17:02,602: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:17:02.702298814Z [2024-05-25 23:17:02,701: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:17:02.752898347Z [2024-05-25 23:17:02,752: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:17:02.756193533Z [2024-05-25 23:17:02,755: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:17:02.783056254Z [2024-05-25 23:17:02,782: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:17:02.786127591Z [2024-05-25 23:17:02,785: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:17:02.786355960Z [2024-05-25 23:17:02,786: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:17:02.786699378Z [2024-05-25 23:17:02,786: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:17:02.787056800Z [2024-05-25 23:17:02,786: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:17:02.788028331Z [2024-05-25 23:17:02,787: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:17:02.788358418Z [2024-05-25 23:17:02,787: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:17:02.894672760Z [2024-05-25 23:17:02,894: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:17:04.931682513Z [2024-05-25 23:17:04,931: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea2c25c7-6dbb-4933-8f49-f58d724bfee1] succeeded in 4.018531794999944s: None 2024-05-25T23:17:05.029898653Z [2024-05-25 23:17:05,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bebb69a6-cc4b-405b-abae-fa78ab3da378] succeeded in 4.124649135999789s: None 2024-05-25T23:18:00.843427928Z [2024-05-25 23:18:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17925c85-f5bc-4c2e-897d-796cdaa5ab32] received 2024-05-25T23:18:00.851697075Z [2024-05-25 23:18:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15a90e3c-dbcd-4333-a19b-a949d0bc2cdb] received 2024-05-25T23:18:00.859644973Z [2024-05-25 23:18:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9992dc4-39c3-4651-814e-eab08b9b7dec] received 2024-05-25T23:18:00.869486004Z [2024-05-25 23:18:00,869: INFO/ForkPoolWorker-15] [17925c85-f5bc-4c2e-897d-796cdaa5ab32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:18:00.875575449Z [2024-05-25 23:18:00,875: INFO/ForkPoolWorker-1] [d9992dc4-39c3-4651-814e-eab08b9b7dec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:18:00.881614117Z [2024-05-25 23:18:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b571083-838c-4a43-9e1d-5c4f2458ee2f] received 2024-05-25T23:18:00.892877363Z [2024-05-25 23:18:00,892: INFO/ForkPoolWorker-16] [15a90e3c-dbcd-4333-a19b-a949d0bc2cdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:18:00.900457866Z [2024-05-25 23:18:00,900: INFO/ForkPoolWorker-2] [8b571083-838c-4a43-9e1d-5c4f2458ee2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:18:01.209773294Z [2024-05-25 23:18:01,205: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:18:01.272093834Z [2024-05-25 23:18:01,268: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:18:01.280313604Z [2024-05-25 23:18:01,276: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:18:01.375763466Z [2024-05-25 23:18:01,362: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:18:01.511817386Z [2024-05-25 23:18:01,511: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:18:01.520137226Z [2024-05-25 23:18:01,519: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:18:01.562477537Z [2024-05-25 23:18:01,562: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:18:01.566824494Z [2024-05-25 23:18:01,566: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:18:01.567050304Z [2024-05-25 23:18:01,566: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:18:01.567189490Z [2024-05-25 23:18:01,567: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:18:01.567474437Z [2024-05-25 23:18:01,567: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:18:01.655613135Z [2024-05-25 23:18:01,655: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:18:01.721320392Z [2024-05-25 23:18:01,721: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:18:02.340405231Z [2024-05-25 23:18:02,339: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15a90e3c-dbcd-4333-a19b-a949d0bc2cdb] succeeded in 1.4692322930000046s: None 2024-05-25T23:18:02.404301237Z [2024-05-25 23:18:02,403: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8b571083-838c-4a43-9e1d-5c4f2458ee2f] succeeded in 1.519742868999856s: None 2024-05-25T23:18:02.644425245Z [2024-05-25 23:18:02,644: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:18:02.647749976Z [2024-05-25 23:18:02,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:18:02.672844803Z [2024-05-25 23:18:02,672: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:18:02.676600613Z [2024-05-25 23:18:02,676: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:18:02.676619935Z [2024-05-25 23:18:02,676: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:18:02.676732279Z [2024-05-25 23:18:02,676: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:18:02.676790646Z [2024-05-25 23:18:02,676: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:18:02.677147059Z [2024-05-25 23:18:02,676: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:18:02.677154590Z [2024-05-25 23:18:02,677: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:18:02.706025798Z [2024-05-25 23:18:02,705: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:18:02.709532793Z [2024-05-25 23:18:02,708: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:18:02.735585571Z [2024-05-25 23:18:02,735: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:18:02.737394792Z [2024-05-25 23:18:02,737: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:18:02.737421401Z [2024-05-25 23:18:02,737: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:18:02.737612441Z [2024-05-25 23:18:02,737: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:18:02.737627735Z [2024-05-25 23:18:02,737: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:18:02.738269029Z [2024-05-25 23:18:02,737: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:18:02.739296192Z [2024-05-25 23:18:02,738: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:18:02.776449796Z [2024-05-25 23:18:02,776: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:18:02.832719792Z [2024-05-25 23:18:02,832: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:18:04.684696263Z [2024-05-25 23:18:04,684: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9992dc4-39c3-4651-814e-eab08b9b7dec] succeeded in 3.8177781939998567s: None 2024-05-25T23:18:05.013327470Z [2024-05-25 23:18:05,012: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17925c85-f5bc-4c2e-897d-796cdaa5ab32] succeeded in 4.16409462699994s: None 2024-05-25T23:19:00.449353304Z [2024-05-25 23:19:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7e7ed95-9d28-4d5b-a176-eb3d106a4016] received 2024-05-25T23:19:00.453955624Z [2024-05-25 23:19:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61a00b67-d455-4496-8b2b-f2e4d6977342] received 2024-05-25T23:19:00.465727854Z [2024-05-25 23:19:00,465: INFO/ForkPoolWorker-15] [b7e7ed95-9d28-4d5b-a176-eb3d106a4016] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:19:00.469420629Z [2024-05-25 23:19:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1012ecc-b4e9-4c8e-a84f-f1b3219a86f2] received 2024-05-25T23:19:00.482774637Z [2024-05-25 23:19:00,482: INFO/ForkPoolWorker-1] [c1012ecc-b4e9-4c8e-a84f-f1b3219a86f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:19:00.487890533Z [2024-05-25 23:19:00,487: INFO/ForkPoolWorker-16] [61a00b67-d455-4496-8b2b-f2e4d6977342] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:19:00.761677689Z [2024-05-25 23:19:00,748: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:19:00.791469536Z [2024-05-25 23:19:00,787: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:19:00.812441190Z [2024-05-25 23:19:00,808: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:19:00.934908055Z [2024-05-25 23:19:00,934: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T23:19:00.938855310Z [2024-05-25 23:19:00,938: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:19:00.966630511Z [2024-05-25 23:19:00,966: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:19:00.968162248Z [2024-05-25 23:19:00,967: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:19:00.968245781Z [2024-05-25 23:19:00,968: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:19:00.968308320Z [2024-05-25 23:19:00,968: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T23:19:00.968510269Z [2024-05-25 23:19:00,968: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:19:01.085570588Z [2024-05-25 23:19:01,085: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:19:01.748080970Z [2024-05-25 23:19:01,747: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7e7ed95-9d28-4d5b-a176-eb3d106a4016] succeeded in 1.2922760359997483s: None 2024-05-25T23:19:01.999803692Z [2024-05-25 23:19:01,999: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:19:02.002940920Z [2024-05-25 23:19:02,002: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:19:02.024107684Z [2024-05-25 23:19:02,023: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:19:02.025886921Z [2024-05-25 23:19:02,025: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:19:02.025992771Z [2024-05-25 23:19:02,025: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:19:02.026175875Z [2024-05-25 23:19:02,025: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:19:02.026293136Z [2024-05-25 23:19:02,026: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:19:02.026603385Z [2024-05-25 23:19:02,026: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:19:02.026737912Z [2024-05-25 23:19:02,026: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:19:02.040990532Z [2024-05-25 23:19:02,040: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:19:02.044328561Z [2024-05-25 23:19:02,043: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:19:02.072534779Z [2024-05-25 23:19:02,072: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:19:02.076606848Z [2024-05-25 23:19:02,076: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:19:02.076635298Z [2024-05-25 23:19:02,076: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:19:02.076866845Z [2024-05-25 23:19:02,076: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:19:02.077011060Z [2024-05-25 23:19:02,076: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:19:02.077372645Z [2024-05-25 23:19:02,077: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:19:02.077493313Z [2024-05-25 23:19:02,077: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:19:02.120258536Z [2024-05-25 23:19:02,119: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:19:02.199351709Z [2024-05-25 23:19:02,199: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:19:04.180386957Z [2024-05-25 23:19:04,179: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1012ecc-b4e9-4c8e-a84f-f1b3219a86f2] succeeded in 3.7079544709999936s: None 2024-05-25T23:19:04.196573279Z [2024-05-25 23:19:04,196: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61a00b67-d455-4496-8b2b-f2e4d6977342] succeeded in 3.737124356000095s: None 2024-05-25T23:20:00.913536416Z [2024-05-25 23:20:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d33ca46f-27ee-4c62-9f78-48fe8ab28d49] received 2024-05-25T23:20:00.928105006Z [2024-05-25 23:20:00,927: INFO/ForkPoolWorker-15] [d33ca46f-27ee-4c62-9f78-48fe8ab28d49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:20:00.929213196Z [2024-05-25 23:20:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[862329c1-1b57-4a45-8694-14f76535a88e] received 2024-05-25T23:20:00.931702937Z [2024-05-25 23:20:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cdbd033-5aca-4ee9-ab8b-f798e9b3bfe3] received 2024-05-25T23:20:00.934357160Z [2024-05-25 23:20:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[813364c8-f34e-44b8-92d2-3c1aad21ea83] received 2024-05-25T23:20:00.946769885Z [2024-05-25 23:20:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9619a1d7-cac2-4aeb-a2be-e113abd3b5d4] received 2024-05-25T23:20:00.953345284Z [2024-05-25 23:20:00,952: INFO/ForkPoolWorker-16] [862329c1-1b57-4a45-8694-14f76535a88e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:20:00.960669074Z [2024-05-25 23:20:00,960: INFO/ForkPoolWorker-1] [3cdbd033-5aca-4ee9-ab8b-f798e9b3bfe3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:20:00.964657963Z [2024-05-25 23:20:00,964: INFO/ForkPoolWorker-3] [9619a1d7-cac2-4aeb-a2be-e113abd3b5d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:20:00.980367221Z [2024-05-25 23:20:00,979: INFO/ForkPoolWorker-2] [813364c8-f34e-44b8-92d2-3c1aad21ea83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:20:01.387113963Z [2024-05-25 23:20:01,383: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:20:01.400066657Z [2024-05-25 23:20:01,395: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:20:01.442429546Z [2024-05-25 23:20:01,438: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:20:01.558887538Z [2024-05-25 23:20:01,555: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:20:01.746526534Z [2024-05-25 23:20:01,734: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:20:01.878281966Z [2024-05-25 23:20:01,877: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:20:01.893814006Z [2024-05-25 23:20:01,893: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:20:01.956683639Z [2024-05-25 23:20:01,956: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:20:01.957788279Z [2024-05-25 23:20:01,957: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:20:01.957914742Z [2024-05-25 23:20:01,957: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:20:01.957979422Z [2024-05-25 23:20:01,957: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:20:01.958175220Z [2024-05-25 23:20:01,958: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:20:02.046095070Z [2024-05-25 23:20:02,045: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:20:02.167736595Z [2024-05-25 23:20:02,167: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:20:02.994184235Z [2024-05-25 23:20:02,993: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3cdbd033-5aca-4ee9-ab8b-f798e9b3bfe3] succeeded in 2.0559242470003483s: None 2024-05-25T23:20:03.023936654Z [2024-05-25 23:20:03,023: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:20:03.027186011Z [2024-05-25 23:20:03,026: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:20:03.031957287Z [2024-05-25 23:20:03,031: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[862329c1-1b57-4a45-8694-14f76535a88e] succeeded in 2.0998041339998963s: None 2024-05-25T23:20:03.068625486Z [2024-05-25 23:20:03,068: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:20:03.070125408Z [2024-05-25 23:20:03,069: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:20:03.070190486Z [2024-05-25 23:20:03,070: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:20:03.070348041Z [2024-05-25 23:20:03,070: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:20:03.070412799Z [2024-05-25 23:20:03,070: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:20:03.070705194Z [2024-05-25 23:20:03,070: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:20:03.070776197Z [2024-05-25 23:20:03,070: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:20:03.175673648Z [2024-05-25 23:20:03,174: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:20:03.227750398Z [2024-05-25 23:20:03,227: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:20:03.232226384Z [2024-05-25 23:20:03,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:20:03.280513799Z [2024-05-25 23:20:03,280: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:20:03.281698576Z [2024-05-25 23:20:03,281: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:20:03.281760994Z [2024-05-25 23:20:03,281: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:20:03.281847699Z [2024-05-25 23:20:03,281: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:20:03.281890266Z [2024-05-25 23:20:03,281: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:20:03.282126121Z [2024-05-25 23:20:03,282: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:20:03.282218588Z [2024-05-25 23:20:03,282: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:20:03.339448388Z [2024-05-25 23:20:03,339: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T23:20:03.344230672Z [2024-05-25 23:20:03,343: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:20:03.411651629Z [2024-05-25 23:20:03,410: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:20:03.457268830Z [2024-05-25 23:20:03,448: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T23:20:03.457996638Z [2024-05-25 23:20:03,451: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:20:03.458023857Z [2024-05-25 23:20:03,451: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:20:03.458032549Z [2024-05-25 23:20:03,451: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:20:03.458040918Z [2024-05-25 23:20:03,452: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T23:20:03.458044507Z [2024-05-25 23:20:03,452: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:20:03.458047661Z [2024-05-25 23:20:03,452: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:20:03.686383110Z [2024-05-25 23:20:03,686: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:20:04.612808584Z [2024-05-25 23:20:04,612: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d33ca46f-27ee-4c62-9f78-48fe8ab28d49] succeeded in 3.6939522389998274s: None 2024-05-25T23:20:05.139199807Z [2024-05-25 23:20:05,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a7df025-7a93-4138-8c5c-d6c68e8a7fdf] received 2024-05-25T23:20:05.162847126Z [2024-05-25 23:20:05,162: INFO/ForkPoolWorker-15] [3a7df025-7a93-4138-8c5c-d6c68e8a7fdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:20:05.222792665Z [2024-05-25 23:20:05,222: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[813364c8-f34e-44b8-92d2-3c1aad21ea83] succeeded in 4.282090352000068s: None 2024-05-25T23:20:05.631966054Z [2024-05-25 23:20:05,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:20:05.722959022Z [2024-05-25 23:20:05,722: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9619a1d7-cac2-4aeb-a2be-e113abd3b5d4] succeeded in 4.773066895999818s: None 2024-05-25T23:20:06.907284483Z [2024-05-25 23:20:06,906: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:20:06.910430914Z [2024-05-25 23:20:06,910: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:20:06.933045680Z [2024-05-25 23:20:06,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:20:06.934551177Z [2024-05-25 23:20:06,934: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:20:06.934652712Z [2024-05-25 23:20:06,934: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:20:06.934845548Z [2024-05-25 23:20:06,934: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:20:06.934951816Z [2024-05-25 23:20:06,934: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:20:06.935225085Z [2024-05-25 23:20:06,935: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:20:06.935374945Z [2024-05-25 23:20:06,935: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:20:07.023644884Z [2024-05-25 23:20:07,023: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:20:07.676895921Z [2024-05-25 23:20:07,676: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a7df025-7a93-4138-8c5c-d6c68e8a7fdf] succeeded in 2.5347350069996537s: None 2024-05-25T23:20:07.856097818Z [2024-05-25 23:20:07,855: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7635cb2-967c-45a2-9bb6-e719eb83950e] received 2024-05-25T23:20:07.864019884Z [2024-05-25 23:20:07,863: INFO/ForkPoolWorker-15] [d7635cb2-967c-45a2-9bb6-e719eb83950e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:20:08.151980767Z [2024-05-25 23:20:08,148: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:20:09.278243996Z [2024-05-25 23:20:09,277: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:20:09.281372921Z [2024-05-25 23:20:09,280: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:20:09.304326579Z [2024-05-25 23:20:09,304: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:20:09.305789767Z [2024-05-25 23:20:09,305: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:20:09.305862465Z [2024-05-25 23:20:09,305: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:20:09.305958318Z [2024-05-25 23:20:09,305: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:20:09.305970523Z [2024-05-25 23:20:09,305: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:20:09.306286753Z [2024-05-25 23:20:09,306: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:20:09.306399785Z [2024-05-25 23:20:09,306: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:20:09.441442679Z [2024-05-25 23:20:09,440: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:20:10.066523029Z [2024-05-25 23:20:10,066: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7635cb2-967c-45a2-9bb6-e719eb83950e] succeeded in 2.2086819959999957s: None 2024-05-25T23:20:10.864461249Z [2024-05-25 23:20:10,860: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf4bca11-fd1d-4443-a02f-848d2e83ac27] received 2024-05-25T23:20:10.871510917Z [2024-05-25 23:20:10,871: INFO/ForkPoolWorker-15] [cf4bca11-fd1d-4443-a02f-848d2e83ac27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:20:11.123472414Z [2024-05-25 23:20:11,119: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:20:12.335298650Z [2024-05-25 23:20:12,334: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:20:12.338983907Z [2024-05-25 23:20:12,338: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:20:12.369029440Z [2024-05-25 23:20:12,368: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:20:12.371166395Z [2024-05-25 23:20:12,370: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:20:12.371189870Z [2024-05-25 23:20:12,371: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:20:12.371484915Z [2024-05-25 23:20:12,371: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:20:12.371573695Z [2024-05-25 23:20:12,371: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:20:12.372206851Z [2024-05-25 23:20:12,371: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:20:12.372363836Z [2024-05-25 23:20:12,372: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:20:12.493028095Z [2024-05-25 23:20:12,492: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:20:13.199595698Z [2024-05-25 23:20:13,199: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf4bca11-fd1d-4443-a02f-848d2e83ac27] succeeded in 2.336107138999978s: None 2024-05-25T23:21:00.287236488Z [2024-05-25 23:21:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0aa2c747-5748-48dd-b77d-f4c4a41dafbd] received 2024-05-25T23:21:00.292176672Z [2024-05-25 23:21:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[832f8112-fedb-477e-9c63-2d1ce0b89345] received 2024-05-25T23:21:00.295046913Z [2024-05-25 23:21:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b00c172d-7046-4d09-adaa-708f132c7c2a] received 2024-05-25T23:21:00.309077328Z [2024-05-25 23:21:00,308: INFO/ForkPoolWorker-15] [0aa2c747-5748-48dd-b77d-f4c4a41dafbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:21:00.316666266Z [2024-05-25 23:21:00,316: INFO/ForkPoolWorker-1] [b00c172d-7046-4d09-adaa-708f132c7c2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:21:00.318765167Z [2024-05-25 23:21:00,318: INFO/ForkPoolWorker-16] [832f8112-fedb-477e-9c63-2d1ce0b89345] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:21:00.638236994Z [2024-05-25 23:21:00,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:21:00.642709160Z [2024-05-25 23:21:00,639: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:21:00.696925488Z [2024-05-25 23:21:00,692: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:21:00.810811510Z [2024-05-25 23:21:00,810: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:21:00.815474562Z [2024-05-25 23:21:00,815: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:21:00.844177695Z [2024-05-25 23:21:00,843: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:21:00.845355666Z [2024-05-25 23:21:00,845: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:21:00.845770499Z [2024-05-25 23:21:00,845: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:21:00.845842455Z [2024-05-25 23:21:00,845: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:21:00.846812159Z [2024-05-25 23:21:00,846: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:21:00.960270665Z [2024-05-25 23:21:00,959: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:21:01.597227693Z [2024-05-25 23:21:01,596: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[832f8112-fedb-477e-9c63-2d1ce0b89345] succeeded in 1.3024155480002264s: None 2024-05-25T23:21:01.942948903Z [2024-05-25 23:21:01,942: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:21:01.946643096Z [2024-05-25 23:21:01,946: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:21:01.967270898Z [2024-05-25 23:21:01,967: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:21:01.968907265Z [2024-05-25 23:21:01,968: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:21:01.968951769Z [2024-05-25 23:21:01,968: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:21:01.969222769Z [2024-05-25 23:21:01,968: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:21:01.969321418Z [2024-05-25 23:21:01,969: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:21:01.969714263Z [2024-05-25 23:21:01,969: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:21:01.969817724Z [2024-05-25 23:21:01,969: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:21:02.066097364Z [2024-05-25 23:21:02,065: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:21:02.126106918Z [2024-05-25 23:21:02,125: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:21:02.132275255Z [2024-05-25 23:21:02,131: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:21:02.162438124Z [2024-05-25 23:21:02,162: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:21:02.164542447Z [2024-05-25 23:21:02,164: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:21:02.164569584Z [2024-05-25 23:21:02,164: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:21:02.164777950Z [2024-05-25 23:21:02,164: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:21:02.164886738Z [2024-05-25 23:21:02,164: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:21:02.165198045Z [2024-05-25 23:21:02,165: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:21:02.165319037Z [2024-05-25 23:21:02,165: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:21:02.263062697Z [2024-05-25 23:21:02,262: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:21:03.549321709Z [2024-05-25 23:21:03,548: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0aa2c747-5748-48dd-b77d-f4c4a41dafbd] succeeded in 3.2539743799998178s: None 2024-05-25T23:21:04.092097261Z [2024-05-25 23:21:04,091: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b00c172d-7046-4d09-adaa-708f132c7c2a] succeeded in 3.7923453309999786s: None 2024-05-25T23:22:01.099636252Z [2024-05-25 23:22:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4a0507c-4b9b-4c5f-bf33-b5f94f3c2dc0] received 2024-05-25T23:22:01.103542964Z [2024-05-25 23:22:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b43ae47-3bfa-47e1-a06c-a81f42b6a8e5] received 2024-05-25T23:22:01.105770805Z [2024-05-25 23:22:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2261364-8a9b-469c-a2f0-fd6ce7e5ea51] received 2024-05-25T23:22:01.109390637Z [2024-05-25 23:22:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[438656e8-75eb-4515-9657-9df5f3bb664e] received 2024-05-25T23:22:01.113569148Z [2024-05-25 23:22:01,112: INFO/ForkPoolWorker-1] [a2261364-8a9b-469c-a2f0-fd6ce7e5ea51] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:22:01.114241901Z [2024-05-25 23:22:01,113: INFO/ForkPoolWorker-15] [d4a0507c-4b9b-4c5f-bf33-b5f94f3c2dc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:22:01.133483382Z [2024-05-25 23:22:01,128: INFO/ForkPoolWorker-16] [7b43ae47-3bfa-47e1-a06c-a81f42b6a8e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:22:01.139175711Z [2024-05-25 23:22:01,138: INFO/ForkPoolWorker-2] [438656e8-75eb-4515-9657-9df5f3bb664e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:22:01.509470592Z [2024-05-25 23:22:01,504: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:22:01.521646853Z [2024-05-25 23:22:01,517: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:22:01.531986348Z [2024-05-25 23:22:01,526: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:22:01.564764684Z [2024-05-25 23:22:01,560: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:22:01.771286733Z [2024-05-25 23:22:01,770: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:22:01.786161806Z [2024-05-25 23:22:01,785: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:22:01.836574889Z [2024-05-25 23:22:01,835: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:22:01.838839918Z [2024-05-25 23:22:01,838: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:22:01.839128937Z [2024-05-25 23:22:01,838: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:22:01.839307946Z [2024-05-25 23:22:01,839: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:22:01.839683791Z [2024-05-25 23:22:01,839: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:22:01.885713364Z [2024-05-25 23:22:01,885: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:22:01.978049221Z [2024-05-25 23:22:01,977: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:22:02.449974482Z [2024-05-25 23:22:02,449: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2261364-8a9b-469c-a2f0-fd6ce7e5ea51] succeeded in 1.3426619400001982s: None 2024-05-25T23:22:02.678600143Z [2024-05-25 23:22:02,678: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b43ae47-3bfa-47e1-a06c-a81f42b6a8e5] succeeded in 1.5706270609998683s: None 2024-05-25T23:22:02.928435123Z [2024-05-25 23:22:02,928: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:22:02.931632079Z [2024-05-25 23:22:02,931: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:22:02.952811013Z [2024-05-25 23:22:02,952: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:22:02.954122810Z [2024-05-25 23:22:02,953: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:22:02.954184746Z [2024-05-25 23:22:02,954: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:22:02.954347439Z [2024-05-25 23:22:02,954: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:22:02.954390765Z [2024-05-25 23:22:02,954: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:22:02.954767302Z [2024-05-25 23:22:02,954: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:22:02.954832946Z [2024-05-25 23:22:02,954: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:22:02.967611578Z [2024-05-25 23:22:02,967: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:22:02.970868788Z [2024-05-25 23:22:02,970: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:22:02.988480499Z [2024-05-25 23:22:02,988: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:22:02.989973505Z [2024-05-25 23:22:02,989: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:22:02.990025762Z [2024-05-25 23:22:02,989: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:22:02.990147061Z [2024-05-25 23:22:02,989: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:22:02.990157027Z [2024-05-25 23:22:02,990: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:22:02.990802577Z [2024-05-25 23:22:02,990: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:22:02.990812469Z [2024-05-25 23:22:02,990: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:22:03.076847915Z [2024-05-25 23:22:03,076: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:22:03.084745931Z [2024-05-25 23:22:03,084: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:22:04.858906110Z [2024-05-25 23:22:04,855: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d4a0507c-4b9b-4c5f-bf33-b5f94f3c2dc0] succeeded in 3.7539064520001375s: None 2024-05-25T23:22:05.302455115Z [2024-05-25 23:22:05,301: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[438656e8-75eb-4515-9657-9df5f3bb664e] succeeded in 4.187051194000105s: None 2024-05-25T23:23:00.848862138Z [2024-05-25 23:23:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35b352ae-271d-4890-ac3d-8ef4eb392728] received 2024-05-25T23:23:00.851926539Z [2024-05-25 23:23:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec7f832b-72aa-44b0-b10a-9aaabfa671de] received 2024-05-25T23:23:00.853765905Z [2024-05-25 23:23:00,853: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49ac412c-71c8-411d-9137-1b550dba59b7] received 2024-05-25T23:23:00.873989283Z [2024-05-25 23:23:00,873: INFO/ForkPoolWorker-16] [ec7f832b-72aa-44b0-b10a-9aaabfa671de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:23:00.878814505Z [2024-05-25 23:23:00,878: INFO/ForkPoolWorker-15] [35b352ae-271d-4890-ac3d-8ef4eb392728] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:23:00.879872260Z [2024-05-25 23:23:00,879: INFO/ForkPoolWorker-1] [49ac412c-71c8-411d-9137-1b550dba59b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:23:01.193448493Z [2024-05-25 23:23:01,189: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:23:01.193804880Z [2024-05-25 23:23:01,188: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:23:01.227899721Z [2024-05-25 23:23:01,223: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:23:01.411951321Z [2024-05-25 23:23:01,411: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T23:23:01.417374870Z [2024-05-25 23:23:01,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:23:01.456995868Z [2024-05-25 23:23:01,456: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:23:01.460329599Z [2024-05-25 23:23:01,460: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:23:01.460532518Z [2024-05-25 23:23:01,460: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:23:01.460624599Z [2024-05-25 23:23:01,460: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T23:23:01.460941438Z [2024-05-25 23:23:01,460: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:23:01.578393996Z [2024-05-25 23:23:01,578: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:23:02.164811857Z [2024-05-25 23:23:02,164: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35b352ae-271d-4890-ac3d-8ef4eb392728] succeeded in 1.306496788000004s: None 2024-05-25T23:23:02.490204720Z [2024-05-25 23:23:02,489: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:23:02.493327253Z [2024-05-25 23:23:02,492: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:23:02.518434466Z [2024-05-25 23:23:02,518: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:23:02.520076500Z [2024-05-25 23:23:02,519: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:23:02.520131870Z [2024-05-25 23:23:02,520: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:23:02.520286545Z [2024-05-25 23:23:02,520: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:23:02.520354334Z [2024-05-25 23:23:02,520: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:23:02.520622880Z [2024-05-25 23:23:02,520: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:23:02.520692342Z [2024-05-25 23:23:02,520: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:23:02.527983125Z [2024-05-25 23:23:02,527: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:23:02.531720571Z [2024-05-25 23:23:02,531: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:23:02.560566123Z [2024-05-25 23:23:02,560: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:23:02.562162571Z [2024-05-25 23:23:02,561: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:23:02.562334038Z [2024-05-25 23:23:02,562: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:23:02.562624882Z [2024-05-25 23:23:02,562: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:23:02.562782371Z [2024-05-25 23:23:02,562: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:23:02.563163590Z [2024-05-25 23:23:02,562: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:23:02.563394748Z [2024-05-25 23:23:02,563: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:23:02.621003546Z [2024-05-25 23:23:02,620: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:23:02.677632647Z [2024-05-25 23:23:02,677: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:23:04.614742936Z [2024-05-25 23:23:04,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec7f832b-72aa-44b0-b10a-9aaabfa671de] succeeded in 3.752334324000003s: None 2024-05-25T23:23:05.119404013Z [2024-05-25 23:23:05,119: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49ac412c-71c8-411d-9137-1b550dba59b7] succeeded in 4.260585094999897s: None 2024-05-25T23:24:00.566238654Z [2024-05-25 23:24:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3144e810-fbbb-4769-ad32-cfda1ae156aa] received 2024-05-25T23:24:00.569434380Z [2024-05-25 23:24:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b078291-8d1d-4a49-a97d-7cd1adc32c6e] received 2024-05-25T23:24:00.575175703Z [2024-05-25 23:24:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0526536f-ed43-4c71-9f75-f504182a84e7] received 2024-05-25T23:24:00.581134743Z [2024-05-25 23:24:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[503a4426-2aa2-4d73-ada6-3aacdb44b799] received 2024-05-25T23:24:00.583967155Z [2024-05-25 23:24:00,583: INFO/ForkPoolWorker-1] [0526536f-ed43-4c71-9f75-f504182a84e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:24:00.590843375Z [2024-05-25 23:24:00,590: INFO/ForkPoolWorker-16] [6b078291-8d1d-4a49-a97d-7cd1adc32c6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:24:00.593114836Z [2024-05-25 23:24:00,592: INFO/ForkPoolWorker-15] [3144e810-fbbb-4769-ad32-cfda1ae156aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:24:00.602697325Z [2024-05-25 23:24:00,602: INFO/ForkPoolWorker-2] [503a4426-2aa2-4d73-ada6-3aacdb44b799] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:24:00.932641243Z [2024-05-25 23:24:00,929: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:24:00.943618849Z [2024-05-25 23:24:00,938: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:24:00.990569060Z [2024-05-25 23:24:00,986: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:24:00.999435388Z [2024-05-25 23:24:00,995: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:24:01.173710142Z [2024-05-25 23:24:01,173: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:24:01.192537759Z [2024-05-25 23:24:01,192: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:24:01.196402699Z [2024-05-25 23:24:01,196: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:24:01.248824082Z [2024-05-25 23:24:01,248: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:24:01.254583305Z [2024-05-25 23:24:01,254: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:24:01.254927776Z [2024-05-25 23:24:01,254: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:24:01.255200989Z [2024-05-25 23:24:01,255: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:24:01.255531201Z [2024-05-25 23:24:01,255: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:24:01.412558042Z [2024-05-25 23:24:01,412: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:24:01.830918560Z [2024-05-25 23:24:01,830: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0526536f-ed43-4c71-9f75-f504182a84e7] succeeded in 1.2539246740002454s: None 2024-05-25T23:24:02.096694458Z [2024-05-25 23:24:02,096: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b078291-8d1d-4a49-a97d-7cd1adc32c6e] succeeded in 1.525025263000316s: None 2024-05-25T23:24:02.250494252Z [2024-05-25 23:24:02,250: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:24:02.253931713Z [2024-05-25 23:24:02,253: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:24:02.277250432Z [2024-05-25 23:24:02,277: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:24:02.281974363Z [2024-05-25 23:24:02,281: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:24:02.282154833Z [2024-05-25 23:24:02,282: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:24:02.282349502Z [2024-05-25 23:24:02,282: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:24:02.282448382Z [2024-05-25 23:24:02,282: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:24:02.282839503Z [2024-05-25 23:24:02,282: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:24:02.285271298Z [2024-05-25 23:24:02,285: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:24:02.372178253Z [2024-05-25 23:24:02,371: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:24:02.373489510Z [2024-05-25 23:24:02,373: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:24:02.375166836Z [2024-05-25 23:24:02,374: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:24:02.397849543Z [2024-05-25 23:24:02,397: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:24:02.399295878Z [2024-05-25 23:24:02,399: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:24:02.399310899Z [2024-05-25 23:24:02,399: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:24:02.399420307Z [2024-05-25 23:24:02,399: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:24:02.399499486Z [2024-05-25 23:24:02,399: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:24:02.399811379Z [2024-05-25 23:24:02,399: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:24:02.399821243Z [2024-05-25 23:24:02,399: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:24:02.479152416Z [2024-05-25 23:24:02,478: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:24:03.879379070Z [2024-05-25 23:24:03,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3144e810-fbbb-4769-ad32-cfda1ae156aa] succeeded in 3.308864484999958s: None 2024-05-25T23:24:04.572207697Z [2024-05-25 23:24:04,571: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[503a4426-2aa2-4d73-ada6-3aacdb44b799] succeeded in 3.9861789760002466s: None 2024-05-25T23:25:00.828070692Z [2024-05-25 23:25:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[699d88b1-494d-4ad8-a47d-56eb332b9d90] received 2024-05-25T23:25:00.833517049Z [2024-05-25 23:25:00,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44397030-f040-441f-be9f-d2c5015776a0] received 2024-05-25T23:25:00.836326826Z [2024-05-25 23:25:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac36e220-eae7-4545-8a9c-bd5cbb4f41eb] received 2024-05-25T23:25:00.839807087Z [2024-05-25 23:25:00,839: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d06a23d-d070-4de1-9d68-a5f7a834e021] received 2024-05-25T23:25:00.851774277Z [2024-05-25 23:25:00,851: INFO/ForkPoolWorker-1] [ac36e220-eae7-4545-8a9c-bd5cbb4f41eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:25:00.851947495Z [2024-05-25 23:25:00,851: INFO/ForkPoolWorker-16] [44397030-f040-441f-be9f-d2c5015776a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:25:00.854242648Z [2024-05-25 23:25:00,853: INFO/ForkPoolWorker-2] [2d06a23d-d070-4de1-9d68-a5f7a834e021] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:25:00.861596321Z [2024-05-25 23:25:00,861: INFO/ForkPoolWorker-15] [699d88b1-494d-4ad8-a47d-56eb332b9d90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:25:01.146570383Z [2024-05-25 23:25:01,142: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:25:01.159734038Z [2024-05-25 23:25:01,156: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:25:01.296533845Z [2024-05-25 23:25:01,292: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:25:01.335159978Z [2024-05-25 23:25:01,331: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:25:01.523029200Z [2024-05-25 23:25:01,522: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:25:01.527185018Z [2024-05-25 23:25:01,526: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:25:01.576721308Z [2024-05-25 23:25:01,576: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:25:01.580245217Z [2024-05-25 23:25:01,580: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:25:01.580289405Z [2024-05-25 23:25:01,580: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:25:01.580337910Z [2024-05-25 23:25:01,580: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:25:01.580573721Z [2024-05-25 23:25:01,580: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:25:01.712105840Z [2024-05-25 23:25:01,711: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:25:02.580939679Z [2024-05-25 23:25:02,580: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2d06a23d-d070-4de1-9d68-a5f7a834e021] succeeded in 1.7379945830002725s: None 2024-05-25T23:25:02.740191451Z [2024-05-25 23:25:02,739: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:25:02.743595611Z [2024-05-25 23:25:02,743: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:25:02.777079048Z [2024-05-25 23:25:02,776: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:25:02.778880615Z [2024-05-25 23:25:02,778: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:25:02.778891086Z [2024-05-25 23:25:02,778: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:25:02.779018325Z [2024-05-25 23:25:02,778: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:25:02.779032085Z [2024-05-25 23:25:02,778: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:25:02.779285680Z [2024-05-25 23:25:02,779: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:25:02.779298497Z [2024-05-25 23:25:02,779: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:25:02.889796419Z [2024-05-25 23:25:02,889: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:25:02.894440003Z [2024-05-25 23:25:02,893: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:25:02.922545275Z [2024-05-25 23:25:02,922: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:25:02.950811737Z [2024-05-25 23:25:02,950: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:25:02.954739403Z [2024-05-25 23:25:02,954: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:25:02.955250468Z [2024-05-25 23:25:02,954: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:25:02.955542232Z [2024-05-25 23:25:02,955: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:25:02.955697651Z [2024-05-25 23:25:02,955: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:25:02.956051213Z [2024-05-25 23:25:02,955: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:25:02.956668223Z [2024-05-25 23:25:02,956: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:25:02.979512706Z [2024-05-25 23:25:02,979: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:25:02.982840932Z [2024-05-25 23:25:02,982: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:25:03.015119006Z [2024-05-25 23:25:03,014: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:25:03.016882600Z [2024-05-25 23:25:03,016: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:25:03.017668107Z [2024-05-25 23:25:03,016: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:25:03.017890944Z [2024-05-25 23:25:03,017: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:25:03.018045979Z [2024-05-25 23:25:03,017: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:25:03.018384547Z [2024-05-25 23:25:03,018: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:25:03.019921494Z [2024-05-25 23:25:03,018: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:25:03.089268365Z [2024-05-25 23:25:03,088: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:25:03.141009091Z [2024-05-25 23:25:03,140: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:25:03.998305365Z [2024-05-25 23:25:03,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ce1dde9-60fc-409a-9731-149acd37b8e9] received 2024-05-25T23:25:04.013519084Z [2024-05-25 23:25:04,013: INFO/ForkPoolWorker-2] [3ce1dde9-60fc-409a-9731-149acd37b8e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:25:04.113913780Z [2024-05-25 23:25:04,113: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[699d88b1-494d-4ad8-a47d-56eb332b9d90] succeeded in 3.281490648000272s: None 2024-05-25T23:25:04.345954356Z [2024-05-25 23:25:04,342: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:25:04.647403751Z [2024-05-25 23:25:04,644: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[44397030-f040-441f-be9f-d2c5015776a0] succeeded in 3.809266607000154s: None 2024-05-25T23:25:05.196568485Z [2024-05-25 23:25:05,196: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ac36e220-eae7-4545-8a9c-bd5cbb4f41eb] succeeded in 4.353658344999985s: None 2024-05-25T23:25:05.647318258Z [2024-05-25 23:25:05,647: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:25:05.650388121Z [2024-05-25 23:25:05,650: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:25:05.676075151Z [2024-05-25 23:25:05,675: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:25:05.677249962Z [2024-05-25 23:25:05,677: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:25:05.677356906Z [2024-05-25 23:25:05,677: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:25:05.677579296Z [2024-05-25 23:25:05,677: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:25:05.677683032Z [2024-05-25 23:25:05,677: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:25:05.677951096Z [2024-05-25 23:25:05,677: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:25:05.678403476Z [2024-05-25 23:25:05,677: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:25:05.753277825Z [2024-05-25 23:25:05,752: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:25:06.381452925Z [2024-05-25 23:25:06,381: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3ce1dde9-60fc-409a-9731-149acd37b8e9] succeeded in 2.3807788789999904s: None 2024-05-25T23:25:06.532399362Z [2024-05-25 23:25:06,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a39281df-a9d4-4230-82c2-f7bd3d5be0f6] received 2024-05-25T23:25:06.550703126Z [2024-05-25 23:25:06,550: INFO/ForkPoolWorker-15] [a39281df-a9d4-4230-82c2-f7bd3d5be0f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:25:06.841941246Z [2024-05-25 23:25:06,838: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:25:07.920691851Z [2024-05-25 23:25:07,920: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:25:07.924379481Z [2024-05-25 23:25:07,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:25:07.947291644Z [2024-05-25 23:25:07,947: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:25:07.948825846Z [2024-05-25 23:25:07,948: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:25:07.949014909Z [2024-05-25 23:25:07,948: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:25:07.949221013Z [2024-05-25 23:25:07,949: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:25:07.949339969Z [2024-05-25 23:25:07,949: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:25:07.949598057Z [2024-05-25 23:25:07,949: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:25:07.949753023Z [2024-05-25 23:25:07,949: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:25:08.051624106Z [2024-05-25 23:25:08,051: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:25:08.633763456Z [2024-05-25 23:25:08,633: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a39281df-a9d4-4230-82c2-f7bd3d5be0f6] succeeded in 2.0978471839998747s: None 2024-05-25T23:25:09.324032320Z [2024-05-25 23:25:09,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ec17539-abf1-4837-9eae-df96ead5e142] received 2024-05-25T23:25:09.337549115Z [2024-05-25 23:25:09,337: INFO/ForkPoolWorker-15] [4ec17539-abf1-4837-9eae-df96ead5e142] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:25:09.624298726Z [2024-05-25 23:25:09,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:25:10.694765255Z [2024-05-25 23:25:10,694: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:25:10.698136737Z [2024-05-25 23:25:10,697: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:25:10.750189842Z [2024-05-25 23:25:10,744: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:25:10.756290074Z [2024-05-25 23:25:10,748: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:25:10.756318252Z [2024-05-25 23:25:10,748: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:25:10.756322801Z [2024-05-25 23:25:10,748: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:25:10.756327129Z [2024-05-25 23:25:10,748: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:25:10.756330116Z [2024-05-25 23:25:10,749: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:25:10.756333306Z [2024-05-25 23:25:10,749: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:25:10.852144843Z [2024-05-25 23:25:10,851: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:25:11.481571925Z [2024-05-25 23:25:11,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ec17539-abf1-4837-9eae-df96ead5e142] succeeded in 2.1525000520000503s: None 2024-05-25T23:26:01.040000927Z [2024-05-25 23:26:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9ecb4c1-dcf8-4c88-9483-871b6b4cf7c2] received 2024-05-25T23:26:01.043391282Z [2024-05-25 23:26:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0642acbe-e25b-4d7b-a174-50e1c7c264fa] received 2024-05-25T23:26:01.045775316Z [2024-05-25 23:26:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39b85a5e-5d7e-4fde-879e-49a4dde62516] received 2024-05-25T23:26:01.056285021Z [2024-05-25 23:26:01,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93a5d0a1-1961-4c40-aa47-5437c1244d5f] received 2024-05-25T23:26:01.057837681Z [2024-05-25 23:26:01,057: INFO/ForkPoolWorker-16] [0642acbe-e25b-4d7b-a174-50e1c7c264fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:26:01.058718547Z [2024-05-25 23:26:01,058: INFO/ForkPoolWorker-1] [39b85a5e-5d7e-4fde-879e-49a4dde62516] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:26:01.060891381Z [2024-05-25 23:26:01,060: INFO/ForkPoolWorker-15] [b9ecb4c1-dcf8-4c88-9483-871b6b4cf7c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:26:01.069771154Z [2024-05-25 23:26:01,069: INFO/ForkPoolWorker-2] [93a5d0a1-1961-4c40-aa47-5437c1244d5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:26:01.383258260Z [2024-05-25 23:26:01,380: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:26:01.386940832Z [2024-05-25 23:26:01,383: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:26:01.539253378Z [2024-05-25 23:26:01,536: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:26:01.548111381Z [2024-05-25 23:26:01,543: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:26:01.564442624Z [2024-05-25 23:26:01,564: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:26:01.570703730Z [2024-05-25 23:26:01,569: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:26:01.608931615Z [2024-05-25 23:26:01,608: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:26:01.612132485Z [2024-05-25 23:26:01,611: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:26:01.612394744Z [2024-05-25 23:26:01,612: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:26:01.612572978Z [2024-05-25 23:26:01,612: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:26:01.612945123Z [2024-05-25 23:26:01,612: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:26:01.756227704Z [2024-05-25 23:26:01,755: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:26:02.011105442Z [2024-05-25 23:26:02,010: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:26:02.556638964Z [2024-05-25 23:26:02,556: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[93a5d0a1-1961-4c40-aa47-5437c1244d5f] succeeded in 1.493125061000228s: None 2024-05-25T23:26:02.684188354Z [2024-05-25 23:26:02,683: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:26:02.687598233Z [2024-05-25 23:26:02,687: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:26:02.721456859Z [2024-05-25 23:26:02,721: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:26:02.722646536Z [2024-05-25 23:26:02,722: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:26:02.722799971Z [2024-05-25 23:26:02,722: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:26:02.722988820Z [2024-05-25 23:26:02,722: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:26:02.723022017Z [2024-05-25 23:26:02,722: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:26:02.723298600Z [2024-05-25 23:26:02,723: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:26:02.723354948Z [2024-05-25 23:26:02,723: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:26:02.823214671Z [2024-05-25 23:26:02,822: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:26:02.888510269Z [2024-05-25 23:26:02,888: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9ecb4c1-dcf8-4c88-9483-871b6b4cf7c2] succeeded in 1.8447112220001145s: None 2024-05-25T23:26:03.268590460Z [2024-05-25 23:26:03,268: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:26:03.271865437Z [2024-05-25 23:26:03,271: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:26:03.312596125Z [2024-05-25 23:26:03,311: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:26:03.313541209Z [2024-05-25 23:26:03,313: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:26:03.313760728Z [2024-05-25 23:26:03,313: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:26:03.313994707Z [2024-05-25 23:26:03,313: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:26:03.314124975Z [2024-05-25 23:26:03,314: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:26:03.314372832Z [2024-05-25 23:26:03,314: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:26:03.316421908Z [2024-05-25 23:26:03,314: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:26:03.439665707Z [2024-05-25 23:26:03,436: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:26:04.502789981Z [2024-05-25 23:26:04,497: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0642acbe-e25b-4d7b-a174-50e1c7c264fa] succeeded in 3.450518754999848s: None 2024-05-25T23:26:05.199441009Z [2024-05-25 23:26:05,198: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[39b85a5e-5d7e-4fde-879e-49a4dde62516] succeeded in 4.151001413999893s: None 2024-05-25T23:27:00.220794734Z [2024-05-25 23:27:00,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c355a1c5-977f-4dff-98db-43ee4209c544] received 2024-05-25T23:27:00.230519763Z [2024-05-25 23:27:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c78bc61f-d162-4c7c-90a3-3ac992cf052f] received 2024-05-25T23:27:00.235165329Z [2024-05-25 23:27:00,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd3e1cc2-5789-460e-9faa-c7461f48e89c] received 2024-05-25T23:27:00.238220449Z [2024-05-25 23:27:00,237: INFO/ForkPoolWorker-15] [c355a1c5-977f-4dff-98db-43ee4209c544] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:27:00.240976444Z [2024-05-25 23:27:00,240: INFO/ForkPoolWorker-16] [c78bc61f-d162-4c7c-90a3-3ac992cf052f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:27:00.251282979Z [2024-05-25 23:27:00,250: INFO/ForkPoolWorker-1] [fd3e1cc2-5789-460e-9faa-c7461f48e89c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:27:00.565626856Z [2024-05-25 23:27:00,561: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:27:00.566669809Z [2024-05-25 23:27:00,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:27:00.583541197Z [2024-05-25 23:27:00,579: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:27:00.807590765Z [2024-05-25 23:27:00,803: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:27:00.812915269Z [2024-05-25 23:27:00,807: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:27:00.877085362Z [2024-05-25 23:27:00,876: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:27:00.882469165Z [2024-05-25 23:27:00,882: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:27:00.882721953Z [2024-05-25 23:27:00,882: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:27:00.882830573Z [2024-05-25 23:27:00,882: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:27:00.883073657Z [2024-05-25 23:27:00,882: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:27:01.009695135Z [2024-05-25 23:27:01,009: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:27:01.587217649Z [2024-05-25 23:27:01,586: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fd3e1cc2-5789-460e-9faa-c7461f48e89c] succeeded in 1.3464217959999587s: None 2024-05-25T23:27:01.848370629Z [2024-05-25 23:27:01,848: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:27:01.851558407Z [2024-05-25 23:27:01,851: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:27:01.871833105Z [2024-05-25 23:27:01,871: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:27:01.872941488Z [2024-05-25 23:27:01,872: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:27:01.873531015Z [2024-05-25 23:27:01,873: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:27:01.873714998Z [2024-05-25 23:27:01,873: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:27:01.873960092Z [2024-05-25 23:27:01,873: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:27:01.874062967Z [2024-05-25 23:27:01,873: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:27:01.874385988Z [2024-05-25 23:27:01,874: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:27:01.874531736Z [2024-05-25 23:27:01,874: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:27:01.876486995Z [2024-05-25 23:27:01,876: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:27:01.897723576Z [2024-05-25 23:27:01,897: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:27:01.899248348Z [2024-05-25 23:27:01,899: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:27:01.899362984Z [2024-05-25 23:27:01,899: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:27:01.899617947Z [2024-05-25 23:27:01,899: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:27:01.899729547Z [2024-05-25 23:27:01,899: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:27:01.900036943Z [2024-05-25 23:27:01,899: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:27:01.900147227Z [2024-05-25 23:27:01,899: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:27:01.970904723Z [2024-05-25 23:27:01,970: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:27:01.988319363Z [2024-05-25 23:27:01,988: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:27:03.459918513Z [2024-05-25 23:27:03,459: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c355a1c5-977f-4dff-98db-43ee4209c544] succeeded in 3.234344063000208s: None 2024-05-25T23:27:03.827894543Z [2024-05-25 23:27:03,827: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c78bc61f-d162-4c7c-90a3-3ac992cf052f] succeeded in 3.5946714789997714s: None 2024-05-25T23:28:00.840695847Z [2024-05-25 23:28:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42970aa4-5912-4f19-a170-4a63e477bdb7] received 2024-05-25T23:28:00.844798631Z [2024-05-25 23:28:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e82177e-e54a-4ea3-b53b-ad528d0fb1bb] received 2024-05-25T23:28:00.857460106Z [2024-05-25 23:28:00,857: INFO/ForkPoolWorker-15] [42970aa4-5912-4f19-a170-4a63e477bdb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:28:00.857768679Z [2024-05-25 23:28:00,857: INFO/ForkPoolWorker-16] [5e82177e-e54a-4ea3-b53b-ad528d0fb1bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:28:00.863147991Z [2024-05-25 23:28:00,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d272b0b7-f860-41f4-babb-a81c420d1a74] received 2024-05-25T23:28:00.864946279Z [2024-05-25 23:28:00,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3bfdc6b-8476-4846-9931-80db0c18f58a] received 2024-05-25T23:28:00.876281951Z [2024-05-25 23:28:00,875: INFO/ForkPoolWorker-1] [d272b0b7-f860-41f4-babb-a81c420d1a74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:28:00.879829724Z [2024-05-25 23:28:00,879: INFO/ForkPoolWorker-2] [e3bfdc6b-8476-4846-9931-80db0c18f58a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:28:01.131990454Z [2024-05-25 23:28:01,128: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:28:01.233588693Z [2024-05-25 23:28:01,230: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:28:01.238278335Z [2024-05-25 23:28:01,234: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:28:01.281446026Z [2024-05-25 23:28:01,277: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:28:01.420006480Z [2024-05-25 23:28:01,419: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:28:01.533044995Z [2024-05-25 23:28:01,532: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:28:01.539959208Z [2024-05-25 23:28:01,536: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:28:01.589156191Z [2024-05-25 23:28:01,588: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:28:01.591396119Z [2024-05-25 23:28:01,591: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:28:01.591707085Z [2024-05-25 23:28:01,591: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:28:01.591967388Z [2024-05-25 23:28:01,591: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:28:01.592446218Z [2024-05-25 23:28:01,592: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:28:01.767313693Z [2024-05-25 23:28:01,767: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:28:02.029467235Z [2024-05-25 23:28:02,028: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[42970aa4-5912-4f19-a170-4a63e477bdb7] succeeded in 1.1856468959999802s: None 2024-05-25T23:28:02.449466542Z [2024-05-25 23:28:02,448: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e3bfdc6b-8476-4846-9931-80db0c18f58a] succeeded in 1.5793307320000167s: None 2024-05-25T23:28:02.566252701Z [2024-05-25 23:28:02,565: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:28:02.569668455Z [2024-05-25 23:28:02,569: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:28:02.597908723Z [2024-05-25 23:28:02,597: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:28:02.599276506Z [2024-05-25 23:28:02,599: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:28:02.599456315Z [2024-05-25 23:28:02,599: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:28:02.599707092Z [2024-05-25 23:28:02,599: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:28:02.599857570Z [2024-05-25 23:28:02,599: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:28:02.600196669Z [2024-05-25 23:28:02,600: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:28:02.600408152Z [2024-05-25 23:28:02,600: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:28:02.702366334Z [2024-05-25 23:28:02,702: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:28:02.871150950Z [2024-05-25 23:28:02,870: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:28:02.874222803Z [2024-05-25 23:28:02,873: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:28:02.905891123Z [2024-05-25 23:28:02,905: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:28:02.908463754Z [2024-05-25 23:28:02,908: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:28:02.908474673Z [2024-05-25 23:28:02,908: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:28:02.908585274Z [2024-05-25 23:28:02,908: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:28:02.908668385Z [2024-05-25 23:28:02,908: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:28:02.908919086Z [2024-05-25 23:28:02,908: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:28:02.908935339Z [2024-05-25 23:28:02,908: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:28:03.006336332Z [2024-05-25 23:28:03,005: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:28:04.233969965Z [2024-05-25 23:28:04,233: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e82177e-e54a-4ea3-b53b-ad528d0fb1bb] succeeded in 3.385631870999987s: None 2024-05-25T23:28:04.932599892Z [2024-05-25 23:28:04,932: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d272b0b7-f860-41f4-babb-a81c420d1a74] succeeded in 4.0656754999999976s: None 2024-05-25T23:29:00.914798010Z [2024-05-25 23:29:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee231098-cbe1-46fe-aa29-8a2488f0ef46] received 2024-05-25T23:29:00.926405992Z [2024-05-25 23:29:00,926: INFO/ForkPoolWorker-15] [ee231098-cbe1-46fe-aa29-8a2488f0ef46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:29:00.926967252Z [2024-05-25 23:29:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78fa69ef-ca9d-4db6-bed2-899904add775] received 2024-05-25T23:29:00.935676859Z [2024-05-25 23:29:00,935: INFO/ForkPoolWorker-16] [78fa69ef-ca9d-4db6-bed2-899904add775] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:29:00.942090975Z [2024-05-25 23:29:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[339946d1-18f5-494b-b577-89325ec303bb] received 2024-05-25T23:29:00.954031660Z [2024-05-25 23:29:00,953: INFO/ForkPoolWorker-1] [339946d1-18f5-494b-b577-89325ec303bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:29:01.238651292Z [2024-05-25 23:29:01,235: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:29:01.294072173Z [2024-05-25 23:29:01,290: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:29:01.319789858Z [2024-05-25 23:29:01,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:29:01.478791628Z [2024-05-25 23:29:01,478: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:29:01.483284378Z [2024-05-25 23:29:01,482: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:29:01.521316069Z [2024-05-25 23:29:01,521: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:29:01.522408193Z [2024-05-25 23:29:01,522: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:29:01.522585782Z [2024-05-25 23:29:01,522: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:29:01.522717447Z [2024-05-25 23:29:01,522: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:29:01.523119974Z [2024-05-25 23:29:01,522: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:29:01.616085490Z [2024-05-25 23:29:01,615: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:29:02.282662207Z [2024-05-25 23:29:02,282: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[339946d1-18f5-494b-b577-89325ec303bb] succeeded in 1.3385764220001874s: None 2024-05-25T23:29:02.495470315Z [2024-05-25 23:29:02,495: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:29:02.498909951Z [2024-05-25 23:29:02,498: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:29:02.513866966Z [2024-05-25 23:29:02,513: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:29:02.517427203Z [2024-05-25 23:29:02,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:29:02.519924783Z [2024-05-25 23:29:02,519: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:29:02.521198645Z [2024-05-25 23:29:02,520: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:29:02.521212313Z [2024-05-25 23:29:02,521: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:29:02.521373436Z [2024-05-25 23:29:02,521: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:29:02.521380247Z [2024-05-25 23:29:02,521: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:29:02.521604344Z [2024-05-25 23:29:02,521: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:29:02.521633909Z [2024-05-25 23:29:02,521: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:29:02.549884661Z [2024-05-25 23:29:02,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:29:02.552246028Z [2024-05-25 23:29:02,552: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:29:02.552287704Z [2024-05-25 23:29:02,552: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:29:02.552612537Z [2024-05-25 23:29:02,552: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:29:02.552694285Z [2024-05-25 23:29:02,552: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:29:02.553186914Z [2024-05-25 23:29:02,553: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:29:02.553372358Z [2024-05-25 23:29:02,553: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:29:02.609013351Z [2024-05-25 23:29:02,608: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:29:02.660899276Z [2024-05-25 23:29:02,660: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:29:05.107207119Z [2024-05-25 23:29:05,106: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee231098-cbe1-46fe-aa29-8a2488f0ef46] succeeded in 4.190222504999838s: None 2024-05-25T23:29:05.462414110Z [2024-05-25 23:29:05,461: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78fa69ef-ca9d-4db6-bed2-899904add775] succeeded in 4.5323458689999825s: None 2024-05-25T23:30:00.392579040Z [2024-05-25 23:30:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3373fce6-f82a-4448-88da-74bbb16c2ebc] received 2024-05-25T23:30:00.394965800Z [2024-05-25 23:30:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16122c97-8f1d-4968-9696-203928f17524] received 2024-05-25T23:30:00.401504882Z [2024-05-25 23:30:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2eb0a566-52e5-477b-aed4-a7fcb16051a7] received 2024-05-25T23:30:00.403129654Z [2024-05-25 23:30:00,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39ced4e4-e2c6-46b2-8125-9aa4437650a0] received 2024-05-25T23:30:00.406882977Z [2024-05-25 23:30:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fb2a256-c436-4d67-9a65-8ce0be6e3265] received 2024-05-25T23:30:00.412560060Z [2024-05-25 23:30:00,412: INFO/ForkPoolWorker-16] [16122c97-8f1d-4968-9696-203928f17524] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:30:00.415930476Z [2024-05-25 23:30:00,412: INFO/ForkPoolWorker-15] [3373fce6-f82a-4448-88da-74bbb16c2ebc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:30:00.417532822Z [2024-05-25 23:30:00,417: INFO/ForkPoolWorker-1] [2eb0a566-52e5-477b-aed4-a7fcb16051a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:30:00.427417331Z [2024-05-25 23:30:00,427: INFO/ForkPoolWorker-2] [39ced4e4-e2c6-46b2-8125-9aa4437650a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:30:00.428519278Z [2024-05-25 23:30:00,428: INFO/ForkPoolWorker-3] [9fb2a256-c436-4d67-9a65-8ce0be6e3265] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:30:00.857664895Z [2024-05-25 23:30:00,853: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:30:00.900583999Z [2024-05-25 23:30:00,897: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:30:01.080792431Z [2024-05-25 23:30:01,077: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:30:01.272976081Z [2024-05-25 23:30:01,272: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T23:30:01.277630910Z [2024-05-25 23:30:01,277: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:30:01.287340137Z [2024-05-25 23:30:01,286: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:30:01.317321193Z [2024-05-25 23:30:01,313: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:30:01.356315520Z [2024-05-25 23:30:01,356: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T23:30:01.361350259Z [2024-05-25 23:30:01,361: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:30:01.361391486Z [2024-05-25 23:30:01,361: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:30:01.361439624Z [2024-05-25 23:30:01,361: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T23:30:01.361609243Z [2024-05-25 23:30:01,361: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:30:01.460441759Z [2024-05-25 23:30:01,444: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:30:01.525481142Z [2024-05-25 23:30:01,525: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:30:01.989192541Z [2024-05-25 23:30:01,988: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[16122c97-8f1d-4968-9696-203928f17524] succeeded in 1.59158450599989s: None 2024-05-25T23:30:02.240682266Z [2024-05-25 23:30:02,240: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9fb2a256-c436-4d67-9a65-8ce0be6e3265] succeeded in 1.828106373999617s: None 2024-05-25T23:30:02.570483699Z [2024-05-25 23:30:02,570: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:30:02.571081361Z [2024-05-25 23:30:02,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:30:02.573874453Z [2024-05-25 23:30:02,573: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:30:02.574484844Z [2024-05-25 23:30:02,574: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:30:02.598198067Z [2024-05-25 23:30:02,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:30:02.599705381Z [2024-05-25 23:30:02,599: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:30:02.599850412Z [2024-05-25 23:30:02,599: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:30:02.600025532Z [2024-05-25 23:30:02,599: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:30:02.600138244Z [2024-05-25 23:30:02,600: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:30:02.600479007Z [2024-05-25 23:30:02,600: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:30:02.600554672Z [2024-05-25 23:30:02,600: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:30:02.612381797Z [2024-05-25 23:30:02,612: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:30:02.622134867Z [2024-05-25 23:30:02,621: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:30:02.622395242Z [2024-05-25 23:30:02,622: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:30:02.622703070Z [2024-05-25 23:30:02,622: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:30:02.622889835Z [2024-05-25 23:30:02,622: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:30:02.623421128Z [2024-05-25 23:30:02,623: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:30:02.623750243Z [2024-05-25 23:30:02,623: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:30:02.684038708Z [2024-05-25 23:30:02,683: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:30:02.719430118Z [2024-05-25 23:30:02,719: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:30:03.073550773Z [2024-05-25 23:30:03,073: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:30:03.100857253Z [2024-05-25 23:30:03,100: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:30:03.135882950Z [2024-05-25 23:30:03,135: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:30:03.140891092Z [2024-05-25 23:30:03,140: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:30:03.141073557Z [2024-05-25 23:30:03,140: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:30:03.141418150Z [2024-05-25 23:30:03,141: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:30:03.141558757Z [2024-05-25 23:30:03,141: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:30:03.141920758Z [2024-05-25 23:30:03,141: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:30:03.142007044Z [2024-05-25 23:30:03,141: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:30:03.285298510Z [2024-05-25 23:30:03,284: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3373fce6-f82a-4448-88da-74bbb16c2ebc] succeeded in 2.8892453039998145s: None 2024-05-25T23:30:03.288832178Z [2024-05-25 23:30:03,288: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:30:03.379056821Z [2024-05-25 23:30:03,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea924f3a-21e6-4223-9e6e-01579edb4715] received 2024-05-25T23:30:03.401336428Z [2024-05-25 23:30:03,400: INFO/ForkPoolWorker-15] [ea924f3a-21e6-4223-9e6e-01579edb4715] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:30:03.921116559Z [2024-05-25 23:30:03,918: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:30:04.318281887Z [2024-05-25 23:30:04,317: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[39ced4e4-e2c6-46b2-8125-9aa4437650a0] succeeded in 3.9125061360000473s: None 2024-05-25T23:30:05.216171989Z [2024-05-25 23:30:05,215: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2eb0a566-52e5-477b-aed4-a7fcb16051a7] succeeded in 4.811375090999718s: None 2024-05-25T23:30:05.282668142Z [2024-05-25 23:30:05,282: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:30:05.285903358Z [2024-05-25 23:30:05,285: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:30:05.317642837Z [2024-05-25 23:30:05,317: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:30:05.319573532Z [2024-05-25 23:30:05,319: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:30:05.319723038Z [2024-05-25 23:30:05,319: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:30:05.319932601Z [2024-05-25 23:30:05,319: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:30:05.320055573Z [2024-05-25 23:30:05,319: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:30:05.320403720Z [2024-05-25 23:30:05,320: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:30:05.320523046Z [2024-05-25 23:30:05,320: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:30:05.425003304Z [2024-05-25 23:30:05,424: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:30:06.146468260Z [2024-05-25 23:30:06,146: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea924f3a-21e6-4223-9e6e-01579edb4715] succeeded in 2.765811504999874s: None 2024-05-25T23:30:06.237229301Z [2024-05-25 23:30:06,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16353ef1-ce61-4a4c-8592-b7acac1b9995] received 2024-05-25T23:30:06.250484000Z [2024-05-25 23:30:06,250: INFO/ForkPoolWorker-15] [16353ef1-ce61-4a4c-8592-b7acac1b9995] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:30:06.551102650Z [2024-05-25 23:30:06,547: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:30:07.821408789Z [2024-05-25 23:30:07,820: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:30:07.824957522Z [2024-05-25 23:30:07,824: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:30:07.850158197Z [2024-05-25 23:30:07,849: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:30:07.851980669Z [2024-05-25 23:30:07,851: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:30:07.852141595Z [2024-05-25 23:30:07,851: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:30:07.852396655Z [2024-05-25 23:30:07,852: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:30:07.852580727Z [2024-05-25 23:30:07,852: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:30:07.852975218Z [2024-05-25 23:30:07,852: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:30:07.853174315Z [2024-05-25 23:30:07,853: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:30:07.956791364Z [2024-05-25 23:30:07,956: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:30:08.474148047Z [2024-05-25 23:30:08,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18e441cd-9863-4ca1-b753-39336f28142d] received 2024-05-25T23:30:08.494280699Z [2024-05-25 23:30:08,493: INFO/ForkPoolWorker-16] [18e441cd-9863-4ca1-b753-39336f28142d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:30:08.582461215Z [2024-05-25 23:30:08,582: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16353ef1-ce61-4a4c-8592-b7acac1b9995] succeeded in 2.342193823999878s: None 2024-05-25T23:30:08.753332775Z [2024-05-25 23:30:08,748: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:30:09.823699522Z [2024-05-25 23:30:09,823: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:30:09.827052937Z [2024-05-25 23:30:09,826: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:30:09.848597107Z [2024-05-25 23:30:09,848: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:30:09.850068966Z [2024-05-25 23:30:09,849: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:30:09.850087691Z [2024-05-25 23:30:09,849: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:30:09.850237208Z [2024-05-25 23:30:09,850: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:30:09.850315956Z [2024-05-25 23:30:09,850: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:30:09.850749219Z [2024-05-25 23:30:09,850: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:30:09.850774976Z [2024-05-25 23:30:09,850: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:30:09.955459593Z [2024-05-25 23:30:09,955: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:30:10.514993350Z [2024-05-25 23:30:10,514: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[18e441cd-9863-4ca1-b753-39336f28142d] succeeded in 2.037554196000201s: None 2024-05-25T23:31:00.440550015Z [2024-05-25 23:31:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61438258-b9a9-4689-b9c1-c04e4552bf79] received 2024-05-25T23:31:00.443998350Z [2024-05-25 23:31:00,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f12a02b-8352-4fa1-876b-3aee52e6d694] received 2024-05-25T23:31:00.450044616Z [2024-05-25 23:31:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cec2fb26-bcf7-4f03-bf71-b760e7d42b6b] received 2024-05-25T23:31:00.453589113Z [2024-05-25 23:31:00,452: INFO/ForkPoolWorker-15] [61438258-b9a9-4689-b9c1-c04e4552bf79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:31:00.456241621Z [2024-05-25 23:31:00,455: INFO/ForkPoolWorker-16] [2f12a02b-8352-4fa1-876b-3aee52e6d694] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:31:00.460472728Z [2024-05-25 23:31:00,460: INFO/ForkPoolWorker-1] [cec2fb26-bcf7-4f03-bf71-b760e7d42b6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:31:00.811895842Z [2024-05-25 23:31:00,808: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:31:00.850473322Z [2024-05-25 23:31:00,846: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:31:00.907062847Z [2024-05-25 23:31:00,903: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:31:01.068401535Z [2024-05-25 23:31:01,067: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:31:01.072351678Z [2024-05-25 23:31:01,071: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:31:01.090828210Z [2024-05-25 23:31:01,090: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:31:01.092064155Z [2024-05-25 23:31:01,091: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:31:01.092097039Z [2024-05-25 23:31:01,091: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:31:01.092189995Z [2024-05-25 23:31:01,092: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:31:01.092373834Z [2024-05-25 23:31:01,092: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:31:01.180955421Z [2024-05-25 23:31:01,180: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:31:01.794836008Z [2024-05-25 23:31:01,794: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f12a02b-8352-4fa1-876b-3aee52e6d694] succeeded in 1.3487943559998712s: None 2024-05-25T23:31:02.092855255Z [2024-05-25 23:31:02,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:31:02.096183612Z [2024-05-25 23:31:02,095: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:31:02.120851747Z [2024-05-25 23:31:02,120: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:31:02.122296780Z [2024-05-25 23:31:02,122: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:31:02.122581458Z [2024-05-25 23:31:02,122: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:31:02.122752355Z [2024-05-25 23:31:02,122: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:31:02.122869825Z [2024-05-25 23:31:02,122: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:31:02.123161128Z [2024-05-25 23:31:02,123: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:31:02.123714362Z [2024-05-25 23:31:02,123: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:31:02.208776776Z [2024-05-25 23:31:02,208: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:31:02.219180230Z [2024-05-25 23:31:02,218: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:31:02.222980803Z [2024-05-25 23:31:02,222: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:31:02.250152289Z [2024-05-25 23:31:02,249: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:31:02.251465483Z [2024-05-25 23:31:02,251: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:31:02.251634876Z [2024-05-25 23:31:02,251: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:31:02.251879894Z [2024-05-25 23:31:02,251: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:31:02.251976644Z [2024-05-25 23:31:02,251: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:31:02.252249733Z [2024-05-25 23:31:02,252: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:31:02.252370004Z [2024-05-25 23:31:02,252: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:31:02.345156547Z [2024-05-25 23:31:02,344: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:31:05.156294666Z [2024-05-25 23:31:05,155: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cec2fb26-bcf7-4f03-bf71-b760e7d42b6b] succeeded in 4.703173309999784s: None 2024-05-25T23:31:05.157662706Z [2024-05-25 23:31:05,156: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61438258-b9a9-4689-b9c1-c04e4552bf79] succeeded in 4.714193597999838s: None 2024-05-25T23:32:00.340684526Z [2024-05-25 23:32:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e5726ea-6144-43ea-95c7-7e6d602e8aff] received 2024-05-25T23:32:00.342889372Z [2024-05-25 23:32:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7388df55-a535-4e24-a215-eb0da69547bc] received 2024-05-25T23:32:00.344781938Z [2024-05-25 23:32:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8439643a-58be-44d2-97dd-67ccbc163d6f] received 2024-05-25T23:32:00.346345590Z [2024-05-25 23:32:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a786ea06-4ea4-4919-af29-129ce2434ab8] received 2024-05-25T23:32:00.360266846Z [2024-05-25 23:32:00,359: INFO/ForkPoolWorker-1] [8439643a-58be-44d2-97dd-67ccbc163d6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:32:00.361937718Z [2024-05-25 23:32:00,360: INFO/ForkPoolWorker-15] [5e5726ea-6144-43ea-95c7-7e6d602e8aff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:32:00.368018077Z [2024-05-25 23:32:00,367: INFO/ForkPoolWorker-2] [a786ea06-4ea4-4919-af29-129ce2434ab8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:32:00.370251588Z [2024-05-25 23:32:00,369: INFO/ForkPoolWorker-16] [7388df55-a535-4e24-a215-eb0da69547bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:32:00.697370927Z [2024-05-25 23:32:00,679: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:32:00.716236123Z [2024-05-25 23:32:00,711: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:32:00.786255402Z [2024-05-25 23:32:00,782: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:32:00.823407809Z [2024-05-25 23:32:00,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:32:00.898796268Z [2024-05-25 23:32:00,898: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:32:00.903064718Z [2024-05-25 23:32:00,902: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:32:00.939077855Z [2024-05-25 23:32:00,938: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:32:00.941864894Z [2024-05-25 23:32:00,941: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:32:00.942062988Z [2024-05-25 23:32:00,941: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:32:00.942199343Z [2024-05-25 23:32:00,942: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:32:00.942510881Z [2024-05-25 23:32:00,942: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:32:01.098373100Z [2024-05-25 23:32:01,098: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:32:01.149483896Z [2024-05-25 23:32:01,149: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:32:01.863162867Z [2024-05-25 23:32:01,862: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8439643a-58be-44d2-97dd-67ccbc163d6f] succeeded in 1.5130775319998975s: None 2024-05-25T23:32:01.959971766Z [2024-05-25 23:32:01,959: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5e5726ea-6144-43ea-95c7-7e6d602e8aff] succeeded in 1.6155088770001385s: None 2024-05-25T23:32:02.177499295Z [2024-05-25 23:32:02,177: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:32:02.180791199Z [2024-05-25 23:32:02,180: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:32:02.205520889Z [2024-05-25 23:32:02,205: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:32:02.207343508Z [2024-05-25 23:32:02,207: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:32:02.207596512Z [2024-05-25 23:32:02,207: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:32:02.207859543Z [2024-05-25 23:32:02,207: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:32:02.208018979Z [2024-05-25 23:32:02,207: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:32:02.208901028Z [2024-05-25 23:32:02,208: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:32:02.209043979Z [2024-05-25 23:32:02,208: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:32:02.239409390Z [2024-05-25 23:32:02,238: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:32:02.242615243Z [2024-05-25 23:32:02,242: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:32:02.265297735Z [2024-05-25 23:32:02,265: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:32:02.266563837Z [2024-05-25 23:32:02,266: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:32:02.266581465Z [2024-05-25 23:32:02,266: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:32:02.266653738Z [2024-05-25 23:32:02,266: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:32:02.266695476Z [2024-05-25 23:32:02,266: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:32:02.266937277Z [2024-05-25 23:32:02,266: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:32:02.267024879Z [2024-05-25 23:32:02,266: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:32:02.333625818Z [2024-05-25 23:32:02,333: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:32:02.386016315Z [2024-05-25 23:32:02,385: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:32:03.932322114Z [2024-05-25 23:32:03,931: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a786ea06-4ea4-4919-af29-129ce2434ab8] succeeded in 3.5806093779997354s: None 2024-05-25T23:32:04.228053346Z [2024-05-25 23:32:04,227: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7388df55-a535-4e24-a215-eb0da69547bc] succeeded in 3.8794852510000055s: None 2024-05-25T23:33:00.244309326Z [2024-05-25 23:33:00,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cb48c1b-2427-4a47-9863-b4db3135dbcb] received 2024-05-25T23:33:00.254106735Z [2024-05-25 23:33:00,253: INFO/ForkPoolWorker-15] [0cb48c1b-2427-4a47-9863-b4db3135dbcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:33:00.256300346Z [2024-05-25 23:33:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d794eb14-0109-44d1-9d4b-d83544472a0a] received 2024-05-25T23:33:00.265197470Z [2024-05-25 23:33:00,264: INFO/ForkPoolWorker-16] [d794eb14-0109-44d1-9d4b-d83544472a0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:33:00.273674881Z [2024-05-25 23:33:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ab0aa07-f943-45c1-893a-115998af9b63] received 2024-05-25T23:33:00.295477914Z [2024-05-25 23:33:00,295: INFO/ForkPoolWorker-1] [8ab0aa07-f943-45c1-893a-115998af9b63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:33:00.557777823Z [2024-05-25 23:33:00,554: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:33:00.634297131Z [2024-05-25 23:33:00,630: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:33:00.648836227Z [2024-05-25 23:33:00,645: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:33:00.824072277Z [2024-05-25 23:33:00,823: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:33:00.828820447Z [2024-05-25 23:33:00,828: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:33:00.850393936Z [2024-05-25 23:33:00,850: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:33:00.851372647Z [2024-05-25 23:33:00,851: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:33:00.851397357Z [2024-05-25 23:33:00,851: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:33:00.851455150Z [2024-05-25 23:33:00,851: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:33:00.852092113Z [2024-05-25 23:33:00,851: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:33:00.950780788Z [2024-05-25 23:33:00,950: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:33:01.653824665Z [2024-05-25 23:33:01,653: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d794eb14-0109-44d1-9d4b-d83544472a0a] succeeded in 1.3957112729999608s: None 2024-05-25T23:33:01.834925852Z [2024-05-25 23:33:01,834: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:33:01.838674282Z [2024-05-25 23:33:01,838: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:33:01.865111772Z [2024-05-25 23:33:01,864: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:33:01.866607284Z [2024-05-25 23:33:01,866: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:33:01.866758280Z [2024-05-25 23:33:01,866: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:33:01.866998026Z [2024-05-25 23:33:01,866: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:33:01.867091033Z [2024-05-25 23:33:01,866: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:33:01.867385034Z [2024-05-25 23:33:01,867: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:33:01.867459262Z [2024-05-25 23:33:01,867: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:33:01.901313091Z [2024-05-25 23:33:01,900: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:33:01.904408720Z [2024-05-25 23:33:01,903: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:33:01.932241814Z [2024-05-25 23:33:01,931: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:33:01.933956579Z [2024-05-25 23:33:01,933: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:33:01.934098659Z [2024-05-25 23:33:01,933: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:33:01.934311401Z [2024-05-25 23:33:01,934: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:33:01.934437522Z [2024-05-25 23:33:01,934: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:33:01.934766158Z [2024-05-25 23:33:01,934: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:33:01.934977282Z [2024-05-25 23:33:01,934: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:33:01.967742040Z [2024-05-25 23:33:01,967: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:33:02.039017427Z [2024-05-25 23:33:02,038: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:33:03.549530294Z [2024-05-25 23:33:03,548: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0cb48c1b-2427-4a47-9863-b4db3135dbcb] succeeded in 3.303010011999959s: None 2024-05-25T23:33:03.856060216Z [2024-05-25 23:33:03,855: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ab0aa07-f943-45c1-893a-115998af9b63] succeeded in 3.580490112999996s: None 2024-05-25T23:34:01.134868997Z [2024-05-25 23:34:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e70ae476-d043-4a2a-a15a-68f0925d2596] received 2024-05-25T23:34:01.140795169Z [2024-05-25 23:34:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21175c6b-314a-4186-97b0-0080df0f5a07] received 2024-05-25T23:34:01.145598834Z [2024-05-25 23:34:01,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d914674e-e2ba-4a8e-b25e-fed3d7950921] received 2024-05-25T23:34:01.157035169Z [2024-05-25 23:34:01,156: INFO/ForkPoolWorker-16] [21175c6b-314a-4186-97b0-0080df0f5a07] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:34:01.158931934Z [2024-05-25 23:34:01,158: INFO/ForkPoolWorker-1] [d914674e-e2ba-4a8e-b25e-fed3d7950921] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:34:01.159781515Z [2024-05-25 23:34:01,159: INFO/ForkPoolWorker-15] [e70ae476-d043-4a2a-a15a-68f0925d2596] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:34:01.444943655Z [2024-05-25 23:34:01,441: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:34:01.455307636Z [2024-05-25 23:34:01,451: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:34:01.496304679Z [2024-05-25 23:34:01,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[554ee183-2d5a-45f9-a2c9-2ed549590288] received 2024-05-25T23:34:01.509401237Z [2024-05-25 23:34:01,509: INFO/ForkPoolWorker-2] [554ee183-2d5a-45f9-a2c9-2ed549590288] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:34:01.509727844Z [2024-05-25 23:34:01,503: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:34:01.617643535Z [2024-05-25 23:34:01,617: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:34:01.621599313Z [2024-05-25 23:34:01,621: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:34:01.696637428Z [2024-05-25 23:34:01,696: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:34:01.699329964Z [2024-05-25 23:34:01,699: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:34:01.699658612Z [2024-05-25 23:34:01,699: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:34:01.699845504Z [2024-05-25 23:34:01,699: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:34:01.700202396Z [2024-05-25 23:34:01,700: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:34:01.832012090Z [2024-05-25 23:34:01,831: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:34:01.880226229Z [2024-05-25 23:34:01,879: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:34:02.426897957Z [2024-05-25 23:34:02,418: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:34:02.556922556Z [2024-05-25 23:34:02,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e70ae476-d043-4a2a-a15a-68f0925d2596] succeeded in 1.4112410759998966s: None 2024-05-25T23:34:02.780042558Z [2024-05-25 23:34:02,779: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[21175c6b-314a-4186-97b0-0080df0f5a07] succeeded in 1.6361618509999971s: None 2024-05-25T23:34:03.012426537Z [2024-05-25 23:34:03,012: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:34:03.015848449Z [2024-05-25 23:34:03,015: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:34:03.047040586Z [2024-05-25 23:34:03,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:34:03.048724124Z [2024-05-25 23:34:03,048: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:34:03.048861740Z [2024-05-25 23:34:03,048: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:34:03.049052898Z [2024-05-25 23:34:03,048: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:34:03.049123863Z [2024-05-25 23:34:03,049: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:34:03.049408845Z [2024-05-25 23:34:03,049: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:34:03.049537387Z [2024-05-25 23:34:03,049: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:34:03.175256563Z [2024-05-25 23:34:03,170: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:34:04.125616248Z [2024-05-25 23:34:04,125: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:34:04.129654587Z [2024-05-25 23:34:04,129: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:34:04.200053491Z [2024-05-25 23:34:04,199: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:34:04.204996081Z [2024-05-25 23:34:04,204: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:34:04.205133064Z [2024-05-25 23:34:04,204: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:34:04.205339712Z [2024-05-25 23:34:04,205: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:34:04.205581456Z [2024-05-25 23:34:04,205: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:34:04.205958433Z [2024-05-25 23:34:04,205: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:34:04.206397901Z [2024-05-25 23:34:04,206: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:34:04.294449076Z [2024-05-25 23:34:04,294: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:34:05.600680383Z [2024-05-25 23:34:05,600: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d914674e-e2ba-4a8e-b25e-fed3d7950921] succeeded in 4.451082850999683s: None 2024-05-25T23:34:05.891222428Z [2024-05-25 23:34:05,890: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[554ee183-2d5a-45f9-a2c9-2ed549590288] succeeded in 4.3920086820003235s: None 2024-05-25T23:35:00.774215008Z [2024-05-25 23:35:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[583eca5e-d2ac-45c3-995b-dc198391c021] received 2024-05-25T23:35:00.782013852Z [2024-05-25 23:35:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0787f9d8-dcc3-4831-a369-1acf8c2a3d1c] received 2024-05-25T23:35:00.785535701Z [2024-05-25 23:35:00,785: INFO/ForkPoolWorker-15] [583eca5e-d2ac-45c3-995b-dc198391c021] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:35:00.789629720Z [2024-05-25 23:35:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1416f619-df9c-4b0c-8144-9f8816e8c708] received 2024-05-25T23:35:00.792411258Z [2024-05-25 23:35:00,792: INFO/ForkPoolWorker-16] [0787f9d8-dcc3-4831-a369-1acf8c2a3d1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:35:00.794695088Z [2024-05-25 23:35:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdf745cc-c398-454e-b571-0c1b30c48c09] received 2024-05-25T23:35:00.812387349Z [2024-05-25 23:35:00,811: INFO/ForkPoolWorker-1] [1416f619-df9c-4b0c-8144-9f8816e8c708] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:35:00.814006880Z [2024-05-25 23:35:00,813: INFO/ForkPoolWorker-2] [fdf745cc-c398-454e-b571-0c1b30c48c09] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:35:01.130658938Z [2024-05-25 23:35:01,126: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:35:01.189336728Z [2024-05-25 23:35:01,185: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:35:01.192302395Z [2024-05-25 23:35:01,188: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:35:01.242017500Z [2024-05-25 23:35:01,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:35:01.458189651Z [2024-05-25 23:35:01,457: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:35:01.462652808Z [2024-05-25 23:35:01,462: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:35:01.483140196Z [2024-05-25 23:35:01,482: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:35:01.484371432Z [2024-05-25 23:35:01,484: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:35:01.484432857Z [2024-05-25 23:35:01,484: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:35:01.484481060Z [2024-05-25 23:35:01,484: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:35:01.484642597Z [2024-05-25 23:35:01,484: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:35:01.588208499Z [2024-05-25 23:35:01,587: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:35:02.239951334Z [2024-05-25 23:35:02,239: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fdf745cc-c398-454e-b571-0c1b30c48c09] succeeded in 1.4369379820000177s: None 2024-05-25T23:35:02.437265050Z [2024-05-25 23:35:02,436: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:35:02.440897716Z [2024-05-25 23:35:02,440: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:35:02.466177623Z [2024-05-25 23:35:02,465: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:35:02.467901593Z [2024-05-25 23:35:02,467: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:35:02.468061801Z [2024-05-25 23:35:02,467: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:35:02.468271568Z [2024-05-25 23:35:02,468: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:35:02.468410796Z [2024-05-25 23:35:02,468: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:35:02.468758834Z [2024-05-25 23:35:02,468: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:35:02.468916005Z [2024-05-25 23:35:02,468: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:35:02.532710186Z [2024-05-25 23:35:02,532: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:35:02.536052218Z [2024-05-25 23:35:02,535: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:35:02.553593755Z [2024-05-25 23:35:02,553: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:35:02.554635650Z [2024-05-25 23:35:02,554: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:35:02.554739226Z [2024-05-25 23:35:02,554: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:35:02.554899822Z [2024-05-25 23:35:02,554: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:35:02.555006403Z [2024-05-25 23:35:02,554: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:35:02.555359242Z [2024-05-25 23:35:02,555: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:35:02.555464574Z [2024-05-25 23:35:02,555: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:35:02.568113249Z [2024-05-25 23:35:02,567: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:35:02.620262731Z [2024-05-25 23:35:02,619: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:35:02.625642074Z [2024-05-25 23:35:02,625: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:35:02.635192949Z [2024-05-25 23:35:02,634: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:35:02.665180054Z [2024-05-25 23:35:02,664: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:35:02.666342073Z [2024-05-25 23:35:02,666: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:35:02.666455548Z [2024-05-25 23:35:02,666: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:35:02.666649190Z [2024-05-25 23:35:02,666: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:35:02.666769030Z [2024-05-25 23:35:02,666: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:35:02.667107643Z [2024-05-25 23:35:02,666: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:35:02.667213147Z [2024-05-25 23:35:02,667: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:35:02.749357853Z [2024-05-25 23:35:02,749: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:35:03.488523261Z [2024-05-25 23:35:03,488: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[583eca5e-d2ac-45c3-995b-dc198391c021] succeeded in 2.7101891129996147s: None 2024-05-25T23:35:04.220072338Z [2024-05-25 23:35:04,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1416f619-df9c-4b0c-8144-9f8816e8c708] succeeded in 3.4272077360001276s: None 2024-05-25T23:35:04.491594775Z [2024-05-25 23:35:04,486: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0787f9d8-dcc3-4831-a369-1acf8c2a3d1c] succeeded in 3.702876599999854s: None 2024-05-25T23:35:04.516359339Z [2024-05-25 23:35:04,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4eea35b0-020c-4787-960a-7a51206fbfeb] received 2024-05-25T23:35:04.524094475Z [2024-05-25 23:35:04,523: INFO/ForkPoolWorker-15] [4eea35b0-020c-4787-960a-7a51206fbfeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:35:04.851169276Z [2024-05-25 23:35:04,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:35:06.125888248Z [2024-05-25 23:35:06,125: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:35:06.129110484Z [2024-05-25 23:35:06,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:35:06.146037918Z [2024-05-25 23:35:06,145: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:35:06.147198777Z [2024-05-25 23:35:06,146: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:35:06.147336862Z [2024-05-25 23:35:06,147: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:35:06.147577519Z [2024-05-25 23:35:06,147: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:35:06.147702630Z [2024-05-25 23:35:06,147: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:35:06.148053894Z [2024-05-25 23:35:06,147: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:35:06.148160832Z [2024-05-25 23:35:06,148: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:35:06.237186425Z [2024-05-25 23:35:06,236: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:35:06.863054351Z [2024-05-25 23:35:06,862: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4eea35b0-020c-4787-960a-7a51206fbfeb] succeeded in 2.3440258149998954s: None 2024-05-25T23:35:07.105204159Z [2024-05-25 23:35:07,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f377d390-80fc-4ce0-9585-83edf42b2085] received 2024-05-25T23:35:07.121502077Z [2024-05-25 23:35:07,121: INFO/ForkPoolWorker-15] [f377d390-80fc-4ce0-9585-83edf42b2085] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:35:07.498270758Z [2024-05-25 23:35:07,491: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:35:08.830960771Z [2024-05-25 23:35:08,830: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:35:08.834038890Z [2024-05-25 23:35:08,833: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:35:08.858095407Z [2024-05-25 23:35:08,857: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:35:08.861867578Z [2024-05-25 23:35:08,861: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:35:08.861894144Z [2024-05-25 23:35:08,861: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:35:08.862239378Z [2024-05-25 23:35:08,861: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:35:08.862387284Z [2024-05-25 23:35:08,862: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:35:08.862989618Z [2024-05-25 23:35:08,862: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:35:08.863186784Z [2024-05-25 23:35:08,862: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:35:08.959801220Z [2024-05-25 23:35:08,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:35:09.575787804Z [2024-05-25 23:35:09,575: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f377d390-80fc-4ce0-9585-83edf42b2085] succeeded in 2.467291696999837s: None 2024-05-25T23:35:09.732766615Z [2024-05-25 23:35:09,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3239fa92-4220-45c2-b204-5fdfdb6352f0] received 2024-05-25T23:35:09.741453220Z [2024-05-25 23:35:09,741: INFO/ForkPoolWorker-15] [3239fa92-4220-45c2-b204-5fdfdb6352f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:35:10.007875550Z [2024-05-25 23:35:10,004: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:35:11.118507235Z [2024-05-25 23:35:11,118: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:35:11.122440952Z [2024-05-25 23:35:11,122: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:35:11.145841135Z [2024-05-25 23:35:11,145: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:35:11.147479636Z [2024-05-25 23:35:11,147: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:35:11.147668507Z [2024-05-25 23:35:11,147: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:35:11.147922069Z [2024-05-25 23:35:11,147: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:35:11.148047836Z [2024-05-25 23:35:11,147: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:35:11.148378775Z [2024-05-25 23:35:11,148: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:35:11.148503774Z [2024-05-25 23:35:11,148: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:35:11.264652229Z [2024-05-25 23:35:11,264: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:35:11.896686404Z [2024-05-25 23:35:11,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3239fa92-4220-45c2-b204-5fdfdb6352f0] succeeded in 2.159718055999747s: None 2024-05-25T23:36:00.609045556Z [2024-05-25 23:36:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33e45b47-33a7-4495-acd1-08bf9bdf4e02] received 2024-05-25T23:36:00.610944863Z [2024-05-25 23:36:00,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4318962d-211e-437e-998e-67a710ebdcdc] received 2024-05-25T23:36:00.617867718Z [2024-05-25 23:36:00,617: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8106de8f-c8f4-4ffc-b776-ee0814026172] received 2024-05-25T23:36:00.621158573Z [2024-05-25 23:36:00,620: INFO/ForkPoolWorker-16] [4318962d-211e-437e-998e-67a710ebdcdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:36:00.622876478Z [2024-05-25 23:36:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8a87ad4-ceb1-4dfe-9722-f3691bd2400d] received 2024-05-25T23:36:00.623932416Z [2024-05-25 23:36:00,622: INFO/ForkPoolWorker-15] [33e45b47-33a7-4495-acd1-08bf9bdf4e02] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:36:00.630280697Z [2024-05-25 23:36:00,630: INFO/ForkPoolWorker-1] [8106de8f-c8f4-4ffc-b776-ee0814026172] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:36:00.635291008Z [2024-05-25 23:36:00,634: INFO/ForkPoolWorker-2] [a8a87ad4-ceb1-4dfe-9722-f3691bd2400d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:36:00.935245248Z [2024-05-25 23:36:00,931: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:36:00.942589260Z [2024-05-25 23:36:00,938: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:36:00.995934861Z [2024-05-25 23:36:00,991: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:36:01.030771881Z [2024-05-25 23:36:01,027: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:36:01.208181200Z [2024-05-25 23:36:01,207: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:36:01.212604741Z [2024-05-25 23:36:01,212: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:36:01.227102010Z [2024-05-25 23:36:01,226: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:36:01.255954595Z [2024-05-25 23:36:01,255: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:36:01.260552943Z [2024-05-25 23:36:01,260: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:36:01.260746702Z [2024-05-25 23:36:01,260: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:36:01.260899397Z [2024-05-25 23:36:01,260: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:36:01.261178014Z [2024-05-25 23:36:01,261: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:36:01.375079701Z [2024-05-25 23:36:01,374: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:36:01.771702854Z [2024-05-25 23:36:01,771: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33e45b47-33a7-4495-acd1-08bf9bdf4e02] succeeded in 1.1590943320002225s: None 2024-05-25T23:36:01.964840579Z [2024-05-25 23:36:01,964: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a8a87ad4-ceb1-4dfe-9722-f3691bd2400d] succeeded in 1.3390930900000058s: None 2024-05-25T23:36:02.164198054Z [2024-05-25 23:36:02,163: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:36:02.167893304Z [2024-05-25 23:36:02,167: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:36:02.210224552Z [2024-05-25 23:36:02,209: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:36:02.213178678Z [2024-05-25 23:36:02,212: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:36:02.213548685Z [2024-05-25 23:36:02,213: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:36:02.214219731Z [2024-05-25 23:36:02,213: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:36:02.214535056Z [2024-05-25 23:36:02,214: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:36:02.215096903Z [2024-05-25 23:36:02,214: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:36:02.215448868Z [2024-05-25 23:36:02,215: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:36:02.346263018Z [2024-05-25 23:36:02,345: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:36:02.375894164Z [2024-05-25 23:36:02,375: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:36:02.379010963Z [2024-05-25 23:36:02,378: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:36:02.401260911Z [2024-05-25 23:36:02,401: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:36:02.402527939Z [2024-05-25 23:36:02,402: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:36:02.402557529Z [2024-05-25 23:36:02,402: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:36:02.402624223Z [2024-05-25 23:36:02,402: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:36:02.402671807Z [2024-05-25 23:36:02,402: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:36:02.402966133Z [2024-05-25 23:36:02,402: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:36:02.403037759Z [2024-05-25 23:36:02,402: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:36:02.526850732Z [2024-05-25 23:36:02,526: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:36:03.810303812Z [2024-05-25 23:36:03,809: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4318962d-211e-437e-998e-67a710ebdcdc] succeeded in 3.1961495949999517s: None 2024-05-25T23:36:04.588269144Z [2024-05-25 23:36:04,587: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8106de8f-c8f4-4ffc-b776-ee0814026172] succeeded in 3.9687073779996354s: None 2024-05-25T23:37:00.616388433Z [2024-05-25 23:37:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb482857-df49-4be4-b2cb-dac097680418] received 2024-05-25T23:37:00.620002738Z [2024-05-25 23:37:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c77cbb44-90cd-4dba-9ac5-0cb677854625] received 2024-05-25T23:37:00.637014573Z [2024-05-25 23:37:00,636: INFO/ForkPoolWorker-16] [c77cbb44-90cd-4dba-9ac5-0cb677854625] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:37:00.637921528Z [2024-05-25 23:37:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[988ca659-4cec-4ec0-b2db-2b78bf9594c3] received 2024-05-25T23:37:00.638069038Z [2024-05-25 23:37:00,637: INFO/ForkPoolWorker-15] [bb482857-df49-4be4-b2cb-dac097680418] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:37:00.658572913Z [2024-05-25 23:37:00,658: INFO/ForkPoolWorker-1] [988ca659-4cec-4ec0-b2db-2b78bf9594c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:37:00.973570197Z [2024-05-25 23:37:00,968: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:37:00.978138146Z [2024-05-25 23:37:00,973: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:37:01.017121176Z [2024-05-25 23:37:01,006: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:37:01.186641162Z [2024-05-25 23:37:01,186: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:37:01.190769853Z [2024-05-25 23:37:01,190: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:37:01.214739874Z [2024-05-25 23:37:01,214: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:37:01.215850113Z [2024-05-25 23:37:01,215: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:37:01.215926042Z [2024-05-25 23:37:01,215: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:37:01.215974161Z [2024-05-25 23:37:01,215: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:37:01.216161738Z [2024-05-25 23:37:01,216: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:37:01.316516037Z [2024-05-25 23:37:01,316: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:37:01.944341993Z [2024-05-25 23:37:01,943: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[988ca659-4cec-4ec0-b2db-2b78bf9594c3] succeeded in 1.30246930300018s: None 2024-05-25T23:37:02.149106893Z [2024-05-25 23:37:02,148: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:37:02.152479850Z [2024-05-25 23:37:02,152: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:37:02.163009359Z [2024-05-25 23:37:02,162: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:37:02.166592783Z [2024-05-25 23:37:02,166: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:37:02.175134262Z [2024-05-25 23:37:02,174: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:37:02.176615043Z [2024-05-25 23:37:02,176: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:37:02.176766716Z [2024-05-25 23:37:02,176: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:37:02.177045853Z [2024-05-25 23:37:02,176: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:37:02.177178789Z [2024-05-25 23:37:02,177: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:37:02.177595749Z [2024-05-25 23:37:02,177: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:37:02.177729733Z [2024-05-25 23:37:02,177: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:37:02.185080203Z [2024-05-25 23:37:02,184: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:37:02.186650601Z [2024-05-25 23:37:02,186: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:37:02.186746921Z [2024-05-25 23:37:02,186: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:37:02.186970062Z [2024-05-25 23:37:02,186: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:37:02.187083363Z [2024-05-25 23:37:02,186: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:37:02.187383263Z [2024-05-25 23:37:02,187: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:37:02.187895637Z [2024-05-25 23:37:02,187: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:37:02.257969077Z [2024-05-25 23:37:02,257: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:37:02.281127321Z [2024-05-25 23:37:02,280: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:37:03.838460145Z [2024-05-25 23:37:03,837: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c77cbb44-90cd-4dba-9ac5-0cb677854625] succeeded in 3.2121280609999303s: None 2024-05-25T23:37:04.125405537Z [2024-05-25 23:37:04,124: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb482857-df49-4be4-b2cb-dac097680418] succeeded in 3.5032723750000514s: None 2024-05-25T23:38:00.459295925Z [2024-05-25 23:38:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[441e927e-6726-445c-afd3-3d7ab2e88664] received 2024-05-25T23:38:00.462762684Z [2024-05-25 23:38:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0c051d4-6eb8-460a-9443-7ec5bfffc179] received 2024-05-25T23:38:00.482441869Z [2024-05-25 23:38:00,480: INFO/ForkPoolWorker-15] [441e927e-6726-445c-afd3-3d7ab2e88664] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:38:00.483999140Z [2024-05-25 23:38:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51a81449-490c-4373-a6bd-f0df9195b3fa] received 2024-05-25T23:38:00.488896371Z [2024-05-25 23:38:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3cde220-184f-41c9-93d2-59a769350f08] received 2024-05-25T23:38:00.495838464Z [2024-05-25 23:38:00,495: INFO/ForkPoolWorker-16] [f0c051d4-6eb8-460a-9443-7ec5bfffc179] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:38:00.497094197Z [2024-05-25 23:38:00,496: INFO/ForkPoolWorker-1] [51a81449-490c-4373-a6bd-f0df9195b3fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:38:00.524692747Z [2024-05-25 23:38:00,524: INFO/ForkPoolWorker-2] [c3cde220-184f-41c9-93d2-59a769350f08] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:38:00.894989559Z [2024-05-25 23:38:00,890: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:38:00.993013955Z [2024-05-25 23:38:00,982: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:38:01.051448197Z [2024-05-25 23:38:01,045: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:38:01.121964707Z [2024-05-25 23:38:01,115: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:38:01.243421496Z [2024-05-25 23:38:01,242: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:38:01.248416599Z [2024-05-25 23:38:01,247: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:38:01.307892914Z [2024-05-25 23:38:01,307: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:38:01.312481960Z [2024-05-25 23:38:01,312: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:38:01.312675206Z [2024-05-25 23:38:01,312: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:38:01.312810854Z [2024-05-25 23:38:01,312: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:38:01.313100262Z [2024-05-25 23:38:01,312: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:38:01.327887395Z [2024-05-25 23:38:01,319: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:38:01.474781828Z [2024-05-25 23:38:01,474: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:38:02.172156445Z [2024-05-25 23:38:02,171: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[441e927e-6726-445c-afd3-3d7ab2e88664] succeeded in 1.7067287579993717s: None 2024-05-25T23:38:02.356910792Z [2024-05-25 23:38:02,356: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c3cde220-184f-41c9-93d2-59a769350f08] succeeded in 1.8625847769999382s: None 2024-05-25T23:38:02.706024105Z [2024-05-25 23:38:02,705: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:38:02.709745202Z [2024-05-25 23:38:02,709: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:38:02.733390430Z [2024-05-25 23:38:02,733: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:38:02.734975908Z [2024-05-25 23:38:02,734: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:38:02.735159800Z [2024-05-25 23:38:02,734: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:38:02.735419313Z [2024-05-25 23:38:02,735: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:38:02.735664381Z [2024-05-25 23:38:02,735: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:38:02.736055065Z [2024-05-25 23:38:02,735: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:38:02.736318210Z [2024-05-25 23:38:02,735: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:38:02.819020833Z [2024-05-25 23:38:02,818: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:38:02.822728399Z [2024-05-25 23:38:02,822: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:38:02.826848613Z [2024-05-25 23:38:02,826: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:38:02.845557358Z [2024-05-25 23:38:02,845: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:38:02.848655163Z [2024-05-25 23:38:02,848: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:38:02.848707450Z [2024-05-25 23:38:02,848: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:38:02.848933697Z [2024-05-25 23:38:02,848: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:38:02.849028173Z [2024-05-25 23:38:02,848: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:38:02.849317235Z [2024-05-25 23:38:02,849: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:38:02.849478428Z [2024-05-25 23:38:02,849: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:38:02.934058071Z [2024-05-25 23:38:02,933: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:38:04.745297004Z [2024-05-25 23:38:04,744: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0c051d4-6eb8-460a-9443-7ec5bfffc179] succeeded in 4.265180658000645s: None 2024-05-25T23:38:04.861490622Z [2024-05-25 23:38:04,861: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[51a81449-490c-4373-a6bd-f0df9195b3fa] succeeded in 4.373738186000082s: None 2024-05-25T23:39:01.095783302Z [2024-05-25 23:39:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b562854a-5239-4b55-b6a4-e954cab93cad] received 2024-05-25T23:39:01.099125795Z [2024-05-25 23:39:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d1261b0-f6e5-41d0-8b1a-af511faad0a2] received 2024-05-25T23:39:01.113106723Z [2024-05-25 23:39:01,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0461ba9b-a5bf-4646-8c9a-992071dff3d6] received 2024-05-25T23:39:01.114073088Z [2024-05-25 23:39:01,113: INFO/ForkPoolWorker-16] [7d1261b0-f6e5-41d0-8b1a-af511faad0a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:39:01.114540456Z [2024-05-25 23:39:01,113: INFO/ForkPoolWorker-15] [b562854a-5239-4b55-b6a4-e954cab93cad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:39:01.136355451Z [2024-05-25 23:39:01,135: INFO/ForkPoolWorker-1] [0461ba9b-a5bf-4646-8c9a-992071dff3d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:39:01.395138115Z [2024-05-25 23:39:01,390: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:39:01.436080161Z [2024-05-25 23:39:01,432: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:39:01.499431873Z [2024-05-25 23:39:01,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:39:01.587118258Z [2024-05-25 23:39:01,586: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:39:01.591078536Z [2024-05-25 23:39:01,590: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:39:01.613317428Z [2024-05-25 23:39:01,613: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:39:01.614585227Z [2024-05-25 23:39:01,614: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:39:01.614705105Z [2024-05-25 23:39:01,614: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:39:01.614780152Z [2024-05-25 23:39:01,614: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:39:01.615012042Z [2024-05-25 23:39:01,614: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:39:01.703610892Z [2024-05-25 23:39:01,703: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:39:02.375233166Z [2024-05-25 23:39:02,374: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d1261b0-f6e5-41d0-8b1a-af511faad0a2] succeeded in 1.2743587790000674s: None 2024-05-25T23:39:02.631864362Z [2024-05-25 23:39:02,631: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:39:02.634703420Z [2024-05-25 23:39:02,634: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:39:02.660189617Z [2024-05-25 23:39:02,659: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:39:02.661722910Z [2024-05-25 23:39:02,661: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:39:02.661976288Z [2024-05-25 23:39:02,661: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:39:02.662410763Z [2024-05-25 23:39:02,661: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:39:02.663230402Z [2024-05-25 23:39:02,662: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:39:02.663687821Z [2024-05-25 23:39:02,663: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:39:02.663858232Z [2024-05-25 23:39:02,663: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:39:02.699816305Z [2024-05-25 23:39:02,699: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:39:02.703147966Z [2024-05-25 23:39:02,702: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:39:02.728186754Z [2024-05-25 23:39:02,727: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:39:02.729570936Z [2024-05-25 23:39:02,729: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:39:02.729612794Z [2024-05-25 23:39:02,729: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:39:02.729835044Z [2024-05-25 23:39:02,729: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:39:02.729897249Z [2024-05-25 23:39:02,729: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:39:02.730381165Z [2024-05-25 23:39:02,730: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:39:02.730403872Z [2024-05-25 23:39:02,730: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:39:02.749529129Z [2024-05-25 23:39:02,749: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:39:02.832948478Z [2024-05-25 23:39:02,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:39:04.488414198Z [2024-05-25 23:39:04,484: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b562854a-5239-4b55-b6a4-e954cab93cad] succeeded in 3.3838122049992307s: None 2024-05-25T23:39:04.989576665Z [2024-05-25 23:39:04,989: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0461ba9b-a5bf-4646-8c9a-992071dff3d6] succeeded in 3.8673437260003993s: None 2024-05-25T23:40:00.353328625Z [2024-05-25 23:40:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[721371da-b2f2-4f12-bb2a-51e94cf60f64] received 2024-05-25T23:40:00.357351158Z [2024-05-25 23:40:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a300a1b-19e3-454a-85db-ad44336ab52e] received 2024-05-25T23:40:00.358788422Z [2024-05-25 23:40:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24bfe0ea-83d2-4881-95ae-ca0b63b12530] received 2024-05-25T23:40:00.362420614Z [2024-05-25 23:40:00,362: INFO/ForkPoolWorker-15] [721371da-b2f2-4f12-bb2a-51e94cf60f64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:40:00.371764011Z [2024-05-25 23:40:00,371: INFO/ForkPoolWorker-16] [7a300a1b-19e3-454a-85db-ad44336ab52e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:40:00.373469112Z [2024-05-25 23:40:00,373: INFO/ForkPoolWorker-1] [24bfe0ea-83d2-4881-95ae-ca0b63b12530] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:40:00.380421239Z [2024-05-25 23:40:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f984dd7d-d4e1-4b6b-8c23-cec7b8468164] received 2024-05-25T23:40:00.385306113Z [2024-05-25 23:40:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6daef123-9982-4bf4-83ba-64ccbc20f4d9] received 2024-05-25T23:40:00.398762955Z [2024-05-25 23:40:00,398: INFO/ForkPoolWorker-3] [6daef123-9982-4bf4-83ba-64ccbc20f4d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:40:00.406661649Z [2024-05-25 23:40:00,406: INFO/ForkPoolWorker-2] [f984dd7d-d4e1-4b6b-8c23-cec7b8468164] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:40:00.727443042Z [2024-05-25 23:40:00,722: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:40:00.727461781Z [2024-05-25 23:40:00,723: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:40:00.738647686Z [2024-05-25 23:40:00,730: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:40:00.867359619Z [2024-05-25 23:40:00,860: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:40:01.021323386Z [2024-05-25 23:40:00,996: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:40:01.392456935Z [2024-05-25 23:40:01,392: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:40:01.396472099Z [2024-05-25 23:40:01,396: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:40:01.416485646Z [2024-05-25 23:40:01,416: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:40:01.418003151Z [2024-05-25 23:40:01,417: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:40:01.418210210Z [2024-05-25 23:40:01,418: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:40:01.418340103Z [2024-05-25 23:40:01,418: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:40:01.418674868Z [2024-05-25 23:40:01,418: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:40:01.445537108Z [2024-05-25 23:40:01,445: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:40:01.516167700Z [2024-05-25 23:40:01,515: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:40:02.050921436Z [2024-05-25 23:40:02,050: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6daef123-9982-4bf4-83ba-64ccbc20f4d9] succeeded in 1.6620918100006747s: None 2024-05-25T23:40:02.164055151Z [2024-05-25 23:40:02,163: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f984dd7d-d4e1-4b6b-8c23-cec7b8468164] succeeded in 1.7703535489999922s: None 2024-05-25T23:40:02.275015604Z [2024-05-25 23:40:02,274: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:40:02.278271494Z [2024-05-25 23:40:02,277: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:40:02.298247845Z [2024-05-25 23:40:02,297: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:40:02.303256936Z [2024-05-25 23:40:02,302: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:40:02.306589476Z [2024-05-25 23:40:02,306: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:40:02.308022333Z [2024-05-25 23:40:02,307: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:40:02.308195248Z [2024-05-25 23:40:02,307: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:40:02.308393060Z [2024-05-25 23:40:02,308: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:40:02.308502231Z [2024-05-25 23:40:02,308: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:40:02.308804078Z [2024-05-25 23:40:02,308: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:40:02.308916155Z [2024-05-25 23:40:02,308: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:40:02.335721119Z [2024-05-25 23:40:02,335: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:40:02.337258697Z [2024-05-25 23:40:02,337: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:40:02.339644134Z [2024-05-25 23:40:02,337: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:40:02.340167313Z [2024-05-25 23:40:02,339: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:40:02.340389755Z [2024-05-25 23:40:02,340: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:40:02.341164248Z [2024-05-25 23:40:02,340: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:40:02.341407707Z [2024-05-25 23:40:02,341: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:40:02.368746478Z [2024-05-25 23:40:02,367: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:40:02.372091505Z [2024-05-25 23:40:02,371: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:40:02.403812032Z [2024-05-25 23:40:02,403: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:40:02.405206080Z [2024-05-25 23:40:02,404: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:40:02.405217524Z [2024-05-25 23:40:02,405: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:40:02.405485344Z [2024-05-25 23:40:02,405: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:40:02.405548390Z [2024-05-25 23:40:02,405: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:40:02.405821155Z [2024-05-25 23:40:02,405: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:40:02.405905359Z [2024-05-25 23:40:02,405: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:40:02.417110816Z [2024-05-25 23:40:02,416: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:40:02.419676055Z [2024-05-25 23:40:02,419: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:40:02.514137451Z [2024-05-25 23:40:02,513: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:40:03.053440177Z [2024-05-25 23:40:03,052: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7a300a1b-19e3-454a-85db-ad44336ab52e] succeeded in 2.690873389000444s: None 2024-05-25T23:40:03.945700195Z [2024-05-25 23:40:03,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fea20f8-9892-4750-a1b8-765e67392e8c] received 2024-05-25T23:40:03.963033779Z [2024-05-25 23:40:03,962: INFO/ForkPoolWorker-16] [8fea20f8-9892-4750-a1b8-765e67392e8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:40:04.039279687Z [2024-05-25 23:40:04,038: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[24bfe0ea-83d2-4881-95ae-ca0b63b12530] succeeded in 3.6785000620002393s: None 2024-05-25T23:40:04.334447545Z [2024-05-25 23:40:04,334: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[721371da-b2f2-4f12-bb2a-51e94cf60f64] succeeded in 3.9788778659994932s: None 2024-05-25T23:40:04.381176953Z [2024-05-25 23:40:04,377: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:40:05.675592500Z [2024-05-25 23:40:05,673: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:40:05.682859983Z [2024-05-25 23:40:05,681: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:40:05.713731810Z [2024-05-25 23:40:05,713: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:40:05.716219084Z [2024-05-25 23:40:05,715: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:40:05.716418478Z [2024-05-25 23:40:05,716: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:40:05.716632122Z [2024-05-25 23:40:05,716: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:40:05.716748193Z [2024-05-25 23:40:05,716: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:40:05.717114044Z [2024-05-25 23:40:05,716: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:40:05.717839622Z [2024-05-25 23:40:05,717: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:40:05.817983114Z [2024-05-25 23:40:05,817: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:40:06.469575106Z [2024-05-25 23:40:06,469: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8fea20f8-9892-4750-a1b8-765e67392e8c] succeeded in 2.5183246090000466s: None 2024-05-25T23:40:07.213499503Z [2024-05-25 23:40:07,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f832f45-eaa9-4a84-9cd0-9a920ae6d401] received 2024-05-25T23:40:07.220973866Z [2024-05-25 23:40:07,220: INFO/ForkPoolWorker-15] [7f832f45-eaa9-4a84-9cd0-9a920ae6d401] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:40:07.513031072Z [2024-05-25 23:40:07,510: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:40:08.690132029Z [2024-05-25 23:40:08,689: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:40:08.693155109Z [2024-05-25 23:40:08,692: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:40:08.716405205Z [2024-05-25 23:40:08,716: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:40:08.718195883Z [2024-05-25 23:40:08,717: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:40:08.718224172Z [2024-05-25 23:40:08,718: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:40:08.718313989Z [2024-05-25 23:40:08,718: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:40:08.718325890Z [2024-05-25 23:40:08,718: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:40:08.718615789Z [2024-05-25 23:40:08,718: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:40:08.718635016Z [2024-05-25 23:40:08,718: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:40:08.804165648Z [2024-05-25 23:40:08,803: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:40:09.410783826Z [2024-05-25 23:40:09,410: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f832f45-eaa9-4a84-9cd0-9a920ae6d401] succeeded in 2.194258257999536s: None 2024-05-25T23:40:10.302619565Z [2024-05-25 23:40:10,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ac0d56f-0c95-4433-9bf5-ecd2bda4adb5] received 2024-05-25T23:40:10.313223066Z [2024-05-25 23:40:10,312: INFO/ForkPoolWorker-15] [3ac0d56f-0c95-4433-9bf5-ecd2bda4adb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:40:10.603899643Z [2024-05-25 23:40:10,600: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:40:11.665150781Z [2024-05-25 23:40:11,664: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:40:11.668509433Z [2024-05-25 23:40:11,668: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:40:11.693293148Z [2024-05-25 23:40:11,692: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:40:11.694752605Z [2024-05-25 23:40:11,694: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:40:11.694947243Z [2024-05-25 23:40:11,694: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:40:11.695152246Z [2024-05-25 23:40:11,694: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:40:11.695280670Z [2024-05-25 23:40:11,695: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:40:11.695637562Z [2024-05-25 23:40:11,695: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:40:11.695722826Z [2024-05-25 23:40:11,695: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:40:11.797840244Z [2024-05-25 23:40:11,797: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:40:12.429311068Z [2024-05-25 23:40:12,428: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ac0d56f-0c95-4433-9bf5-ecd2bda4adb5] succeeded in 2.1207884019995618s: None 2024-05-25T23:41:00.828685423Z [2024-05-25 23:41:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbbfa8b8-fed7-4c3b-bdcd-ad90014a8c22] received 2024-05-25T23:41:00.836551584Z [2024-05-25 23:41:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f498e3d-3c63-4c94-ad0e-7a3c27f30097] received 2024-05-25T23:41:00.843864559Z [2024-05-25 23:41:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72d37830-812d-4573-8ae6-c5eaf95e32bd] received 2024-05-25T23:41:00.847352508Z [2024-05-25 23:41:00,847: INFO/ForkPoolWorker-16] [8f498e3d-3c63-4c94-ad0e-7a3c27f30097] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:41:00.847769581Z [2024-05-25 23:41:00,847: INFO/ForkPoolWorker-15] [cbbfa8b8-fed7-4c3b-bdcd-ad90014a8c22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:41:00.878652083Z [2024-05-25 23:41:00,878: INFO/ForkPoolWorker-1] [72d37830-812d-4573-8ae6-c5eaf95e32bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:41:01.114046245Z [2024-05-25 23:41:01,110: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:41:01.118255485Z [2024-05-25 23:41:01,114: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:41:01.184110958Z [2024-05-25 23:41:01,180: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:41:01.260784977Z [2024-05-25 23:41:01,260: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:41:01.264794606Z [2024-05-25 23:41:01,264: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:41:01.288983792Z [2024-05-25 23:41:01,288: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:41:01.290032093Z [2024-05-25 23:41:01,289: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:41:01.290102023Z [2024-05-25 23:41:01,289: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:41:01.290143552Z [2024-05-25 23:41:01,290: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:41:01.290322798Z [2024-05-25 23:41:01,290: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:41:01.370809986Z [2024-05-25 23:41:01,370: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:41:01.947684433Z [2024-05-25 23:41:01,947: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8f498e3d-3c63-4c94-ad0e-7a3c27f30097] succeeded in 1.1067464119996657s: None 2024-05-25T23:41:02.249780388Z [2024-05-25 23:41:02,249: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:41:02.253157540Z [2024-05-25 23:41:02,252: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:41:02.276667068Z [2024-05-25 23:41:02,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:41:02.278111909Z [2024-05-25 23:41:02,277: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:41:02.278641913Z [2024-05-25 23:41:02,278: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:41:02.279120357Z [2024-05-25 23:41:02,278: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:41:02.279333979Z [2024-05-25 23:41:02,279: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:41:02.279787391Z [2024-05-25 23:41:02,279: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:41:02.280432695Z [2024-05-25 23:41:02,280: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:41:02.378460746Z [2024-05-25 23:41:02,378: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:41:02.408109617Z [2024-05-25 23:41:02,407: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:41:02.411224107Z [2024-05-25 23:41:02,410: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:41:02.433137202Z [2024-05-25 23:41:02,432: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:41:02.434883935Z [2024-05-25 23:41:02,434: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:41:02.434903831Z [2024-05-25 23:41:02,434: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:41:02.434977847Z [2024-05-25 23:41:02,434: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:41:02.434985043Z [2024-05-25 23:41:02,434: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:41:02.435154656Z [2024-05-25 23:41:02,434: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:41:02.435163758Z [2024-05-25 23:41:02,435: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:41:02.542170682Z [2024-05-25 23:41:02,541: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:41:04.109003723Z [2024-05-25 23:41:04,108: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[72d37830-812d-4573-8ae6-c5eaf95e32bd] succeeded in 3.258965062000243s: None 2024-05-25T23:41:04.586064321Z [2024-05-25 23:41:04,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbbfa8b8-fed7-4c3b-bdcd-ad90014a8c22] succeeded in 3.7462662929992803s: None 2024-05-25T23:42:01.324300407Z [2024-05-25 23:42:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[707d0f2f-6a12-4808-b598-3d7c3ab9c1dd] received 2024-05-25T23:42:01.331258055Z [2024-05-25 23:42:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbbb722c-5411-413a-af9f-c53bca390405] received 2024-05-25T23:42:01.333219421Z [2024-05-25 23:42:01,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c75f9462-c997-4091-970f-fe88f378fbed] received 2024-05-25T23:42:01.334846672Z [2024-05-25 23:42:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8e62370-aae4-4e77-bdc3-73d584e8af83] received 2024-05-25T23:42:01.347368643Z [2024-05-25 23:42:01,347: INFO/ForkPoolWorker-15] [707d0f2f-6a12-4808-b598-3d7c3ab9c1dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:42:01.348551059Z [2024-05-25 23:42:01,348: INFO/ForkPoolWorker-16] [bbbb722c-5411-413a-af9f-c53bca390405] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:42:01.352471628Z [2024-05-25 23:42:01,352: INFO/ForkPoolWorker-2] [f8e62370-aae4-4e77-bdc3-73d584e8af83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:42:01.355878166Z [2024-05-25 23:42:01,355: INFO/ForkPoolWorker-1] [c75f9462-c997-4091-970f-fe88f378fbed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:42:01.702597170Z [2024-05-25 23:42:01,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:42:01.734172470Z [2024-05-25 23:42:01,730: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:42:01.782925713Z [2024-05-25 23:42:01,776: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:42:01.790192260Z [2024-05-25 23:42:01,786: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:42:01.898548130Z [2024-05-25 23:42:01,898: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T23:42:01.902554609Z [2024-05-25 23:42:01,902: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:42:01.925710227Z [2024-05-25 23:42:01,925: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:42:01.926716364Z [2024-05-25 23:42:01,926: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:42:01.926834133Z [2024-05-25 23:42:01,926: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:42:01.926901592Z [2024-05-25 23:42:01,926: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T23:42:01.927187550Z [2024-05-25 23:42:01,927: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:42:02.045722317Z [2024-05-25 23:42:02,045: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:42:02.104698504Z [2024-05-25 23:42:02,104: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:42:02.645531528Z [2024-05-25 23:42:02,645: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bbbb722c-5411-413a-af9f-c53bca390405] succeeded in 1.3106600629998866s: None 2024-05-25T23:42:02.686864396Z [2024-05-25 23:42:02,686: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c75f9462-c997-4091-970f-fe88f378fbed] succeeded in 1.35143968400007s: None 2024-05-25T23:42:03.041302525Z [2024-05-25 23:42:03,040: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:42:03.044677355Z [2024-05-25 23:42:03,044: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:42:03.063645111Z [2024-05-25 23:42:03,063: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:42:03.064482138Z [2024-05-25 23:42:03,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:42:03.065821643Z [2024-05-25 23:42:03,065: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:42:03.065836398Z [2024-05-25 23:42:03,065: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:42:03.066095522Z [2024-05-25 23:42:03,065: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:42:03.066167437Z [2024-05-25 23:42:03,066: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:42:03.066494848Z [2024-05-25 23:42:03,066: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:42:03.066947890Z [2024-05-25 23:42:03,066: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:42:03.067013576Z [2024-05-25 23:42:03,066: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:42:03.091152300Z [2024-05-25 23:42:03,090: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:42:03.093125663Z [2024-05-25 23:42:03,092: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:42:03.093465629Z [2024-05-25 23:42:03,093: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:42:03.093990089Z [2024-05-25 23:42:03,093: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:42:03.094287644Z [2024-05-25 23:42:03,094: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:42:03.095334912Z [2024-05-25 23:42:03,095: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:42:03.095729832Z [2024-05-25 23:42:03,095: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:42:03.178138000Z [2024-05-25 23:42:03,177: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:42:03.226143452Z [2024-05-25 23:42:03,225: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:42:04.955255054Z [2024-05-25 23:42:04,954: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f8e62370-aae4-4e77-bdc3-73d584e8af83] succeeded in 3.617449487000158s: None 2024-05-25T23:42:05.504573844Z [2024-05-25 23:42:05,504: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[707d0f2f-6a12-4808-b598-3d7c3ab9c1dd] succeeded in 4.178345676999925s: None 2024-05-25T23:43:00.603458697Z [2024-05-25 23:43:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef8f613a-c3a8-4559-ad62-8bbc7e429abf] received 2024-05-25T23:43:00.609450475Z [2024-05-25 23:43:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d09088e4-9545-4fff-8640-bd98f6512ad8] received 2024-05-25T23:43:00.614818579Z [2024-05-25 23:43:00,614: INFO/ForkPoolWorker-15] [ef8f613a-c3a8-4559-ad62-8bbc7e429abf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:43:00.621688097Z [2024-05-25 23:43:00,621: INFO/ForkPoolWorker-16] [d09088e4-9545-4fff-8640-bd98f6512ad8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:43:00.628255822Z [2024-05-25 23:43:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b1dad64-c960-47ec-9a9f-d23e9c155e89] received 2024-05-25T23:43:00.642637637Z [2024-05-25 23:43:00,641: INFO/ForkPoolWorker-1] [3b1dad64-c960-47ec-9a9f-d23e9c155e89] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:43:00.965834648Z [2024-05-25 23:43:00,962: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:43:00.977906144Z [2024-05-25 23:43:00,974: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:43:01.035251889Z [2024-05-25 23:43:01,031: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:43:01.232319561Z [2024-05-25 23:43:01,231: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:43:01.237536830Z [2024-05-25 23:43:01,236: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:43:01.302736065Z [2024-05-25 23:43:01,302: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:43:01.305789518Z [2024-05-25 23:43:01,305: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:43:01.308801576Z [2024-05-25 23:43:01,307: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:43:01.308863331Z [2024-05-25 23:43:01,308: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:43:01.309130064Z [2024-05-25 23:43:01,309: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:43:01.511966672Z [2024-05-25 23:43:01,507: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:43:02.303869666Z [2024-05-25 23:43:02,303: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3b1dad64-c960-47ec-9a9f-d23e9c155e89] succeeded in 1.6716669010002079s: None 2024-05-25T23:43:02.440705878Z [2024-05-25 23:43:02,440: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:43:02.445361290Z [2024-05-25 23:43:02,444: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:43:02.468029812Z [2024-05-25 23:43:02,467: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:43:02.469323656Z [2024-05-25 23:43:02,469: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:43:02.469411337Z [2024-05-25 23:43:02,469: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:43:02.469627363Z [2024-05-25 23:43:02,469: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:43:02.469765160Z [2024-05-25 23:43:02,469: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:43:02.470116009Z [2024-05-25 23:43:02,469: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:43:02.470220675Z [2024-05-25 23:43:02,470: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:43:02.569212288Z [2024-05-25 23:43:02,568: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:43:02.837851375Z [2024-05-25 23:43:02,837: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:43:02.841052318Z [2024-05-25 23:43:02,840: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:43:02.866352039Z [2024-05-25 23:43:02,866: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:43:02.867597800Z [2024-05-25 23:43:02,867: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:43:02.867665905Z [2024-05-25 23:43:02,867: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:43:02.867810686Z [2024-05-25 23:43:02,867: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:43:02.867857783Z [2024-05-25 23:43:02,867: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:43:02.868140552Z [2024-05-25 23:43:02,868: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:43:02.868197446Z [2024-05-25 23:43:02,868: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:43:02.945107445Z [2024-05-25 23:43:02,944: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:43:04.121292641Z [2024-05-25 23:43:04,120: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d09088e4-9545-4fff-8640-bd98f6512ad8] succeeded in 3.5088193459996546s: None 2024-05-25T23:43:04.961791422Z [2024-05-25 23:43:04,961: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef8f613a-c3a8-4559-ad62-8bbc7e429abf] succeeded in 4.354373623000356s: None 2024-05-25T23:44:00.435908131Z [2024-05-25 23:44:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57365688-1b3b-4ce7-9957-a354f8458fb1] received 2024-05-25T23:44:00.439868384Z [2024-05-25 23:44:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9386782e-11e7-43d4-aacb-a5f0d6952ef6] received 2024-05-25T23:44:00.443226218Z [2024-05-25 23:44:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de47c035-1129-4e78-b460-ba714c1651f8] received 2024-05-25T23:44:00.446637693Z [2024-05-25 23:44:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6ec9bb3-9329-49d2-b5ea-8c3bcd032e67] received 2024-05-25T23:44:00.448179548Z [2024-05-25 23:44:00,447: INFO/ForkPoolWorker-15] [57365688-1b3b-4ce7-9957-a354f8458fb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:44:00.456794654Z [2024-05-25 23:44:00,456: INFO/ForkPoolWorker-1] [de47c035-1129-4e78-b460-ba714c1651f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:44:00.458783360Z [2024-05-25 23:44:00,458: INFO/ForkPoolWorker-16] [9386782e-11e7-43d4-aacb-a5f0d6952ef6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:44:00.462763988Z [2024-05-25 23:44:00,462: INFO/ForkPoolWorker-2] [c6ec9bb3-9329-49d2-b5ea-8c3bcd032e67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:44:00.767668882Z [2024-05-25 23:44:00,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:44:00.819650529Z [2024-05-25 23:44:00,815: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:44:00.863862961Z [2024-05-25 23:44:00,853: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:44:00.918681540Z [2024-05-25 23:44:00,914: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:44:01.041124371Z [2024-05-25 23:44:01,040: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:44:01.046007297Z [2024-05-25 23:44:01,045: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:44:01.082258185Z [2024-05-25 23:44:01,082: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:44:01.083978760Z [2024-05-25 23:44:01,083: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:44:01.084225812Z [2024-05-25 23:44:01,084: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:44:01.084360940Z [2024-05-25 23:44:01,084: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:44:01.084665348Z [2024-05-25 23:44:01,084: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:44:01.159597034Z [2024-05-25 23:44:01,159: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:44:01.193520221Z [2024-05-25 23:44:01,193: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:44:01.933487771Z [2024-05-25 23:44:01,933: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9386782e-11e7-43d4-aacb-a5f0d6952ef6] succeeded in 1.4892020859997501s: None 2024-05-25T23:44:01.961089307Z [2024-05-25 23:44:01,960: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de47c035-1129-4e78-b460-ba714c1651f8] succeeded in 1.515628117000233s: None 2024-05-25T23:44:02.136863568Z [2024-05-25 23:44:02,136: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:44:02.140490882Z [2024-05-25 23:44:02,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:44:02.176538785Z [2024-05-25 23:44:02,176: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:44:02.178239732Z [2024-05-25 23:44:02,177: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:44:02.178262804Z [2024-05-25 23:44:02,178: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:44:02.178386976Z [2024-05-25 23:44:02,178: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:44:02.178421558Z [2024-05-25 23:44:02,178: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:44:02.178680692Z [2024-05-25 23:44:02,178: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:44:02.178729382Z [2024-05-25 23:44:02,178: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:44:02.223244328Z [2024-05-25 23:44:02,222: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:44:02.227554932Z [2024-05-25 23:44:02,227: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:44:02.251120131Z [2024-05-25 23:44:02,250: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:44:02.252606636Z [2024-05-25 23:44:02,252: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:44:02.252682888Z [2024-05-25 23:44:02,252: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:44:02.252896432Z [2024-05-25 23:44:02,252: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:44:02.252957875Z [2024-05-25 23:44:02,252: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:44:02.253471613Z [2024-05-25 23:44:02,253: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:44:02.253747045Z [2024-05-25 23:44:02,253: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:44:02.264086042Z [2024-05-25 23:44:02,263: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:44:02.333710915Z [2024-05-25 23:44:02,333: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:44:04.023925420Z [2024-05-25 23:44:04,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57365688-1b3b-4ce7-9957-a354f8458fb1] succeeded in 3.5860473229995478s: None 2024-05-25T23:44:04.439646088Z [2024-05-25 23:44:04,433: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c6ec9bb3-9329-49d2-b5ea-8c3bcd032e67] succeeded in 3.9844547980001153s: None 2024-05-25T23:45:00.396790077Z [2024-05-25 23:45:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f972a58-011f-44f0-aa0c-766df7d92e21] received 2024-05-25T23:45:00.399307411Z [2024-05-25 23:45:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edb9c72a-e8f2-430d-b96e-4f86e70b2a31] received 2024-05-25T23:45:00.404562482Z [2024-05-25 23:45:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44a16a34-6e6b-4caa-99d7-1d29566e022c] received 2024-05-25T23:45:00.411559135Z [2024-05-25 23:45:00,411: INFO/ForkPoolWorker-16] [edb9c72a-e8f2-430d-b96e-4f86e70b2a31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:45:00.417436892Z [2024-05-25 23:45:00,416: INFO/ForkPoolWorker-15] [7f972a58-011f-44f0-aa0c-766df7d92e21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:45:00.418724702Z [2024-05-25 23:45:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7788b2a-5625-4f87-a6b5-f2105be02096] received 2024-05-25T23:45:00.419839009Z [2024-05-25 23:45:00,419: INFO/ForkPoolWorker-1] [44a16a34-6e6b-4caa-99d7-1d29566e022c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:45:00.436050594Z [2024-05-25 23:45:00,435: INFO/ForkPoolWorker-2] [a7788b2a-5625-4f87-a6b5-f2105be02096] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:45:00.745620636Z [2024-05-25 23:45:00,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:45:00.755688164Z [2024-05-25 23:45:00,745: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:45:00.816971327Z [2024-05-25 23:45:00,812: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:45:00.835913272Z [2024-05-25 23:45:00,831: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:45:01.012762735Z [2024-05-25 23:45:01,012: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:45:01.016892018Z [2024-05-25 23:45:01,016: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:45:01.041498725Z [2024-05-25 23:45:01,041: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:45:01.042396410Z [2024-05-25 23:45:01,042: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:45:01.042541357Z [2024-05-25 23:45:01,042: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:45:01.042611237Z [2024-05-25 23:45:01,042: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:45:01.042922419Z [2024-05-25 23:45:01,042: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:45:01.148152354Z [2024-05-25 23:45:01,147: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:45:01.653872062Z [2024-05-25 23:45:01,653: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a7788b2a-5625-4f87-a6b5-f2105be02096] succeeded in 1.2282775610001408s: None 2024-05-25T23:45:02.076386176Z [2024-05-25 23:45:02,076: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:45:02.080328854Z [2024-05-25 23:45:02,079: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:45:02.115457214Z [2024-05-25 23:45:02,115: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:45:02.118150453Z [2024-05-25 23:45:02,117: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:45:02.118275934Z [2024-05-25 23:45:02,118: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:45:02.118499196Z [2024-05-25 23:45:02,118: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:45:02.118618551Z [2024-05-25 23:45:02,118: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:45:02.119087443Z [2024-05-25 23:45:02,118: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:45:02.119237643Z [2024-05-25 23:45:02,119: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:45:02.220310170Z [2024-05-25 23:45:02,220: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:45:02.279419611Z [2024-05-25 23:45:02,279: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:45:02.282927730Z [2024-05-25 23:45:02,282: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:45:02.320424368Z [2024-05-25 23:45:02,320: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:45:02.322990839Z [2024-05-25 23:45:02,322: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:45:02.323250831Z [2024-05-25 23:45:02,322: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:45:02.323615684Z [2024-05-25 23:45:02,323: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:45:02.323843593Z [2024-05-25 23:45:02,323: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:45:02.324328222Z [2024-05-25 23:45:02,324: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:45:02.324582922Z [2024-05-25 23:45:02,324: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:45:02.397864219Z [2024-05-25 23:45:02,397: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:45:02.406179221Z [2024-05-25 23:45:02,405: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:45:02.411576234Z [2024-05-25 23:45:02,411: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:45:02.447378133Z [2024-05-25 23:45:02,447: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:45:02.449864174Z [2024-05-25 23:45:02,449: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:45:02.449879319Z [2024-05-25 23:45:02,449: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:45:02.450028242Z [2024-05-25 23:45:02,449: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:45:02.450109516Z [2024-05-25 23:45:02,450: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:45:02.450356556Z [2024-05-25 23:45:02,450: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:45:02.450537130Z [2024-05-25 23:45:02,450: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:45:02.524969437Z [2024-05-25 23:45:02,524: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:45:03.100049209Z [2024-05-25 23:45:03,099: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f972a58-011f-44f0-aa0c-766df7d92e21] succeeded in 2.6962760879996495s: None 2024-05-25T23:45:03.234433345Z [2024-05-25 23:45:03,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06319338-68b2-4ca4-996f-25fe522f419e] received 2024-05-25T23:45:03.247015029Z [2024-05-25 23:45:03,246: INFO/ForkPoolWorker-15] [06319338-68b2-4ca4-996f-25fe522f419e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:45:03.550478153Z [2024-05-25 23:45:03,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:45:03.915259393Z [2024-05-25 23:45:03,914: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[edb9c72a-e8f2-430d-b96e-4f86e70b2a31] succeeded in 3.5134410199998456s: None 2024-05-25T23:45:04.219874258Z [2024-05-25 23:45:04,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[44a16a34-6e6b-4caa-99d7-1d29566e022c] succeeded in 3.8114520130002347s: None 2024-05-25T23:45:04.738577768Z [2024-05-25 23:45:04,738: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:45:04.741889247Z [2024-05-25 23:45:04,741: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:45:04.757686076Z [2024-05-25 23:45:04,757: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:45:04.758940337Z [2024-05-25 23:45:04,758: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:45:04.758979393Z [2024-05-25 23:45:04,758: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:45:04.759167174Z [2024-05-25 23:45:04,758: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:45:04.759229997Z [2024-05-25 23:45:04,759: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:45:04.759507588Z [2024-05-25 23:45:04,759: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:45:04.759619957Z [2024-05-25 23:45:04,759: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:45:04.833582689Z [2024-05-25 23:45:04,833: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:45:05.470100327Z [2024-05-25 23:45:05,469: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06319338-68b2-4ca4-996f-25fe522f419e] succeeded in 2.234245390999604s: None 2024-05-25T23:45:05.778042049Z [2024-05-25 23:45:05,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74aae252-fbea-4f0c-b05a-28aa293b15e8] received 2024-05-25T23:45:05.786033192Z [2024-05-25 23:45:05,785: INFO/ForkPoolWorker-15] [74aae252-fbea-4f0c-b05a-28aa293b15e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:45:06.129860987Z [2024-05-25 23:45:06,126: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:45:07.411350161Z [2024-05-25 23:45:07,410: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:45:07.415186673Z [2024-05-25 23:45:07,414: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:45:07.438484676Z [2024-05-25 23:45:07,438: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:45:07.440170593Z [2024-05-25 23:45:07,439: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:45:07.440284369Z [2024-05-25 23:45:07,440: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:45:07.440473187Z [2024-05-25 23:45:07,440: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:45:07.440561890Z [2024-05-25 23:45:07,440: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:45:07.440902077Z [2024-05-25 23:45:07,440: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:45:07.440946204Z [2024-05-25 23:45:07,440: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:45:07.551503189Z [2024-05-25 23:45:07,551: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:45:08.164598027Z [2024-05-25 23:45:08,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74aae252-fbea-4f0c-b05a-28aa293b15e8] succeeded in 2.3838194039999507s: None 2024-05-25T23:45:08.444195534Z [2024-05-25 23:45:08,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e137e712-c9d9-456d-8ba2-06df3ac10eae] received 2024-05-25T23:45:08.453683121Z [2024-05-25 23:45:08,453: INFO/ForkPoolWorker-15] [e137e712-c9d9-456d-8ba2-06df3ac10eae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:45:08.750913266Z [2024-05-25 23:45:08,747: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:45:09.937147802Z [2024-05-25 23:45:09,936: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:45:09.940817788Z [2024-05-25 23:45:09,940: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:45:09.960100980Z [2024-05-25 23:45:09,959: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:45:09.961933490Z [2024-05-25 23:45:09,961: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:45:09.962323546Z [2024-05-25 23:45:09,962: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:45:09.962598696Z [2024-05-25 23:45:09,962: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:45:09.962776957Z [2024-05-25 23:45:09,962: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:45:09.963092934Z [2024-05-25 23:45:09,962: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:45:09.963628341Z [2024-05-25 23:45:09,963: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:45:10.062996690Z [2024-05-25 23:45:10,062: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:45:10.633447755Z [2024-05-25 23:45:10,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e137e712-c9d9-456d-8ba2-06df3ac10eae] succeeded in 2.1872264789999463s: None 2024-05-25T23:46:00.502634436Z [2024-05-25 23:46:00,502: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[888fb615-f635-41ff-aaa2-d7cd4cd2a960] received 2024-05-25T23:46:00.504555443Z [2024-05-25 23:46:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c8b80a0-2195-4ebf-bfcc-eb43440c8b13] received 2024-05-25T23:46:00.521626490Z [2024-05-25 23:46:00,519: INFO/ForkPoolWorker-15] [888fb615-f635-41ff-aaa2-d7cd4cd2a960] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:46:00.528223594Z [2024-05-25 23:46:00,527: INFO/ForkPoolWorker-16] [8c8b80a0-2195-4ebf-bfcc-eb43440c8b13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:46:00.534095481Z [2024-05-25 23:46:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6608570d-fec8-4803-b882-20cb426a6c4b] received 2024-05-25T23:46:00.539473839Z [2024-05-25 23:46:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1383a821-a459-493c-8433-89b75d73b947] received 2024-05-25T23:46:00.550043468Z [2024-05-25 23:46:00,549: INFO/ForkPoolWorker-1] [6608570d-fec8-4803-b882-20cb426a6c4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:46:00.553670353Z [2024-05-25 23:46:00,553: INFO/ForkPoolWorker-2] [1383a821-a459-493c-8433-89b75d73b947] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:46:00.826472465Z [2024-05-25 23:46:00,823: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:46:00.915288580Z [2024-05-25 23:46:00,911: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:46:00.923479760Z [2024-05-25 23:46:00,920: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:46:00.944420259Z [2024-05-25 23:46:00,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:46:01.097540735Z [2024-05-25 23:46:01,097: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:46:01.101456157Z [2024-05-25 23:46:01,101: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:46:01.130035636Z [2024-05-25 23:46:01,129: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:46:01.132235903Z [2024-05-25 23:46:01,132: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:46:01.132352650Z [2024-05-25 23:46:01,132: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:46:01.132425560Z [2024-05-25 23:46:01,132: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:46:01.132629277Z [2024-05-25 23:46:01,132: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:46:01.216700894Z [2024-05-25 23:46:01,216: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:46:01.249966006Z [2024-05-25 23:46:01,249: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:46:01.871888260Z [2024-05-25 23:46:01,871: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[888fb615-f635-41ff-aaa2-d7cd4cd2a960] succeeded in 1.364888914000403s: None 2024-05-25T23:46:01.881388620Z [2024-05-25 23:46:01,880: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1383a821-a459-493c-8433-89b75d73b947] succeeded in 1.3355719729997872s: None 2024-05-25T23:46:02.231136069Z [2024-05-25 23:46:02,230: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:46:02.234281697Z [2024-05-25 23:46:02,233: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:46:02.245540263Z [2024-05-25 23:46:02,245: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:46:02.249108666Z [2024-05-25 23:46:02,248: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:46:02.260335995Z [2024-05-25 23:46:02,260: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:46:02.262276638Z [2024-05-25 23:46:02,261: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:46:02.262290406Z [2024-05-25 23:46:02,262: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:46:02.262637566Z [2024-05-25 23:46:02,262: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:46:02.262649290Z [2024-05-25 23:46:02,262: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:46:02.263014352Z [2024-05-25 23:46:02,262: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:46:02.263271815Z [2024-05-25 23:46:02,262: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:46:02.282650676Z [2024-05-25 23:46:02,282: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:46:02.284125469Z [2024-05-25 23:46:02,283: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:46:02.284137773Z [2024-05-25 23:46:02,284: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:46:02.284350064Z [2024-05-25 23:46:02,284: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:46:02.284464362Z [2024-05-25 23:46:02,284: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:46:02.284766673Z [2024-05-25 23:46:02,284: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:46:02.284875187Z [2024-05-25 23:46:02,284: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:46:02.377759790Z [2024-05-25 23:46:02,377: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:46:02.398399745Z [2024-05-25 23:46:02,398: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:46:04.018507375Z [2024-05-25 23:46:04,018: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c8b80a0-2195-4ebf-bfcc-eb43440c8b13] succeeded in 3.501651176999985s: None 2024-05-25T23:46:04.452234616Z [2024-05-25 23:46:04,451: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6608570d-fec8-4803-b882-20cb426a6c4b] succeeded in 3.9139469600004304s: None 2024-05-25T23:47:00.389471738Z [2024-05-25 23:47:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8dc4f665-cd2b-47d1-97ba-ad663e852d6b] received 2024-05-25T23:47:00.405636717Z [2024-05-25 23:47:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[421653fe-8ec7-428e-bb60-699f9547de54] received 2024-05-25T23:47:00.406682418Z [2024-05-25 23:47:00,406: INFO/ForkPoolWorker-15] [8dc4f665-cd2b-47d1-97ba-ad663e852d6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:47:00.420454010Z [2024-05-25 23:47:00,420: INFO/ForkPoolWorker-16] [421653fe-8ec7-428e-bb60-699f9547de54] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:47:00.425588154Z [2024-05-25 23:47:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a134e27f-d915-4a99-bd81-044edc023c19] received 2024-05-25T23:47:00.438980490Z [2024-05-25 23:47:00,438: INFO/ForkPoolWorker-1] [a134e27f-d915-4a99-bd81-044edc023c19] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:47:00.911176545Z [2024-05-25 23:47:00,903: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:47:00.934887863Z [2024-05-25 23:47:00,931: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:47:01.152506293Z [2024-05-25 23:47:01,148: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:47:01.393510888Z [2024-05-25 23:47:01,393: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:47:01.397666017Z [2024-05-25 23:47:01,397: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:47:01.470468365Z [2024-05-25 23:47:01,470: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:47:01.471335218Z [2024-05-25 23:47:01,471: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:47:01.471397189Z [2024-05-25 23:47:01,471: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:47:01.471445293Z [2024-05-25 23:47:01,471: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:47:01.471980843Z [2024-05-25 23:47:01,471: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:47:01.603609325Z [2024-05-25 23:47:01,598: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:47:02.608840597Z [2024-05-25 23:47:02,608: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a134e27f-d915-4a99-bd81-044edc023c19] succeeded in 2.1801024189999225s: None 2024-05-25T23:47:03.926207228Z [2024-05-25 23:47:03,925: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:47:03.930117208Z [2024-05-25 23:47:03,929: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:47:03.974218778Z [2024-05-25 23:47:03,974: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:47:03.977736075Z [2024-05-25 23:47:03,977: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:47:03.979853770Z [2024-05-25 23:47:03,977: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:47:03.980150610Z [2024-05-25 23:47:03,979: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:47:03.980329952Z [2024-05-25 23:47:03,980: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:47:03.980685617Z [2024-05-25 23:47:03,980: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:47:03.981242400Z [2024-05-25 23:47:03,980: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:47:04.174651912Z [2024-05-25 23:47:04,174: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:47:04.178415553Z [2024-05-25 23:47:04,178: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:47:04.253748712Z [2024-05-25 23:47:04,251: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:47:04.264106949Z [2024-05-25 23:47:04,263: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:47:04.267756952Z [2024-05-25 23:47:04,267: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:47:04.269241119Z [2024-05-25 23:47:04,268: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:47:04.277815532Z [2024-05-25 23:47:04,277: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:47:04.280310165Z [2024-05-25 23:47:04,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:47:04.282482301Z [2024-05-25 23:47:04,281: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:47:04.301904910Z [2024-05-25 23:47:04,301: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:47:04.474648867Z [2024-05-25 23:47:04,474: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:47:06.446702377Z [2024-05-25 23:47:06,446: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[421653fe-8ec7-428e-bb60-699f9547de54] succeeded in 6.038701085999492s: None 2024-05-25T23:47:08.551229471Z [2024-05-25 23:47:08,550: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8dc4f665-cd2b-47d1-97ba-ad663e852d6b] succeeded in 8.159286762999727s: None 2024-05-25T23:48:00.504340197Z [2024-05-25 23:48:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[572d56fb-89f6-4acc-a943-f5a5867c99a1] received 2024-05-25T23:48:00.512177605Z [2024-05-25 23:48:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9cbeee9-0048-4cb6-9d2d-551276f535bd] received 2024-05-25T23:48:00.516095555Z [2024-05-25 23:48:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b537be9-6064-4f22-bb31-75e2807b7d1c] received 2024-05-25T23:48:00.518361923Z [2024-05-25 23:48:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccb440fb-8f34-4990-9d31-e371c00368d9] received 2024-05-25T23:48:00.544165609Z [2024-05-25 23:48:00,543: INFO/ForkPoolWorker-1] [4b537be9-6064-4f22-bb31-75e2807b7d1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:48:00.547076702Z [2024-05-25 23:48:00,544: INFO/ForkPoolWorker-15] [572d56fb-89f6-4acc-a943-f5a5867c99a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:48:00.549660625Z [2024-05-25 23:48:00,549: INFO/ForkPoolWorker-2] [ccb440fb-8f34-4990-9d31-e371c00368d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:48:00.555772657Z [2024-05-25 23:48:00,555: INFO/ForkPoolWorker-16] [d9cbeee9-0048-4cb6-9d2d-551276f535bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:48:00.910922845Z [2024-05-25 23:48:00,907: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:48:00.916387929Z [2024-05-25 23:48:00,912: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:48:00.953978523Z [2024-05-25 23:48:00,950: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:48:01.019587999Z [2024-05-25 23:48:01,016: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:48:01.085866554Z [2024-05-25 23:48:01,085: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:48:01.090187894Z [2024-05-25 23:48:01,089: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:48:01.121592814Z [2024-05-25 23:48:01,121: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:48:01.122935740Z [2024-05-25 23:48:01,122: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:48:01.123045089Z [2024-05-25 23:48:01,122: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:48:01.123081080Z [2024-05-25 23:48:01,123: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:48:01.123274928Z [2024-05-25 23:48:01,123: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:48:01.163905587Z [2024-05-25 23:48:01,163: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:48:01.252918465Z [2024-05-25 23:48:01,252: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:48:01.834233617Z [2024-05-25 23:48:01,833: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[572d56fb-89f6-4acc-a943-f5a5867c99a1] succeeded in 1.3173871910003072s: None 2024-05-25T23:48:02.003857132Z [2024-05-25 23:48:02,003: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ccb440fb-8f34-4990-9d31-e371c00368d9] succeeded in 1.4782631950001814s: None 2024-05-25T23:48:02.487006995Z [2024-05-25 23:48:02,486: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:48:02.491269994Z [2024-05-25 23:48:02,490: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:48:02.501590388Z [2024-05-25 23:48:02,501: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:48:02.505346971Z [2024-05-25 23:48:02,504: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:48:02.516060936Z [2024-05-25 23:48:02,515: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:48:02.518346169Z [2024-05-25 23:48:02,518: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:48:02.518358066Z [2024-05-25 23:48:02,518: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:48:02.518557908Z [2024-05-25 23:48:02,518: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:48:02.518623701Z [2024-05-25 23:48:02,518: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:48:02.519024513Z [2024-05-25 23:48:02,518: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:48:02.519066393Z [2024-05-25 23:48:02,518: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:48:02.525946235Z [2024-05-25 23:48:02,525: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:48:02.527114742Z [2024-05-25 23:48:02,526: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:48:02.527279894Z [2024-05-25 23:48:02,527: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:48:02.527468695Z [2024-05-25 23:48:02,527: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:48:02.527668460Z [2024-05-25 23:48:02,527: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:48:02.528004832Z [2024-05-25 23:48:02,527: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:48:02.528153114Z [2024-05-25 23:48:02,528: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:48:02.634246635Z [2024-05-25 23:48:02,633: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:48:02.639952019Z [2024-05-25 23:48:02,639: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:48:04.551478298Z [2024-05-25 23:48:04,551: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d9cbeee9-0048-4cb6-9d2d-551276f535bd] succeeded in 4.034675084999435s: None 2024-05-25T23:48:04.952386526Z [2024-05-25 23:48:04,952: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b537be9-6064-4f22-bb31-75e2807b7d1c] succeeded in 4.431027270000413s: None 2024-05-25T23:49:00.421227408Z [2024-05-25 23:49:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac9a83b2-286a-4e6f-bf5f-ae4f92dc2110] received 2024-05-25T23:49:00.433151014Z [2024-05-25 23:49:00,432: INFO/ForkPoolWorker-15] [ac9a83b2-286a-4e6f-bf5f-ae4f92dc2110] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:49:00.433735626Z [2024-05-25 23:49:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f61f21d-0f45-4293-9046-f4dee3efc6b8] received 2024-05-25T23:49:00.435996764Z [2024-05-25 23:49:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[805ae796-f992-4879-b979-6f2211edc8cb] received 2024-05-25T23:49:00.447109632Z [2024-05-25 23:49:00,446: INFO/ForkPoolWorker-1] [805ae796-f992-4879-b979-6f2211edc8cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:49:00.451996869Z [2024-05-25 23:49:00,451: INFO/ForkPoolWorker-16] [0f61f21d-0f45-4293-9046-f4dee3efc6b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:49:00.792989916Z [2024-05-25 23:49:00,786: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:49:00.871026473Z [2024-05-25 23:49:00,865: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:49:00.945193924Z [2024-05-25 23:49:00,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:49:00.965081569Z [2024-05-25 23:49:00,964: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:49:00.969263637Z [2024-05-25 23:49:00,968: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:49:00.997564970Z [2024-05-25 23:49:00,997: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:49:00.998585470Z [2024-05-25 23:49:00,998: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:49:00.998710318Z [2024-05-25 23:49:00,998: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:49:01.003903268Z [2024-05-25 23:49:01,003: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:49:01.004502435Z [2024-05-25 23:49:01,004: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:49:01.118690779Z [2024-05-25 23:49:01,118: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:49:01.705617899Z [2024-05-25 23:49:01,705: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[805ae796-f992-4879-b979-6f2211edc8cb] succeeded in 1.267055968999557s: None 2024-05-25T23:49:02.161746773Z [2024-05-25 23:49:02,161: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:49:02.165315077Z [2024-05-25 23:49:02,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:49:02.193707124Z [2024-05-25 23:49:02,193: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:49:02.196275247Z [2024-05-25 23:49:02,195: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:49:02.196682623Z [2024-05-25 23:49:02,196: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:49:02.197106996Z [2024-05-25 23:49:02,196: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:49:02.197350249Z [2024-05-25 23:49:02,197: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:49:02.197996943Z [2024-05-25 23:49:02,197: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:49:02.198242903Z [2024-05-25 23:49:02,198: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:49:02.277219327Z [2024-05-25 23:49:02,276: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:49:02.307292575Z [2024-05-25 23:49:02,306: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:49:02.310960669Z [2024-05-25 23:49:02,310: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:49:02.347380879Z [2024-05-25 23:49:02,347: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:49:02.350210688Z [2024-05-25 23:49:02,349: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:49:02.350467800Z [2024-05-25 23:49:02,350: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:49:02.350825640Z [2024-05-25 23:49:02,350: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:49:02.351038348Z [2024-05-25 23:49:02,350: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:49:02.351564767Z [2024-05-25 23:49:02,351: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:49:02.352033826Z [2024-05-25 23:49:02,351: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:49:02.469574038Z [2024-05-25 23:49:02,469: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:49:04.147235272Z [2024-05-25 23:49:04,146: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac9a83b2-286a-4e6f-bf5f-ae4f92dc2110] succeeded in 3.723275414999989s: None 2024-05-25T23:49:04.529504035Z [2024-05-25 23:49:04,528: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f61f21d-0f45-4293-9046-f4dee3efc6b8] succeeded in 4.093259128000682s: None 2024-05-25T23:50:00.316420181Z [2024-05-25 23:50:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e024349-7a23-464c-a19f-3443f723e737] received 2024-05-25T23:50:00.325009067Z [2024-05-25 23:50:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e08ef8a2-7fa3-4a99-90f3-64a8df897c19] received 2024-05-25T23:50:00.327238802Z [2024-05-25 23:50:00,326: INFO/ForkPoolWorker-15] [6e024349-7a23-464c-a19f-3443f723e737] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:50:00.334316901Z [2024-05-25 23:50:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99c78b83-9f2b-4211-b4d5-802986633cb1] received 2024-05-25T23:50:00.335246209Z [2024-05-25 23:50:00,334: INFO/ForkPoolWorker-16] [e08ef8a2-7fa3-4a99-90f3-64a8df897c19] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:50:00.344195051Z [2024-05-25 23:50:00,343: INFO/ForkPoolWorker-1] [99c78b83-9f2b-4211-b4d5-802986633cb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:50:00.348033177Z [2024-05-25 23:50:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f28692d-7896-4b2c-a0d4-eec2576c5ffe] received 2024-05-25T23:50:00.352007203Z [2024-05-25 23:50:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09128312-7e24-4cc4-8dbe-0ea58ae8d9d8] received 2024-05-25T23:50:00.364074748Z [2024-05-25 23:50:00,363: INFO/ForkPoolWorker-2] [1f28692d-7896-4b2c-a0d4-eec2576c5ffe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:50:00.365485048Z [2024-05-25 23:50:00,365: INFO/ForkPoolWorker-3] [09128312-7e24-4cc4-8dbe-0ea58ae8d9d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:50:00.637913967Z [2024-05-25 23:50:00,632: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:50:00.686733351Z [2024-05-25 23:50:00,683: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:50:00.879688758Z [2024-05-25 23:50:00,876: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:50:00.941374381Z [2024-05-25 23:50:00,937: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:50:01.054624753Z [2024-05-25 23:50:01,051: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:50:01.134211260Z [2024-05-25 23:50:01,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:50:01.423225875Z [2024-05-25 23:50:01,422: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:50:01.427869054Z [2024-05-25 23:50:01,427: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:50:01.450973052Z [2024-05-25 23:50:01,450: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:50:01.452882714Z [2024-05-25 23:50:01,452: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:50:01.452920769Z [2024-05-25 23:50:01,452: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:50:01.452948421Z [2024-05-25 23:50:01,452: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:50:01.454947767Z [2024-05-25 23:50:01,454: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:50:01.702778703Z [2024-05-25 23:50:01,702: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:50:01.836752517Z [2024-05-25 23:50:01,836: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e08ef8a2-7fa3-4a99-90f3-64a8df897c19] succeeded in 1.5099951040001542s: None 2024-05-25T23:50:02.346706191Z [2024-05-25 23:50:02,346: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:50:02.350594012Z [2024-05-25 23:50:02,350: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:50:02.414690064Z [2024-05-25 23:50:02,414: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:50:02.421468317Z [2024-05-25 23:50:02,421: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:50:02.421515458Z [2024-05-25 23:50:02,421: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:50:02.421753420Z [2024-05-25 23:50:02,421: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:50:02.421770580Z [2024-05-25 23:50:02,421: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:50:02.426854668Z [2024-05-25 23:50:02,426: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:50:02.433873718Z [2024-05-25 23:50:02,426: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:50:02.570347708Z [2024-05-25 23:50:02,570: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:50:02.630079118Z [2024-05-25 23:50:02,629: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:50:02.639060674Z [2024-05-25 23:50:02,638: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:50:02.664831026Z [2024-05-25 23:50:02,664: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1f28692d-7896-4b2c-a0d4-eec2576c5ffe] succeeded in 2.3141699249999874s: None 2024-05-25T23:50:02.691962881Z [2024-05-25 23:50:02,690: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:50:02.692728015Z [2024-05-25 23:50:02,692: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:50:02.692742749Z [2024-05-25 23:50:02,692: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:50:02.692839400Z [2024-05-25 23:50:02,692: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:50:02.692890990Z [2024-05-25 23:50:02,692: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:50:02.693180438Z [2024-05-25 23:50:02,693: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:50:02.693190629Z [2024-05-25 23:50:02,693: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:50:02.819017402Z [2024-05-25 23:50:02,818: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:50:03.000789577Z [2024-05-25 23:50:03,000: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T23:50:03.009104003Z [2024-05-25 23:50:03,008: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:50:03.040302079Z [2024-05-25 23:50:03,040: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T23:50:03.041638779Z [2024-05-25 23:50:03,041: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:50:03.041838405Z [2024-05-25 23:50:03,041: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:50:03.042089833Z [2024-05-25 23:50:03,041: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:50:03.042357312Z [2024-05-25 23:50:03,042: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T23:50:03.042912209Z [2024-05-25 23:50:03,042: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:50:03.043104786Z [2024-05-25 23:50:03,042: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:50:03.133975868Z [2024-05-25 23:50:03,133: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:50:03.271820340Z [2024-05-25 23:50:03,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05d652e8-8601-4158-8870-90fb0c5ad6fe] received 2024-05-25T23:50:03.286752307Z [2024-05-25 23:50:03,285: INFO/ForkPoolWorker-16] [05d652e8-8601-4158-8870-90fb0c5ad6fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:50:03.386910262Z [2024-05-25 23:50:03,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e024349-7a23-464c-a19f-3443f723e737] succeeded in 3.068564234000405s: None 2024-05-25T23:50:03.686055070Z [2024-05-25 23:50:03,681: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:50:05.108066084Z [2024-05-25 23:50:05,107: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:50:05.111931420Z [2024-05-25 23:50:05,111: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:50:05.189130986Z [2024-05-25 23:50:05,188: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:50:05.196536562Z [2024-05-25 23:50:05,196: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:50:05.196553764Z [2024-05-25 23:50:05,196: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:50:05.197660169Z [2024-05-25 23:50:05,196: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:50:05.197814418Z [2024-05-25 23:50:05,197: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:50:05.198238893Z [2024-05-25 23:50:05,198: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:50:05.200621523Z [2024-05-25 23:50:05,198: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:50:05.376629901Z [2024-05-25 23:50:05,376: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[09128312-7e24-4cc4-8dbe-0ea58ae8d9d8] succeeded in 5.021927625999524s: None 2024-05-25T23:50:05.438071274Z [2024-05-25 23:50:05,436: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[99c78b83-9f2b-4211-b4d5-802986633cb1] succeeded in 5.100606828999844s: None 2024-05-25T23:50:05.438403575Z [2024-05-25 23:50:05,438: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:50:06.139595252Z [2024-05-25 23:50:06,139: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[05d652e8-8601-4158-8870-90fb0c5ad6fe] succeeded in 2.86673138200058s: None 2024-05-25T23:50:06.890681842Z [2024-05-25 23:50:06,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81186120-e8b7-481d-8c19-8113e0b79e35] received 2024-05-25T23:50:06.909491468Z [2024-05-25 23:50:06,909: INFO/ForkPoolWorker-15] [81186120-e8b7-481d-8c19-8113e0b79e35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:50:07.195816772Z [2024-05-25 23:50:07,192: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:50:08.296585827Z [2024-05-25 23:50:08,296: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:50:08.300179564Z [2024-05-25 23:50:08,299: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:50:08.328872745Z [2024-05-25 23:50:08,328: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:50:08.330305123Z [2024-05-25 23:50:08,330: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:50:08.330360168Z [2024-05-25 23:50:08,330: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:50:08.330471941Z [2024-05-25 23:50:08,330: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:50:08.330506434Z [2024-05-25 23:50:08,330: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:50:08.331217118Z [2024-05-25 23:50:08,330: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:50:08.331275260Z [2024-05-25 23:50:08,331: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:50:08.459129836Z [2024-05-25 23:50:08,458: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:50:09.006168426Z [2024-05-25 23:50:09,003: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81186120-e8b7-481d-8c19-8113e0b79e35] succeeded in 2.106845194000016s: None 2024-05-25T23:50:09.035630855Z [2024-05-25 23:50:09,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a990a36a-a9d6-4764-a1e3-8a4fca09f40e] received 2024-05-25T23:50:09.054638651Z [2024-05-25 23:50:09,053: INFO/ForkPoolWorker-15] [a990a36a-a9d6-4764-a1e3-8a4fca09f40e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:50:09.361508355Z [2024-05-25 23:50:09,358: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:50:10.448256134Z [2024-05-25 23:50:10,447: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:50:10.451471410Z [2024-05-25 23:50:10,450: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:50:10.479779819Z [2024-05-25 23:50:10,479: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:50:10.481608577Z [2024-05-25 23:50:10,481: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:50:10.481841266Z [2024-05-25 23:50:10,481: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:50:10.482077681Z [2024-05-25 23:50:10,481: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:50:10.482411860Z [2024-05-25 23:50:10,482: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:50:10.482977263Z [2024-05-25 23:50:10,482: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:50:10.483108550Z [2024-05-25 23:50:10,482: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:50:10.563178224Z [2024-05-25 23:50:10,562: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:50:11.112770150Z [2024-05-25 23:50:11,112: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a990a36a-a9d6-4764-a1e3-8a4fca09f40e] succeeded in 2.0750566430006074s: None 2024-05-25T23:51:00.232850672Z [2024-05-25 23:51:00,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c1902a4-a0ee-4e3e-990d-b93847f50a9b] received 2024-05-25T23:51:00.238858947Z [2024-05-25 23:51:00,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3787febd-74bf-4687-8912-3025347fbfcc] received 2024-05-25T23:51:00.241484185Z [2024-05-25 23:51:00,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc9b5e45-54d9-4e54-bdd4-be843749f62e] received 2024-05-25T23:51:00.244244131Z [2024-05-25 23:51:00,243: INFO/ForkPoolWorker-15] [2c1902a4-a0ee-4e3e-990d-b93847f50a9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:51:00.250127837Z [2024-05-25 23:51:00,249: INFO/ForkPoolWorker-16] [3787febd-74bf-4687-8912-3025347fbfcc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:51:00.254143431Z [2024-05-25 23:51:00,253: INFO/ForkPoolWorker-1] [dc9b5e45-54d9-4e54-bdd4-be843749f62e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:51:00.556027910Z [2024-05-25 23:51:00,552: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:51:00.578222837Z [2024-05-25 23:51:00,574: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:51:00.680543963Z [2024-05-25 23:51:00,677: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:51:00.884411988Z [2024-05-25 23:51:00,884: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:51:00.888235876Z [2024-05-25 23:51:00,887: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:51:00.916422396Z [2024-05-25 23:51:00,916: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:51:00.924529762Z [2024-05-25 23:51:00,924: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:51:00.924916383Z [2024-05-25 23:51:00,924: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:51:00.925171795Z [2024-05-25 23:51:00,924: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:51:00.925593866Z [2024-05-25 23:51:00,925: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:51:01.005124226Z [2024-05-25 23:51:01,004: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:51:01.712488780Z [2024-05-25 23:51:01,712: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc9b5e45-54d9-4e54-bdd4-be843749f62e] succeeded in 1.4692507230001866s: None 2024-05-25T23:51:01.781619591Z [2024-05-25 23:51:01,781: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:51:01.785010214Z [2024-05-25 23:51:01,784: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:51:01.805502159Z [2024-05-25 23:51:01,805: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:51:01.806840104Z [2024-05-25 23:51:01,806: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:51:01.806855015Z [2024-05-25 23:51:01,806: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:51:01.806994945Z [2024-05-25 23:51:01,806: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:51:01.807008959Z [2024-05-25 23:51:01,806: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:51:01.807575561Z [2024-05-25 23:51:01,807: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:51:01.807687559Z [2024-05-25 23:51:01,807: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:51:01.903030536Z [2024-05-25 23:51:01,902: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:51:02.023557268Z [2024-05-25 23:51:02,023: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:51:02.027409442Z [2024-05-25 23:51:02,027: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:51:02.045503218Z [2024-05-25 23:51:02,045: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:51:02.046881788Z [2024-05-25 23:51:02,046: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:51:02.047104234Z [2024-05-25 23:51:02,046: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:51:02.047345169Z [2024-05-25 23:51:02,047: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:51:02.047628239Z [2024-05-25 23:51:02,047: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:51:02.048145005Z [2024-05-25 23:51:02,047: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:51:02.048329536Z [2024-05-25 23:51:02,048: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:51:02.128506930Z [2024-05-25 23:51:02,128: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:51:03.541039185Z [2024-05-25 23:51:03,540: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3787febd-74bf-4687-8912-3025347fbfcc] succeeded in 3.299276933999863s: None 2024-05-25T23:51:03.919807297Z [2024-05-25 23:51:03,919: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c1902a4-a0ee-4e3e-990d-b93847f50a9b] succeeded in 3.682854720999785s: None 2024-05-25T23:52:00.923436390Z [2024-05-25 23:52:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd782761-a64b-4d55-9aad-f701912a99cb] received 2024-05-25T23:52:00.928469201Z [2024-05-25 23:52:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80a2967a-053b-4406-bf73-2cafd6dc93d9] received 2024-05-25T23:52:00.937479041Z [2024-05-25 23:52:00,937: INFO/ForkPoolWorker-15] [bd782761-a64b-4d55-9aad-f701912a99cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:52:00.944477341Z [2024-05-25 23:52:00,943: INFO/ForkPoolWorker-16] [80a2967a-053b-4406-bf73-2cafd6dc93d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:52:00.952269191Z [2024-05-25 23:52:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22dff4d4-f04a-40cc-b71c-df492d16970d] received 2024-05-25T23:52:00.954819763Z [2024-05-25 23:52:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a659c950-4fb8-42bb-80cc-a2e132daa2dd] received 2024-05-25T23:52:00.975348934Z [2024-05-25 23:52:00,974: INFO/ForkPoolWorker-1] [22dff4d4-f04a-40cc-b71c-df492d16970d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:52:00.984997852Z [2024-05-25 23:52:00,984: INFO/ForkPoolWorker-2] [a659c950-4fb8-42bb-80cc-a2e132daa2dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:52:01.265289710Z [2024-05-25 23:52:01,260: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:52:01.291799286Z [2024-05-25 23:52:01,288: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:52:01.426512331Z [2024-05-25 23:52:01,417: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:52:01.427837511Z [2024-05-25 23:52:01,418: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:52:01.623482432Z [2024-05-25 23:52:01,623: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:52:01.628025348Z [2024-05-25 23:52:01,627: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:52:01.671295750Z [2024-05-25 23:52:01,671: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:52:01.672765631Z [2024-05-25 23:52:01,672: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:52:01.676304310Z [2024-05-25 23:52:01,676: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:52:01.676562796Z [2024-05-25 23:52:01,676: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:52:01.676723485Z [2024-05-25 23:52:01,676: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:52:01.677026512Z [2024-05-25 23:52:01,676: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:52:01.827920065Z [2024-05-25 23:52:01,827: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:52:02.414016434Z [2024-05-25 23:52:02,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd782761-a64b-4d55-9aad-f701912a99cb] succeeded in 1.4833486959996662s: None 2024-05-25T23:52:02.636203445Z [2024-05-25 23:52:02,635: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a659c950-4fb8-42bb-80cc-a2e132daa2dd] succeeded in 1.6622298809998028s: None 2024-05-25T23:52:02.836993403Z [2024-05-25 23:52:02,836: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:52:02.842658594Z [2024-05-25 23:52:02,842: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:52:02.909884456Z [2024-05-25 23:52:02,909: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:52:02.920257778Z [2024-05-25 23:52:02,919: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:52:02.920573662Z [2024-05-25 23:52:02,920: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:52:02.920793776Z [2024-05-25 23:52:02,920: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:52:02.920844265Z [2024-05-25 23:52:02,920: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:52:02.921135490Z [2024-05-25 23:52:02,921: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:52:02.921170413Z [2024-05-25 23:52:02,921: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:52:03.213791434Z [2024-05-25 23:52:03,213: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:52:03.593370805Z [2024-05-25 23:52:03,593: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:52:03.598175629Z [2024-05-25 23:52:03,597: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:52:03.652446590Z [2024-05-25 23:52:03,652: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:52:03.657028466Z [2024-05-25 23:52:03,656: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:52:03.657591184Z [2024-05-25 23:52:03,656: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:52:03.659404836Z [2024-05-25 23:52:03,659: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:52:03.661838703Z [2024-05-25 23:52:03,659: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:52:03.661914630Z [2024-05-25 23:52:03,661: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:52:03.662125164Z [2024-05-25 23:52:03,661: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:52:03.783792360Z [2024-05-25 23:52:03,783: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:52:05.758812731Z [2024-05-25 23:52:05,758: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80a2967a-053b-4406-bf73-2cafd6dc93d9] succeeded in 4.825692252999943s: None 2024-05-25T23:52:06.427870573Z [2024-05-25 23:52:06,427: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[22dff4d4-f04a-40cc-b71c-df492d16970d] succeeded in 5.469789226000103s: None 2024-05-25T23:53:01.230426785Z [2024-05-25 23:53:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[841be48a-c540-454d-9f7c-a1ffb5a6d184] received 2024-05-25T23:53:01.232483749Z [2024-05-25 23:53:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93359b35-4722-49ba-9354-ccca9532bdef] received 2024-05-25T23:53:01.244787590Z [2024-05-25 23:53:01,244: INFO/ForkPoolWorker-16] [93359b35-4722-49ba-9354-ccca9532bdef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:53:01.245090422Z [2024-05-25 23:53:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b47f3c8-a4ec-4c71-81d9-0399a744b961] received 2024-05-25T23:53:01.245321623Z [2024-05-25 23:53:01,244: INFO/ForkPoolWorker-15] [841be48a-c540-454d-9f7c-a1ffb5a6d184] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:53:01.284177098Z [2024-05-25 23:53:01,283: INFO/ForkPoolWorker-1] [0b47f3c8-a4ec-4c71-81d9-0399a744b961] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:53:01.560018028Z [2024-05-25 23:53:01,556: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:53:01.593497519Z [2024-05-25 23:53:01,590: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:53:01.621710725Z [2024-05-25 23:53:01,617: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:53:01.810497676Z [2024-05-25 23:53:01,809: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:53:01.815188017Z [2024-05-25 23:53:01,814: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:53:01.848568406Z [2024-05-25 23:53:01,848: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:53:01.849881473Z [2024-05-25 23:53:01,849: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:53:01.850533192Z [2024-05-25 23:53:01,849: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:53:01.850808763Z [2024-05-25 23:53:01,850: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:53:01.851166137Z [2024-05-25 23:53:01,851: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:53:01.983609668Z [2024-05-25 23:53:01,983: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:53:02.616808757Z [2024-05-25 23:53:02,616: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b47f3c8-a4ec-4c71-81d9-0399a744b961] succeeded in 1.3651349310002843s: None 2024-05-25T23:53:02.736308502Z [2024-05-25 23:53:02,735: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:53:02.740465643Z [2024-05-25 23:53:02,740: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:53:02.761452841Z [2024-05-25 23:53:02,761: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:53:02.763297291Z [2024-05-25 23:53:02,763: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:53:02.763315644Z [2024-05-25 23:53:02,763: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:53:02.763431130Z [2024-05-25 23:53:02,763: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:53:02.763441922Z [2024-05-25 23:53:02,763: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:53:02.763727628Z [2024-05-25 23:53:02,763: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:53:02.763781967Z [2024-05-25 23:53:02,763: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:53:02.785265006Z [2024-05-25 23:53:02,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:53:02.788836362Z [2024-05-25 23:53:02,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:53:02.816439948Z [2024-05-25 23:53:02,816: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:53:02.817943885Z [2024-05-25 23:53:02,817: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:53:02.818159584Z [2024-05-25 23:53:02,817: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:53:02.818473476Z [2024-05-25 23:53:02,818: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:53:02.818600663Z [2024-05-25 23:53:02,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:53:02.818968122Z [2024-05-25 23:53:02,818: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:53:02.819132831Z [2024-05-25 23:53:02,818: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:53:02.835099370Z [2024-05-25 23:53:02,834: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:53:02.921357499Z [2024-05-25 23:53:02,921: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:53:05.170805290Z [2024-05-25 23:53:05,170: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[841be48a-c540-454d-9f7c-a1ffb5a6d184] succeeded in 3.935755210000025s: None 2024-05-25T23:53:05.390183221Z [2024-05-25 23:53:05,389: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93359b35-4722-49ba-9354-ccca9532bdef] succeeded in 4.15527308899982s: None 2024-05-25T23:54:01.051286578Z [2024-05-25 23:54:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f1fbb35-5140-439a-9899-360b28df0f44] received 2024-05-25T23:54:01.054275272Z [2024-05-25 23:54:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[798ee358-0479-414b-98de-8885c385acfa] received 2024-05-25T23:54:01.057517429Z [2024-05-25 23:54:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[312807a3-d395-4d38-82c1-07670a14486e] received 2024-05-25T23:54:01.063135694Z [2024-05-25 23:54:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b7c3dc0-f609-4c8b-bf05-5c0df25ea18c] received 2024-05-25T23:54:01.063449331Z [2024-05-25 23:54:01,063: INFO/ForkPoolWorker-15] [9f1fbb35-5140-439a-9899-360b28df0f44] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:54:01.068383245Z [2024-05-25 23:54:01,068: INFO/ForkPoolWorker-16] [798ee358-0479-414b-98de-8885c385acfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:54:01.071344203Z [2024-05-25 23:54:01,070: INFO/ForkPoolWorker-1] [312807a3-d395-4d38-82c1-07670a14486e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:54:01.082436153Z [2024-05-25 23:54:01,082: INFO/ForkPoolWorker-2] [0b7c3dc0-f609-4c8b-bf05-5c0df25ea18c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:54:01.355870167Z [2024-05-25 23:54:01,352: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:54:01.468484406Z [2024-05-25 23:54:01,464: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:54:01.504671017Z [2024-05-25 23:54:01,501: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:54:01.537761657Z [2024-05-25 23:54:01,533: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:54:01.709653540Z [2024-05-25 23:54:01,709: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:54:01.780695077Z [2024-05-25 23:54:01,780: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:54:01.784685508Z [2024-05-25 23:54:01,784: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:54:01.811203313Z [2024-05-25 23:54:01,810: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:54:01.812291781Z [2024-05-25 23:54:01,812: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:54:01.812357961Z [2024-05-25 23:54:01,812: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:54:01.812419212Z [2024-05-25 23:54:01,812: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:54:01.812768011Z [2024-05-25 23:54:01,812: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:54:01.894355822Z [2024-05-25 23:54:01,894: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:54:02.309244187Z [2024-05-25 23:54:02,308: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f1fbb35-5140-439a-9899-360b28df0f44] succeeded in 1.254974721000508s: None 2024-05-25T23:54:02.471600861Z [2024-05-25 23:54:02,470: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0b7c3dc0-f609-4c8b-bf05-5c0df25ea18c] succeeded in 1.4039553650000016s: None 2024-05-25T23:54:02.569087519Z [2024-05-25 23:54:02,568: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:54:02.572460538Z [2024-05-25 23:54:02,572: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:54:02.592129277Z [2024-05-25 23:54:02,591: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:54:02.593535604Z [2024-05-25 23:54:02,593: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:54:02.593598427Z [2024-05-25 23:54:02,593: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:54:02.593774821Z [2024-05-25 23:54:02,593: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:54:02.593872494Z [2024-05-25 23:54:02,593: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:54:02.594162125Z [2024-05-25 23:54:02,594: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:54:02.594251381Z [2024-05-25 23:54:02,594: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:54:02.707445957Z [2024-05-25 23:54:02,707: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:54:02.786803031Z [2024-05-25 23:54:02,786: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:54:02.790099325Z [2024-05-25 23:54:02,789: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:54:02.815846267Z [2024-05-25 23:54:02,815: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:54:02.824889938Z [2024-05-25 23:54:02,824: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:54:02.824943176Z [2024-05-25 23:54:02,824: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:54:02.825241974Z [2024-05-25 23:54:02,824: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:54:02.825288450Z [2024-05-25 23:54:02,825: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:54:02.825957036Z [2024-05-25 23:54:02,825: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:54:02.826132374Z [2024-05-25 23:54:02,825: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:54:02.928572142Z [2024-05-25 23:54:02,928: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:54:05.062727724Z [2024-05-25 23:54:05,060: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[312807a3-d395-4d38-82c1-07670a14486e] succeeded in 3.9988310179996915s: None 2024-05-25T23:54:06.047504813Z [2024-05-25 23:54:06,045: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[798ee358-0479-414b-98de-8885c385acfa] succeeded in 4.9880419979999715s: None 2024-05-25T23:55:00.940234077Z [2024-05-25 23:55:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf703148-cd89-4405-a92d-c02a515f461a] received 2024-05-25T23:55:00.946140481Z [2024-05-25 23:55:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[355b2c53-3d08-4ea7-94a8-b79b6bd956ab] received 2024-05-25T23:55:00.948596400Z [2024-05-25 23:55:00,948: INFO/ForkPoolWorker-15] [bf703148-cd89-4405-a92d-c02a515f461a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:55:00.950377904Z [2024-05-25 23:55:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32ceae66-9aac-4fdc-b591-649761ec49a9] received 2024-05-25T23:55:00.956287059Z [2024-05-25 23:55:00,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57e017dd-1be6-4ab0-ac7c-a19f5a2a68c3] received 2024-05-25T23:55:00.956453550Z [2024-05-25 23:55:00,956: INFO/ForkPoolWorker-16] [355b2c53-3d08-4ea7-94a8-b79b6bd956ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:55:00.973085327Z [2024-05-25 23:55:00,972: INFO/ForkPoolWorker-1] [32ceae66-9aac-4fdc-b591-649761ec49a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:55:00.975410804Z [2024-05-25 23:55:00,975: INFO/ForkPoolWorker-2] [57e017dd-1be6-4ab0-ac7c-a19f5a2a68c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:55:01.301651865Z [2024-05-25 23:55:01,298: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:55:01.314825547Z [2024-05-25 23:55:01,311: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:55:01.349612402Z [2024-05-25 23:55:01,334: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:55:01.370672847Z [2024-05-25 23:55:01,366: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:55:01.654352341Z [2024-05-25 23:55:01,653: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:55:01.664020395Z [2024-05-25 23:55:01,663: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:55:01.724901451Z [2024-05-25 23:55:01,724: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:55:01.727560528Z [2024-05-25 23:55:01,727: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:55:01.727895617Z [2024-05-25 23:55:01,727: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:55:01.728100716Z [2024-05-25 23:55:01,727: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:55:01.728421649Z [2024-05-25 23:55:01,728: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:55:01.833756710Z [2024-05-25 23:55:01,833: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:55:02.452202400Z [2024-05-25 23:55:02,451: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[57e017dd-1be6-4ab0-ac7c-a19f5a2a68c3] succeeded in 1.4936811440002202s: None 2024-05-25T23:55:02.481575330Z [2024-05-25 23:55:02,481: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:55:02.484876166Z [2024-05-25 23:55:02,484: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:55:02.510961405Z [2024-05-25 23:55:02,510: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:55:02.512438602Z [2024-05-25 23:55:02,512: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:55:02.512452595Z [2024-05-25 23:55:02,512: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:55:02.512547783Z [2024-05-25 23:55:02,512: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:55:02.512579207Z [2024-05-25 23:55:02,512: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:55:02.512917275Z [2024-05-25 23:55:02,512: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:55:02.512956137Z [2024-05-25 23:55:02,512: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:55:02.596786510Z [2024-05-25 23:55:02,596: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:55:02.606006853Z [2024-05-25 23:55:02,605: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:55:02.621836008Z [2024-05-25 23:55:02,621: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:55:02.647149179Z [2024-05-25 23:55:02,646: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:55:02.648778007Z [2024-05-25 23:55:02,648: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:55:02.648907962Z [2024-05-25 23:55:02,648: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:55:02.649086730Z [2024-05-25 23:55:02,648: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:55:02.649197815Z [2024-05-25 23:55:02,649: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:55:02.649476409Z [2024-05-25 23:55:02,649: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:55:02.649604305Z [2024-05-25 23:55:02,649: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:55:02.739283240Z [2024-05-25 23:55:02,738: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:55:02.742610166Z [2024-05-25 23:55:02,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:55:02.743157178Z [2024-05-25 23:55:02,742: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:55:02.764079458Z [2024-05-25 23:55:02,763: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:55:02.765612968Z [2024-05-25 23:55:02,765: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:55:02.765632409Z [2024-05-25 23:55:02,765: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:55:02.765764062Z [2024-05-25 23:55:02,765: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:55:02.765802193Z [2024-05-25 23:55:02,765: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:55:02.766020115Z [2024-05-25 23:55:02,765: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:55:02.766045958Z [2024-05-25 23:55:02,765: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:55:02.848937554Z [2024-05-25 23:55:02,848: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:55:03.439648750Z [2024-05-25 23:55:03,437: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf703148-cd89-4405-a92d-c02a515f461a] succeeded in 2.4953427139998894s: None 2024-05-25T23:55:03.838878475Z [2024-05-25 23:55:03,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25ef0c02-7540-46d2-a6d4-649bcfacc529] received 2024-05-25T23:55:03.849584997Z [2024-05-25 23:55:03,849: INFO/ForkPoolWorker-15] [25ef0c02-7540-46d2-a6d4-649bcfacc529] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:55:04.173079874Z [2024-05-25 23:55:04,170: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:55:04.281043942Z [2024-05-25 23:55:04,280: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[32ceae66-9aac-4fdc-b591-649761ec49a9] succeeded in 3.3236392399994656s: None 2024-05-25T23:55:04.416611152Z [2024-05-25 23:55:04,416: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[355b2c53-3d08-4ea7-94a8-b79b6bd956ab] succeeded in 3.4681575080003313s: None 2024-05-25T23:55:05.462813985Z [2024-05-25 23:55:05,459: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:55:05.464760972Z [2024-05-25 23:55:05,462: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:55:05.506675045Z [2024-05-25 23:55:05,506: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:55:05.511589423Z [2024-05-25 23:55:05,507: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:55:05.511608590Z [2024-05-25 23:55:05,508: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:55:05.511616499Z [2024-05-25 23:55:05,508: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:55:05.511621703Z [2024-05-25 23:55:05,508: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:55:05.511625961Z [2024-05-25 23:55:05,508: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:55:05.511630178Z [2024-05-25 23:55:05,508: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:55:05.591437985Z [2024-05-25 23:55:05,591: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:55:06.229055670Z [2024-05-25 23:55:06,228: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25ef0c02-7540-46d2-a6d4-649bcfacc529] succeeded in 2.38714521699967s: None 2024-05-25T23:55:07.043898819Z [2024-05-25 23:55:07,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e05706aa-3a9f-40c4-8630-d7088b40d937] received 2024-05-25T23:55:07.064346153Z [2024-05-25 23:55:07,064: INFO/ForkPoolWorker-15] [e05706aa-3a9f-40c4-8630-d7088b40d937] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:55:07.331364372Z [2024-05-25 23:55:07,327: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:55:08.459129757Z [2024-05-25 23:55:08,458: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:55:08.462496782Z [2024-05-25 23:55:08,462: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:55:08.495401482Z [2024-05-25 23:55:08,495: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:55:08.497408565Z [2024-05-25 23:55:08,497: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:55:08.497657157Z [2024-05-25 23:55:08,497: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:55:08.497936084Z [2024-05-25 23:55:08,497: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:55:08.498197435Z [2024-05-25 23:55:08,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:55:08.498667939Z [2024-05-25 23:55:08,498: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:55:08.498945101Z [2024-05-25 23:55:08,498: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:55:08.621420573Z [2024-05-25 23:55:08,620: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:55:09.161610052Z [2024-05-25 23:55:09,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04063b6a-9359-4201-956d-7937557d61ec] received 2024-05-25T23:55:09.171280804Z [2024-05-25 23:55:09,171: INFO/ForkPoolWorker-16] [04063b6a-9359-4201-956d-7937557d61ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:55:09.222405059Z [2024-05-25 23:55:09,221: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e05706aa-3a9f-40c4-8630-d7088b40d937] succeeded in 2.17581853899992s: None 2024-05-25T23:55:09.427605189Z [2024-05-25 23:55:09,424: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T23:55:10.479244588Z [2024-05-25 23:55:10,478: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:55:10.482501719Z [2024-05-25 23:55:10,482: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:55:10.501075895Z [2024-05-25 23:55:10,500: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:55:10.502176328Z [2024-05-25 23:55:10,501: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:55:10.502292640Z [2024-05-25 23:55:10,502: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:55:10.502425573Z [2024-05-25 23:55:10,502: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:55:10.502472203Z [2024-05-25 23:55:10,502: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:55:10.502708813Z [2024-05-25 23:55:10,502: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T23:55:10.502781658Z [2024-05-25 23:55:10,502: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:55:10.593610832Z [2024-05-25 23:55:10,593: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:55:11.237836019Z [2024-05-25 23:55:11,237: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04063b6a-9359-4201-956d-7937557d61ec] succeeded in 2.0738641349998943s: None 2024-05-25T23:56:00.868440106Z [2024-05-25 23:56:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2ef9813-ba6d-4dc1-9196-aed6407d976e] received 2024-05-25T23:56:00.874259997Z [2024-05-25 23:56:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44196658-6440-4c83-ba4b-f0bcd266ce13] received 2024-05-25T23:56:00.878761373Z [2024-05-25 23:56:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40e04986-713a-495c-bc83-5194063401a8] received 2024-05-25T23:56:00.886617235Z [2024-05-25 23:56:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a20c021-3576-45a7-81db-636570560d02] received 2024-05-25T23:56:00.887778162Z [2024-05-25 23:56:00,887: INFO/ForkPoolWorker-16] [44196658-6440-4c83-ba4b-f0bcd266ce13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:56:00.887806746Z [2024-05-25 23:56:00,887: INFO/ForkPoolWorker-15] [f2ef9813-ba6d-4dc1-9196-aed6407d976e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:56:00.891505387Z [2024-05-25 23:56:00,891: INFO/ForkPoolWorker-1] [40e04986-713a-495c-bc83-5194063401a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:56:00.904900604Z [2024-05-25 23:56:00,904: INFO/ForkPoolWorker-2] [5a20c021-3576-45a7-81db-636570560d02] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:56:01.192455193Z [2024-05-25 23:56:01,189: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:56:01.208095745Z [2024-05-25 23:56:01,205: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:56:01.336395836Z [2024-05-25 23:56:01,332: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:56:01.351886571Z [2024-05-25 23:56:01,347: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:56:01.440318446Z [2024-05-25 23:56:01,440: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:56:01.533639219Z [2024-05-25 23:56:01,533: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T23:56:01.537605687Z [2024-05-25 23:56:01,537: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:56:01.571184356Z [2024-05-25 23:56:01,570: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:56:01.573303091Z [2024-05-25 23:56:01,573: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:56:01.573531697Z [2024-05-25 23:56:01,573: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:56:01.574197349Z [2024-05-25 23:56:01,574: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T23:56:01.574542873Z [2024-05-25 23:56:01,574: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:56:01.665649956Z [2024-05-25 23:56:01,665: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:56:02.050751563Z [2024-05-25 23:56:02,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2ef9813-ba6d-4dc1-9196-aed6407d976e] succeeded in 1.1736579620001066s: None 2024-05-25T23:56:02.277021135Z [2024-05-25 23:56:02,276: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5a20c021-3576-45a7-81db-636570560d02] succeeded in 1.3855093960000886s: None 2024-05-25T23:56:02.442872572Z [2024-05-25 23:56:02,442: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:56:02.446030276Z [2024-05-25 23:56:02,445: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:56:02.473171916Z [2024-05-25 23:56:02,472: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:56:02.474552451Z [2024-05-25 23:56:02,474: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:56:02.474812547Z [2024-05-25 23:56:02,474: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:56:02.475042334Z [2024-05-25 23:56:02,474: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:56:02.475248615Z [2024-05-25 23:56:02,475: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:56:02.475971078Z [2024-05-25 23:56:02,475: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:56:02.476123370Z [2024-05-25 23:56:02,475: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:56:02.563928153Z [2024-05-25 23:56:02,563: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:56:02.784953620Z [2024-05-25 23:56:02,784: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:56:02.788357648Z [2024-05-25 23:56:02,787: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:56:02.810636449Z [2024-05-25 23:56:02,810: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:56:02.812375218Z [2024-05-25 23:56:02,812: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:56:02.812440642Z [2024-05-25 23:56:02,812: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:56:02.812619313Z [2024-05-25 23:56:02,812: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:56:02.812700794Z [2024-05-25 23:56:02,812: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:56:02.813036617Z [2024-05-25 23:56:02,812: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:56:02.813084140Z [2024-05-25 23:56:02,812: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:56:02.909444939Z [2024-05-25 23:56:02,909: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:56:04.458036493Z [2024-05-25 23:56:04,455: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[44196658-6440-4c83-ba4b-f0bcd266ce13] succeeded in 3.577539347000311s: None 2024-05-25T23:56:04.722146522Z [2024-05-25 23:56:04,721: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[40e04986-713a-495c-bc83-5194063401a8] succeeded in 3.839888086999963s: None 2024-05-25T23:57:00.256247584Z [2024-05-25 23:57:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2a26bb4-b2e0-47e0-aa59-01d0f65c9fb0] received 2024-05-25T23:57:00.263647503Z [2024-05-25 23:57:00,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74e3b23a-9f97-40a9-8d3a-74f760b428de] received 2024-05-25T23:57:00.270021094Z [2024-05-25 23:57:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dadf5b96-8f45-417d-b4a0-afe60573d5b6] received 2024-05-25T23:57:00.282731820Z [2024-05-25 23:57:00,282: INFO/ForkPoolWorker-16] [74e3b23a-9f97-40a9-8d3a-74f760b428de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:57:00.290171516Z [2024-05-25 23:57:00,289: INFO/ForkPoolWorker-15] [f2a26bb4-b2e0-47e0-aa59-01d0f65c9fb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:57:00.297419013Z [2024-05-25 23:57:00,297: INFO/ForkPoolWorker-1] [dadf5b96-8f45-417d-b4a0-afe60573d5b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:57:00.618609180Z [2024-05-25 23:57:00,615: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:57:00.685202667Z [2024-05-25 23:57:00,682: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:57:00.723257947Z [2024-05-25 23:57:00,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:57:00.946973591Z [2024-05-25 23:57:00,946: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:57:00.954347179Z [2024-05-25 23:57:00,953: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:57:00.985894727Z [2024-05-25 23:57:00,985: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:57:00.989858384Z [2024-05-25 23:57:00,989: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:57:00.990039583Z [2024-05-25 23:57:00,989: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:57:00.990152876Z [2024-05-25 23:57:00,990: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:57:00.990406229Z [2024-05-25 23:57:00,990: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:57:01.146031623Z [2024-05-25 23:57:01,145: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:57:01.893840309Z [2024-05-25 23:57:01,893: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dadf5b96-8f45-417d-b4a0-afe60573d5b6] succeeded in 1.6220942720001403s: None 2024-05-25T23:57:02.147939571Z [2024-05-25 23:57:02,142: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:57:02.151277909Z [2024-05-25 23:57:02,150: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:57:02.180667973Z [2024-05-25 23:57:02,180: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:57:02.181875688Z [2024-05-25 23:57:02,181: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:57:02.182134106Z [2024-05-25 23:57:02,181: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:57:02.182301213Z [2024-05-25 23:57:02,182: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:57:02.182393196Z [2024-05-25 23:57:02,182: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:57:02.182600353Z [2024-05-25 23:57:02,182: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:57:02.182690899Z [2024-05-25 23:57:02,182: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:57:02.222521909Z [2024-05-25 23:57:02,222: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:57:02.227082381Z [2024-05-25 23:57:02,226: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:57:02.250280060Z [2024-05-25 23:57:02,250: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:57:02.254173375Z [2024-05-25 23:57:02,253: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:57:02.254255798Z [2024-05-25 23:57:02,254: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:57:02.254383855Z [2024-05-25 23:57:02,254: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:57:02.254438526Z [2024-05-25 23:57:02,254: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:57:02.254702846Z [2024-05-25 23:57:02,254: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:57:02.254805622Z [2024-05-25 23:57:02,254: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:57:02.280441992Z [2024-05-25 23:57:02,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:57:02.342618659Z [2024-05-25 23:57:02,342: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:57:03.707003293Z [2024-05-25 23:57:03,706: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[74e3b23a-9f97-40a9-8d3a-74f760b428de] succeeded in 3.440860708999935s: None 2024-05-25T23:57:04.565603066Z [2024-05-25 23:57:04,564: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2a26bb4-b2e0-47e0-aa59-01d0f65c9fb0] succeeded in 4.2980176500004745s: None 2024-05-25T23:58:00.643711086Z [2024-05-25 23:58:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85268064-54da-46a5-a804-9e5ce6c1d2af] received 2024-05-25T23:58:00.650706375Z [2024-05-25 23:58:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec77c098-a821-4358-9ad1-fd89d8e5e5cb] received 2024-05-25T23:58:00.653911362Z [2024-05-25 23:58:00,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5ec4e80-182c-4014-9817-634d613fa4bf] received 2024-05-25T23:58:00.656871113Z [2024-05-25 23:58:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19340123-13c9-4758-ab76-7153de6abfda] received 2024-05-25T23:58:00.662208594Z [2024-05-25 23:58:00,661: INFO/ForkPoolWorker-15] [85268064-54da-46a5-a804-9e5ce6c1d2af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:58:00.666568914Z [2024-05-25 23:58:00,666: INFO/ForkPoolWorker-16] [ec77c098-a821-4358-9ad1-fd89d8e5e5cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:58:00.678537759Z [2024-05-25 23:58:00,678: INFO/ForkPoolWorker-2] [19340123-13c9-4758-ab76-7153de6abfda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:58:00.686942815Z [2024-05-25 23:58:00,686: INFO/ForkPoolWorker-1] [e5ec4e80-182c-4014-9817-634d613fa4bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:58:00.989409980Z [2024-05-25 23:58:00,985: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T23:58:01.007031023Z [2024-05-25 23:58:01,003: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:58:01.046012498Z [2024-05-25 23:58:01,042: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:58:01.058943116Z [2024-05-25 23:58:01,055: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:58:01.219906817Z [2024-05-25 23:58:01,219: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T23:58:01.224476411Z [2024-05-25 23:58:01,224: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:58:01.258945530Z [2024-05-25 23:58:01,258: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:58:01.261908953Z [2024-05-25 23:58:01,261: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:58:01.262138794Z [2024-05-25 23:58:01,261: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:58:01.262389815Z [2024-05-25 23:58:01,262: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T23:58:01.264485956Z [2024-05-25 23:58:01,264: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:58:01.373343787Z [2024-05-25 23:58:01,373: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:58:01.404506773Z [2024-05-25 23:58:01,404: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:58:02.186655310Z [2024-05-25 23:58:02,186: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec77c098-a821-4358-9ad1-fd89d8e5e5cb] succeeded in 1.530723334999493s: None 2024-05-25T23:58:02.212870060Z [2024-05-25 23:58:02,212: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5ec4e80-182c-4014-9817-634d613fa4bf] succeeded in 1.5433826299995417s: None 2024-05-25T23:58:02.500220289Z [2024-05-25 23:58:02,499: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T23:58:02.503819530Z [2024-05-25 23:58:02,503: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:58:02.520420828Z [2024-05-25 23:58:02,520: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:58:02.521567754Z [2024-05-25 23:58:02,521: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:58:02.521695370Z [2024-05-25 23:58:02,521: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:58:02.521851566Z [2024-05-25 23:58:02,521: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:58:02.522005845Z [2024-05-25 23:58:02,521: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T23:58:02.522356496Z [2024-05-25 23:58:02,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:58:02.522364383Z [2024-05-25 23:58:02,522: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:58:02.604857509Z [2024-05-25 23:58:02,604: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:58:02.794522180Z [2024-05-25 23:58:02,794: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T23:58:02.801542797Z [2024-05-25 23:58:02,801: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:58:02.834018885Z [2024-05-25 23:58:02,833: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T23:58:02.835054572Z [2024-05-25 23:58:02,834: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:58:02.835072374Z [2024-05-25 23:58:02,835: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:58:02.835240291Z [2024-05-25 23:58:02,835: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:58:02.835270833Z [2024-05-25 23:58:02,835: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T23:58:02.835582856Z [2024-05-25 23:58:02,835: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:58:02.835650822Z [2024-05-25 23:58:02,835: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:58:02.948653569Z [2024-05-25 23:58:02,948: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:58:04.352630984Z [2024-05-25 23:58:04,352: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85268064-54da-46a5-a804-9e5ce6c1d2af] succeeded in 3.706842947000041s: None 2024-05-25T23:58:05.408755343Z [2024-05-25 23:58:05,408: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[19340123-13c9-4758-ab76-7153de6abfda] succeeded in 4.747262914999737s: None 2024-05-25T23:59:01.221004471Z [2024-05-25 23:59:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[789d7c9e-0cbf-4a64-99e4-de6f3863ddfc] received 2024-05-25T23:59:01.228330313Z [2024-05-25 23:59:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f5ac2ce-3fa4-4038-ae38-9bce8edbad5e] received 2024-05-25T23:59:01.234267930Z [2024-05-25 23:59:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65539ad2-36a6-4016-ad0b-d5c7df54e8a5] received 2024-05-25T23:59:01.235319114Z [2024-05-25 23:59:01,235: INFO/ForkPoolWorker-15] [789d7c9e-0cbf-4a64-99e4-de6f3863ddfc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:59:01.253503681Z [2024-05-25 23:59:01,253: INFO/ForkPoolWorker-16] [1f5ac2ce-3fa4-4038-ae38-9bce8edbad5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:59:01.261257023Z [2024-05-25 23:59:01,260: INFO/ForkPoolWorker-1] [65539ad2-36a6-4016-ad0b-d5c7df54e8a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:59:01.706322197Z [2024-05-25 23:59:01,702: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T23:59:01.715137472Z [2024-05-25 23:59:01,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T23:59:01.751921170Z [2024-05-25 23:59:01,747: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T23:59:01.887152933Z [2024-05-25 23:59:01,886: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T23:59:01.891324673Z [2024-05-25 23:59:01,890: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:59:01.959472774Z [2024-05-25 23:59:01,959: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T23:59:01.960762622Z [2024-05-25 23:59:01,960: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-25T23:59:01.961823357Z [2024-05-25 23:59:01,960: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T23:59:01.961911289Z [2024-05-25 23:59:01,961: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T23:59:01.962193758Z [2024-05-25 23:59:01,962: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-25T23:59:02.168114457Z [2024-05-25 23:59:02,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:59:02.830666380Z [2024-05-25 23:59:02,830: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[789d7c9e-0cbf-4a64-99e4-de6f3863ddfc] succeeded in 1.6069877159998214s: None 2024-05-25T23:59:03.135679905Z [2024-05-25 23:59:03,135: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T23:59:03.139188830Z [2024-05-25 23:59:03,138: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:59:03.171364076Z [2024-05-25 23:59:03,171: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T23:59:03.184367274Z [2024-05-25 23:59:03,183: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:59:03.184391280Z [2024-05-25 23:59:03,183: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:59:03.184395522Z [2024-05-25 23:59:03,183: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:59:03.184399995Z [2024-05-25 23:59:03,183: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T23:59:03.184403178Z [2024-05-25 23:59:03,184: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T23:59:03.184406323Z [2024-05-25 23:59:03,184: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:59:03.273102159Z [2024-05-25 23:59:03,272: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T23:59:03.276707175Z [2024-05-25 23:59:03,276: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T23:59:03.308479115Z [2024-05-25 23:59:03,307: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:59:03.345522924Z [2024-05-25 23:59:03,345: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T23:59:03.347330639Z [2024-05-25 23:59:03,347: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-25T23:59:03.347370406Z [2024-05-25 23:59:03,347: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-25T23:59:03.347592940Z [2024-05-25 23:59:03,347: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T23:59:03.347606005Z [2024-05-25 23:59:03,347: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T23:59:03.347980654Z [2024-05-25 23:59:03,347: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T23:59:03.348524564Z [2024-05-25 23:59:03,347: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-25T23:59:03.490119010Z [2024-05-25 23:59:03,489: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T23:59:05.579689569Z [2024-05-25 23:59:05,577: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f5ac2ce-3fa4-4038-ae38-9bce8edbad5e] succeeded in 4.346672537999439s: None 2024-05-25T23:59:05.831320537Z [2024-05-25 23:59:05,830: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[65539ad2-36a6-4016-ad0b-d5c7df54e8a5] succeeded in 4.581102381999699s: None 2024-05-26T00:00:00.398286257Z [2024-05-26 00:00:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3d4970d-af1e-4d9b-b1a3-6d2d5065ab98] received 2024-05-26T00:00:00.400048916Z [2024-05-26 00:00:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76f33aac-426f-4c96-baf9-7fd71c66a889] received 2024-05-26T00:00:00.402302475Z [2024-05-26 00:00:00,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50709644-12f5-44e9-b0b7-5686506ad800] received 2024-05-26T00:00:00.403498894Z [2024-05-26 00:00:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32e242bc-f048-4bd5-aacd-513355121da6] received 2024-05-26T00:00:00.404640893Z [2024-05-26 00:00:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f04cbff2-367e-4211-ac58-4e786f7a5b0c] received 2024-05-26T00:00:00.410556879Z [2024-05-26 00:00:00,410: INFO/ForkPoolWorker-15] [c3d4970d-af1e-4d9b-b1a3-6d2d5065ab98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:00:00.425260338Z [2024-05-26 00:00:00,424: INFO/ForkPoolWorker-1] [50709644-12f5-44e9-b0b7-5686506ad800] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:00:00.427448916Z [2024-05-26 00:00:00,427: INFO/ForkPoolWorker-16] [76f33aac-426f-4c96-baf9-7fd71c66a889] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:00:00.429127231Z [2024-05-26 00:00:00,428: INFO/ForkPoolWorker-3] [f04cbff2-367e-4211-ac58-4e786f7a5b0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:00:00.434117622Z [2024-05-26 00:00:00,433: INFO/ForkPoolWorker-2] [32e242bc-f048-4bd5-aacd-513355121da6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:00:00.752812262Z [2024-05-26 00:00:00,748: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:00:00.811923067Z [2024-05-26 00:00:00,806: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:00:00.851864474Z [2024-05-26 00:00:00,842: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:00:00.992953404Z [2024-05-26 00:00:00,988: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:00:01.271524410Z [2024-05-26 00:00:01,270: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:00:01.277236659Z [2024-05-26 00:00:01,276: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:00:01.279148337Z [2024-05-26 00:00:01,264: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:00:01.370080161Z [2024-05-26 00:00:01,369: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:00:01.371221493Z [2024-05-26 00:00:01,371: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:00:01.371541944Z [2024-05-26 00:00:01,371: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:00:01.371764700Z [2024-05-26 00:00:01,371: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:00:01.372360846Z [2024-05-26 00:00:01,372: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:00:01.510961215Z [2024-05-26 00:00:01,510: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:00:01.724385416Z [2024-05-26 00:00:01,724: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:00:02.326126658Z [2024-05-26 00:00:02,325: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[50709644-12f5-44e9-b0b7-5686506ad800] succeeded in 1.9152857900007803s: None 2024-05-26T00:00:02.636212376Z [2024-05-26 00:00:02,635: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f04cbff2-367e-4211-ac58-4e786f7a5b0c] succeeded in 2.2289372650002406s: None 2024-05-26T00:00:02.657760520Z [2024-05-26 00:00:02,654: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:00:02.665597493Z [2024-05-26 00:00:02,665: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:00:02.727495726Z [2024-05-26 00:00:02,727: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:00:02.732513616Z [2024-05-26 00:00:02,732: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:00:02.732531332Z [2024-05-26 00:00:02,732: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:00:02.732638278Z [2024-05-26 00:00:02,732: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:00:02.732666021Z [2024-05-26 00:00:02,732: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:00:02.732928948Z [2024-05-26 00:00:02,732: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:00:02.732952684Z [2024-05-26 00:00:02,732: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:00:02.910779696Z [2024-05-26 00:00:02,910: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:00:03.048639635Z [2024-05-26 00:00:03,047: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:00:03.053148864Z [2024-05-26 00:00:03,052: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:00:03.089069764Z [2024-05-26 00:00:03,088: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:00:03.091768056Z [2024-05-26 00:00:03,090: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:00:03.092207393Z [2024-05-26 00:00:03,091: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:00:03.092366268Z [2024-05-26 00:00:03,092: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:00:03.092496978Z [2024-05-26 00:00:03,092: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:00:03.092791046Z [2024-05-26 00:00:03,092: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:00:03.092813257Z [2024-05-26 00:00:03,092: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:00:03.257869035Z [2024-05-26 00:00:03,257: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:00:03.369357187Z [2024-05-26 00:00:03,368: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:00:03.386049386Z [2024-05-26 00:00:03,385: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:00:03.497223316Z [2024-05-26 00:00:03,496: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:00:03.504316648Z [2024-05-26 00:00:03,504: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:00:03.504390174Z [2024-05-26 00:00:03,504: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:00:03.512046024Z [2024-05-26 00:00:03,511: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:00:03.512198787Z [2024-05-26 00:00:03,511: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:00:03.517354682Z [2024-05-26 00:00:03,512: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:00:03.518186422Z [2024-05-26 00:00:03,517: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:00:03.830406932Z [2024-05-26 00:00:03,830: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:00:04.450961320Z [2024-05-26 00:00:04,450: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3d4970d-af1e-4d9b-b1a3-6d2d5065ab98] succeeded in 4.050562159999572s: None 2024-05-26T00:00:04.869532071Z [2024-05-26 00:00:04,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0a924d8-bc4c-4c21-aee4-aac7e55b79b9] received 2024-05-26T00:00:04.895562196Z [2024-05-26 00:00:04,893: INFO/ForkPoolWorker-15] [c0a924d8-bc4c-4c21-aee4-aac7e55b79b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:00:05.061099372Z [2024-05-26 00:00:05,060: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[76f33aac-426f-4c96-baf9-7fd71c66a889] succeeded in 4.653109980999943s: None 2024-05-26T00:00:05.357208052Z [2024-05-26 00:00:05,353: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:00:06.454027174Z [2024-05-26 00:00:06,453: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[32e242bc-f048-4bd5-aacd-513355121da6] succeeded in 6.042127865999646s: None 2024-05-26T00:00:06.729369404Z [2024-05-26 00:00:06,729: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:00:06.733630645Z [2024-05-26 00:00:06,733: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:00:06.755911916Z [2024-05-26 00:00:06,755: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:00:06.757103907Z [2024-05-26 00:00:06,756: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:00:06.757140020Z [2024-05-26 00:00:06,757: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:00:06.757234893Z [2024-05-26 00:00:06,757: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:00:06.757265767Z [2024-05-26 00:00:06,757: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:00:06.757838198Z [2024-05-26 00:00:06,757: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:00:06.757871469Z [2024-05-26 00:00:06,757: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:00:06.831868946Z [2024-05-26 00:00:06,831: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:00:07.548131754Z [2024-05-26 00:00:07,547: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0a924d8-bc4c-4c21-aee4-aac7e55b79b9] succeeded in 2.6782469510008013s: None 2024-05-26T00:00:08.381091091Z [2024-05-26 00:00:08,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dc04f9a-a887-4c9d-83bc-94a887419b8e] received 2024-05-26T00:00:08.387449928Z [2024-05-26 00:00:08,387: INFO/ForkPoolWorker-15] [5dc04f9a-a887-4c9d-83bc-94a887419b8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:00:08.720787040Z [2024-05-26 00:00:08,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:00:09.858209372Z [2024-05-26 00:00:09,857: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:00:09.861781686Z [2024-05-26 00:00:09,861: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:00:09.886568043Z [2024-05-26 00:00:09,886: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:00:09.888839761Z [2024-05-26 00:00:09,888: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:00:09.888871756Z [2024-05-26 00:00:09,888: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:00:09.889005692Z [2024-05-26 00:00:09,888: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:00:09.889035503Z [2024-05-26 00:00:09,888: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:00:09.889424758Z [2024-05-26 00:00:09,889: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:00:09.889433752Z [2024-05-26 00:00:09,889: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:00:10.021137346Z [2024-05-26 00:00:10,020: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:00:10.636223298Z [2024-05-26 00:00:10,635: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5dc04f9a-a887-4c9d-83bc-94a887419b8e] succeeded in 2.252625547000207s: None 2024-05-26T00:00:11.196563354Z [2024-05-26 00:00:11,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73152e7d-a2ae-4303-ad64-234f7ccc630e] received 2024-05-26T00:00:11.206116978Z [2024-05-26 00:00:11,205: INFO/ForkPoolWorker-15] [73152e7d-a2ae-4303-ad64-234f7ccc630e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:00:11.506938305Z [2024-05-26 00:00:11,503: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:00:12.621919854Z [2024-05-26 00:00:12,621: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:00:12.625371798Z [2024-05-26 00:00:12,624: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:00:12.653319638Z [2024-05-26 00:00:12,653: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:00:12.654904117Z [2024-05-26 00:00:12,654: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:00:12.654974137Z [2024-05-26 00:00:12,654: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:00:12.655160238Z [2024-05-26 00:00:12,654: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:00:12.655190089Z [2024-05-26 00:00:12,655: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:00:12.655537295Z [2024-05-26 00:00:12,655: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:00:12.655693633Z [2024-05-26 00:00:12,655: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:00:12.746125923Z [2024-05-26 00:00:12,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:00:13.369299067Z [2024-05-26 00:00:13,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73152e7d-a2ae-4303-ad64-234f7ccc630e] succeeded in 2.170320723000259s: None 2024-05-26T00:01:00.883410195Z [2024-05-26 00:01:00,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[337cf232-ac1b-4691-8599-59189a14649e] received 2024-05-26T00:01:00.891207400Z [2024-05-26 00:01:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6de2f70b-5231-4d51-9bb0-5e3211feaf11] received 2024-05-26T00:01:00.900269383Z [2024-05-26 00:01:00,899: INFO/ForkPoolWorker-15] [337cf232-ac1b-4691-8599-59189a14649e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:01:00.904482888Z [2024-05-26 00:01:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5f261cf-5496-4b02-98c2-c20f67d49822] received 2024-05-26T00:01:00.915249871Z [2024-05-26 00:01:00,914: INFO/ForkPoolWorker-1] [d5f261cf-5496-4b02-98c2-c20f67d49822] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:01:00.918355210Z [2024-05-26 00:01:00,918: INFO/ForkPoolWorker-16] [6de2f70b-5231-4d51-9bb0-5e3211feaf11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:01:01.202011460Z [2024-05-26 00:01:01,198: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:01:01.242731818Z [2024-05-26 00:01:01,239: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:01:01.294240903Z [2024-05-26 00:01:01,291: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:01:01.406600137Z [2024-05-26 00:01:01,406: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:01:01.410525314Z [2024-05-26 00:01:01,410: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:01:01.441991525Z [2024-05-26 00:01:01,441: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:01:01.443222503Z [2024-05-26 00:01:01,442: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:01:01.443257923Z [2024-05-26 00:01:01,443: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:01:01.443310199Z [2024-05-26 00:01:01,443: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:01:01.443478828Z [2024-05-26 00:01:01,443: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:01:01.548101242Z [2024-05-26 00:01:01,547: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:01:02.170962309Z [2024-05-26 00:01:02,170: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d5f261cf-5496-4b02-98c2-c20f67d49822] succeeded in 1.2643288139997821s: None 2024-05-26T00:01:02.360078093Z [2024-05-26 00:01:02,359: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:01:02.363424058Z [2024-05-26 00:01:02,363: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:01:02.385647829Z [2024-05-26 00:01:02,385: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:01:02.387238127Z [2024-05-26 00:01:02,386: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:01:02.387272011Z [2024-05-26 00:01:02,387: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:01:02.387570315Z [2024-05-26 00:01:02,387: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:01:02.387755182Z [2024-05-26 00:01:02,387: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:01:02.388179011Z [2024-05-26 00:01:02,387: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:01:02.388362988Z [2024-05-26 00:01:02,388: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:01:02.464048168Z [2024-05-26 00:01:02,463: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:01:02.467394940Z [2024-05-26 00:01:02,466: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:01:02.474758624Z [2024-05-26 00:01:02,474: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:01:02.505723942Z [2024-05-26 00:01:02,505: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:01:02.508837851Z [2024-05-26 00:01:02,508: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:01:02.509624289Z [2024-05-26 00:01:02,508: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:01:02.509888526Z [2024-05-26 00:01:02,509: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:01:02.510073467Z [2024-05-26 00:01:02,509: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:01:02.510569428Z [2024-05-26 00:01:02,510: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:01:02.510749587Z [2024-05-26 00:01:02,510: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:01:02.585882845Z [2024-05-26 00:01:02,585: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:01:04.284126904Z [2024-05-26 00:01:04,283: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[337cf232-ac1b-4691-8599-59189a14649e] succeeded in 3.397928953000701s: None 2024-05-26T00:01:06.523922551Z [2024-05-26 00:01:06,523: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6de2f70b-5231-4d51-9bb0-5e3211feaf11] succeeded in 5.630205066999224s: None 2024-05-26T00:02:00.239429035Z [2024-05-26 00:02:00,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd3a9175-7d97-4206-b66a-27295983064c] received 2024-05-26T00:02:00.241781993Z [2024-05-26 00:02:00,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9ddb565-9617-44c2-bdfc-a4fd216123ac] received 2024-05-26T00:02:00.251896432Z [2024-05-26 00:02:00,251: INFO/ForkPoolWorker-16] [f9ddb565-9617-44c2-bdfc-a4fd216123ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:02:00.252140377Z [2024-05-26 00:02:00,251: INFO/ForkPoolWorker-15] [cd3a9175-7d97-4206-b66a-27295983064c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:02:00.260538890Z [2024-05-26 00:02:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f35a24b-61a0-4cf0-b80b-bafc1d99609f] received 2024-05-26T00:02:00.263910813Z [2024-05-26 00:02:00,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c2000f2-6ab4-41c5-b2bc-fb12a24f8165] received 2024-05-26T00:02:00.287646890Z [2024-05-26 00:02:00,287: INFO/ForkPoolWorker-1] [2f35a24b-61a0-4cf0-b80b-bafc1d99609f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:02:00.296008463Z [2024-05-26 00:02:00,295: INFO/ForkPoolWorker-2] [4c2000f2-6ab4-41c5-b2bc-fb12a24f8165] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:02:00.635888348Z [2024-05-26 00:02:00,632: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:02:00.648493435Z [2024-05-26 00:02:00,645: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:02:00.662925848Z [2024-05-26 00:02:00,656: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:02:00.669587709Z [2024-05-26 00:02:00,665: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:02:00.828836654Z [2024-05-26 00:02:00,828: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:02:00.832598020Z [2024-05-26 00:02:00,832: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:02:00.865334498Z [2024-05-26 00:02:00,865: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:02:00.867406755Z [2024-05-26 00:02:00,867: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:02:00.867549112Z [2024-05-26 00:02:00,867: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:02:00.867684571Z [2024-05-26 00:02:00,867: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:02:00.867967736Z [2024-05-26 00:02:00,867: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:02:00.936721383Z [2024-05-26 00:02:00,936: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:02:00.995625972Z [2024-05-26 00:02:00,995: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:02:01.539652969Z [2024-05-26 00:02:01,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd3a9175-7d97-4206-b66a-27295983064c] succeeded in 1.2944481889999224s: None 2024-05-26T00:02:01.799637495Z [2024-05-26 00:02:01,799: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4c2000f2-6ab4-41c5-b2bc-fb12a24f8165] succeeded in 1.5322048040006848s: None 2024-05-26T00:02:01.898503762Z [2024-05-26 00:02:01,898: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:02:01.901996179Z [2024-05-26 00:02:01,901: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:02:01.921724141Z [2024-05-26 00:02:01,921: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:02:01.922766690Z [2024-05-26 00:02:01,922: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:02:01.922778372Z [2024-05-26 00:02:01,922: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:02:01.922895814Z [2024-05-26 00:02:01,922: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:02:01.922936698Z [2024-05-26 00:02:01,922: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:02:01.923182689Z [2024-05-26 00:02:01,923: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:02:01.923239562Z [2024-05-26 00:02:01,923: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:02:02.049865353Z [2024-05-26 00:02:02,049: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:02:02.082705129Z [2024-05-26 00:02:02,082: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:02:02.086039659Z [2024-05-26 00:02:02,085: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:02:02.115030246Z [2024-05-26 00:02:02,114: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:02:02.116994090Z [2024-05-26 00:02:02,116: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:02:02.117435146Z [2024-05-26 00:02:02,117: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:02:02.117661322Z [2024-05-26 00:02:02,117: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:02:02.117858914Z [2024-05-26 00:02:02,117: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:02:02.118228659Z [2024-05-26 00:02:02,118: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:02:02.118429373Z [2024-05-26 00:02:02,118: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:02:02.204571612Z [2024-05-26 00:02:02,204: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:02:03.650167298Z [2024-05-26 00:02:03,649: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f35a24b-61a0-4cf0-b80b-bafc1d99609f] succeeded in 3.386205740999685s: None 2024-05-26T00:02:03.915659247Z [2024-05-26 00:02:03,915: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f9ddb565-9617-44c2-bdfc-a4fd216123ac] succeeded in 3.6714935479994892s: None 2024-05-26T00:03:00.269118779Z [2024-05-26 00:03:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d98828d-2b27-4fbc-8f5c-979c501da006] received 2024-05-26T00:03:00.272557123Z [2024-05-26 00:03:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb461bf0-1f4c-4c14-807d-3836568a11d2] received 2024-05-26T00:03:00.277372725Z [2024-05-26 00:03:00,276: INFO/ForkPoolWorker-15] [0d98828d-2b27-4fbc-8f5c-979c501da006] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:03:00.284203196Z [2024-05-26 00:03:00,282: INFO/ForkPoolWorker-16] [cb461bf0-1f4c-4c14-807d-3836568a11d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:03:00.301064975Z [2024-05-26 00:03:00,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a2c24d5-4734-4dc3-b5c9-17e66f3a1721] received 2024-05-26T00:03:00.324104002Z [2024-05-26 00:03:00,323: INFO/ForkPoolWorker-1] [4a2c24d5-4734-4dc3-b5c9-17e66f3a1721] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:03:00.625420903Z [2024-05-26 00:03:00,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:03:00.735737052Z [2024-05-26 00:03:00,730: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:03:00.819291915Z [2024-05-26 00:03:00,816: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:03:00.991623620Z [2024-05-26 00:03:00,990: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:03:01.007714068Z [2024-05-26 00:03:01,005: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:03:01.039038528Z [2024-05-26 00:03:01,037: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:03:01.039303341Z [2024-05-26 00:03:01,039: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:03:01.039308463Z [2024-05-26 00:03:01,039: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:03:01.039315356Z [2024-05-26 00:03:01,039: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:03:01.040071021Z [2024-05-26 00:03:01,039: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:03:01.152133492Z [2024-05-26 00:03:01,150: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:03:01.859349679Z [2024-05-26 00:03:01,859: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb461bf0-1f4c-4c14-807d-3836568a11d2] succeeded in 1.584320994999871s: None 2024-05-26T00:03:02.184535407Z [2024-05-26 00:03:02,184: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:03:02.189197757Z [2024-05-26 00:03:02,187: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:03:02.227671887Z [2024-05-26 00:03:02,226: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:03:02.229890219Z [2024-05-26 00:03:02,229: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:03:02.229903776Z [2024-05-26 00:03:02,229: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:03:02.230024814Z [2024-05-26 00:03:02,229: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:03:02.230069782Z [2024-05-26 00:03:02,229: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:03:02.230275040Z [2024-05-26 00:03:02,230: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:03:02.230328702Z [2024-05-26 00:03:02,230: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:03:02.305644844Z [2024-05-26 00:03:02,305: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:03:02.306356409Z [2024-05-26 00:03:02,306: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:03:02.308790894Z [2024-05-26 00:03:02,308: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:03:02.343659056Z [2024-05-26 00:03:02,342: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:03:02.352642976Z [2024-05-26 00:03:02,352: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:03:02.352666542Z [2024-05-26 00:03:02,352: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:03:02.352751547Z [2024-05-26 00:03:02,352: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:03:02.352773865Z [2024-05-26 00:03:02,352: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:03:02.354890425Z [2024-05-26 00:03:02,353: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:03:02.354911431Z [2024-05-26 00:03:02,353: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:03:02.455648444Z [2024-05-26 00:03:02,452: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:03:03.875604547Z [2024-05-26 00:03:03,874: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d98828d-2b27-4fbc-8f5c-979c501da006] succeeded in 3.6037187850006376s: None 2024-05-26T00:03:04.416106140Z [2024-05-26 00:03:04,414: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a2c24d5-4734-4dc3-b5c9-17e66f3a1721] succeeded in 4.0974478540001655s: None 2024-05-26T00:04:00.436238900Z [2024-05-26 00:04:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d514db84-9898-42d7-8c64-362b53784a8b] received 2024-05-26T00:04:00.446486988Z [2024-05-26 00:04:00,446: INFO/ForkPoolWorker-15] [d514db84-9898-42d7-8c64-362b53784a8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:04:00.449254951Z [2024-05-26 00:04:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[147b683a-0efc-4a8f-87b1-3e717bae6519] received 2024-05-26T00:04:00.453160830Z [2024-05-26 00:04:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6c1b0c6-fee3-4547-b23d-eb5276bc9e42] received 2024-05-26T00:04:00.455300914Z [2024-05-26 00:04:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8442353d-eea0-4f43-ac41-c63dd38fd25a] received 2024-05-26T00:04:00.473572532Z [2024-05-26 00:04:00,473: INFO/ForkPoolWorker-2] [8442353d-eea0-4f43-ac41-c63dd38fd25a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:04:00.484197563Z [2024-05-26 00:04:00,483: INFO/ForkPoolWorker-16] [147b683a-0efc-4a8f-87b1-3e717bae6519] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:04:00.485076855Z [2024-05-26 00:04:00,484: INFO/ForkPoolWorker-1] [f6c1b0c6-fee3-4547-b23d-eb5276bc9e42] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:04:00.821830278Z [2024-05-26 00:04:00,811: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:04:00.914142302Z [2024-05-26 00:04:00,910: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:04:00.968467931Z [2024-05-26 00:04:00,965: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:04:00.997297443Z [2024-05-26 00:04:00,993: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:04:01.116567430Z [2024-05-26 00:04:01,116: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:04:01.121034921Z [2024-05-26 00:04:01,120: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:04:01.163476493Z [2024-05-26 00:04:01,163: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:04:01.166306017Z [2024-05-26 00:04:01,166: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:04:01.166933990Z [2024-05-26 00:04:01,166: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:04:01.167097645Z [2024-05-26 00:04:01,166: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:04:01.167385935Z [2024-05-26 00:04:01,167: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:04:01.255012726Z [2024-05-26 00:04:01,254: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:04:01.350170422Z [2024-05-26 00:04:01,349: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:04:01.979489939Z [2024-05-26 00:04:01,979: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f6c1b0c6-fee3-4547-b23d-eb5276bc9e42] succeeded in 1.512020537999888s: None 2024-05-26T00:04:01.997624901Z [2024-05-26 00:04:01,997: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[147b683a-0efc-4a8f-87b1-3e717bae6519] succeeded in 1.5419238849999601s: None 2024-05-26T00:04:02.244659275Z [2024-05-26 00:04:02,244: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:04:02.247817474Z [2024-05-26 00:04:02,247: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:04:02.278949965Z [2024-05-26 00:04:02,278: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:04:02.280223320Z [2024-05-26 00:04:02,279: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:04:02.280274532Z [2024-05-26 00:04:02,280: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:04:02.280329065Z [2024-05-26 00:04:02,280: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:04:02.280341494Z [2024-05-26 00:04:02,280: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:04:02.280584761Z [2024-05-26 00:04:02,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:04:02.280601326Z [2024-05-26 00:04:02,280: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:04:02.314018028Z [2024-05-26 00:04:02,313: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:04:02.317699183Z [2024-05-26 00:04:02,317: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:04:02.345605712Z [2024-05-26 00:04:02,345: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:04:02.346674723Z [2024-05-26 00:04:02,346: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:04:02.346686479Z [2024-05-26 00:04:02,346: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:04:02.346887409Z [2024-05-26 00:04:02,346: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:04:02.346935508Z [2024-05-26 00:04:02,346: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:04:02.347301932Z [2024-05-26 00:04:02,347: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:04:02.347377692Z [2024-05-26 00:04:02,347: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:04:02.370707217Z [2024-05-26 00:04:02,370: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:04:02.426570924Z [2024-05-26 00:04:02,426: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:04:03.933954663Z [2024-05-26 00:04:03,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d514db84-9898-42d7-8c64-362b53784a8b] succeeded in 3.494518331999643s: None 2024-05-26T00:04:04.257339742Z [2024-05-26 00:04:04,256: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8442353d-eea0-4f43-ac41-c63dd38fd25a] succeeded in 3.799118912999802s: None 2024-05-26T00:05:01.316444193Z [2024-05-26 00:05:01,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56b73b42-fd92-4fbd-97f8-58f79a61aae3] received 2024-05-26T00:05:01.322575884Z [2024-05-26 00:05:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a69d8f4a-5682-4788-a7de-b97a47f5b21f] received 2024-05-26T00:05:01.326259632Z [2024-05-26 00:05:01,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b87d0e75-a134-4051-9b6a-9ad0a9c690eb] received 2024-05-26T00:05:01.331224904Z [2024-05-26 00:05:01,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8500503-10ad-45e9-8be5-94ebcb7b7d50] received 2024-05-26T00:05:01.364468337Z [2024-05-26 00:05:01,364: INFO/ForkPoolWorker-2] [b8500503-10ad-45e9-8be5-94ebcb7b7d50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:05:01.364910043Z [2024-05-26 00:05:01,364: INFO/ForkPoolWorker-15] [56b73b42-fd92-4fbd-97f8-58f79a61aae3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:05:01.365099826Z [2024-05-26 00:05:01,359: INFO/ForkPoolWorker-1] [b87d0e75-a134-4051-9b6a-9ad0a9c690eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:05:01.380611577Z [2024-05-26 00:05:01,380: INFO/ForkPoolWorker-16] [a69d8f4a-5682-4788-a7de-b97a47f5b21f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:05:01.721317348Z [2024-05-26 00:05:01,714: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:05:01.818247471Z [2024-05-26 00:05:01,813: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:05:01.977032307Z [2024-05-26 00:05:01,976: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:05:01.980899812Z [2024-05-26 00:05:01,980: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:05:02.010035223Z [2024-05-26 00:05:02,009: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:05:02.012358815Z [2024-05-26 00:05:02,012: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:05:02.012527106Z [2024-05-26 00:05:02,012: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:05:02.013266399Z [2024-05-26 00:05:02,012: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:05:02.013542753Z [2024-05-26 00:05:02,013: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:05:02.102089762Z [2024-05-26 00:05:02,101: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:05:02.110174648Z [2024-05-26 00:05:02,107: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:05:02.164524923Z [2024-05-26 00:05:02,156: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:05:02.722968175Z [2024-05-26 00:05:02,722: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b87d0e75-a134-4051-9b6a-9ad0a9c690eb] succeeded in 1.388578506000158s: None 2024-05-26T00:05:03.220512795Z [2024-05-26 00:05:03,219: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:05:03.223566472Z [2024-05-26 00:05:03,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:05:03.241858928Z [2024-05-26 00:05:03,241: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:05:03.243291746Z [2024-05-26 00:05:03,243: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:05:03.243362918Z [2024-05-26 00:05:03,243: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:05:03.243683254Z [2024-05-26 00:05:03,243: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:05:03.243734522Z [2024-05-26 00:05:03,243: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:05:03.244154225Z [2024-05-26 00:05:03,244: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:05:03.244213684Z [2024-05-26 00:05:03,244: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:05:03.332064758Z [2024-05-26 00:05:03,331: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:05:03.399661571Z [2024-05-26 00:05:03,397: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:05:03.407583680Z [2024-05-26 00:05:03,405: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:05:03.432191105Z [2024-05-26 00:05:03,431: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:05:03.433601228Z [2024-05-26 00:05:03,433: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:05:03.434070957Z [2024-05-26 00:05:03,433: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:05:03.434689088Z [2024-05-26 00:05:03,434: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:05:03.434695448Z [2024-05-26 00:05:03,434: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:05:03.434698895Z [2024-05-26 00:05:03,434: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:05:03.434702028Z [2024-05-26 00:05:03,434: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:05:03.575378847Z [2024-05-26 00:05:03,575: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:05:03.785644975Z [2024-05-26 00:05:03,785: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:05:03.789700971Z [2024-05-26 00:05:03,789: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:05:03.839027610Z [2024-05-26 00:05:03,838: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:05:03.840526010Z [2024-05-26 00:05:03,840: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:05:03.840606908Z [2024-05-26 00:05:03,840: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:05:03.840829250Z [2024-05-26 00:05:03,840: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:05:03.840921143Z [2024-05-26 00:05:03,840: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:05:03.841204369Z [2024-05-26 00:05:03,841: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:05:03.841298381Z [2024-05-26 00:05:03,841: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:05:03.993217023Z [2024-05-26 00:05:03,992: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:05:04.860138899Z [2024-05-26 00:05:04,856: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a69d8f4a-5682-4788-a7de-b97a47f5b21f] succeeded in 3.518812219999745s: None 2024-05-26T00:05:05.065986644Z [2024-05-26 00:05:05,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56b73b42-fd92-4fbd-97f8-58f79a61aae3] succeeded in 3.738347149999754s: None 2024-05-26T00:05:05.477980884Z [2024-05-26 00:05:05,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44e9183e-cd8e-499a-b7aa-6dfa856d505a] received 2024-05-26T00:05:05.497477226Z [2024-05-26 00:05:05,497: INFO/ForkPoolWorker-15] [44e9183e-cd8e-499a-b7aa-6dfa856d505a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:05:05.905310874Z [2024-05-26 00:05:05,904: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b8500503-10ad-45e9-8be5-94ebcb7b7d50] succeeded in 4.567879406999964s: None 2024-05-26T00:05:05.954616325Z [2024-05-26 00:05:05,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:05:07.076739039Z [2024-05-26 00:05:07,076: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:05:07.079946885Z [2024-05-26 00:05:07,079: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:05:07.110723147Z [2024-05-26 00:05:07,110: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:05:07.111944441Z [2024-05-26 00:05:07,111: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:05:07.112035216Z [2024-05-26 00:05:07,111: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:05:07.112064279Z [2024-05-26 00:05:07,111: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:05:07.112081203Z [2024-05-26 00:05:07,111: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:05:07.112307622Z [2024-05-26 00:05:07,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:05:07.112320593Z [2024-05-26 00:05:07,112: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:05:07.188629265Z [2024-05-26 00:05:07,188: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:05:07.876442652Z [2024-05-26 00:05:07,875: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44e9183e-cd8e-499a-b7aa-6dfa856d505a] succeeded in 2.3960117400001764s: None 2024-05-26T00:05:08.160354016Z [2024-05-26 00:05:08,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b08771d5-9244-4aa3-81ce-0b7047a68eab] received 2024-05-26T00:05:08.178883635Z [2024-05-26 00:05:08,178: INFO/ForkPoolWorker-15] [b08771d5-9244-4aa3-81ce-0b7047a68eab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:05:08.474681955Z [2024-05-26 00:05:08,471: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:05:09.559013259Z [2024-05-26 00:05:09,558: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:05:09.562243822Z [2024-05-26 00:05:09,561: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:05:09.578983797Z [2024-05-26 00:05:09,578: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:05:09.580326993Z [2024-05-26 00:05:09,580: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:05:09.580339673Z [2024-05-26 00:05:09,580: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:05:09.580480741Z [2024-05-26 00:05:09,580: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:05:09.580485784Z [2024-05-26 00:05:09,580: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:05:09.580728098Z [2024-05-26 00:05:09,580: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:05:09.580737104Z [2024-05-26 00:05:09,580: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:05:09.649534646Z [2024-05-26 00:05:09,648: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:05:10.284311319Z [2024-05-26 00:05:10,283: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b08771d5-9244-4aa3-81ce-0b7047a68eab] succeeded in 2.1208605210003952s: None 2024-05-26T00:05:10.530344755Z [2024-05-26 00:05:10,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[256edc25-9260-4d20-b80a-703bc39f860f] received 2024-05-26T00:05:10.541467222Z [2024-05-26 00:05:10,541: INFO/ForkPoolWorker-15] [256edc25-9260-4d20-b80a-703bc39f860f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:05:10.810855111Z [2024-05-26 00:05:10,807: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:05:12.015290911Z [2024-05-26 00:05:12,014: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:05:12.018868653Z [2024-05-26 00:05:12,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:05:12.044371132Z [2024-05-26 00:05:12,043: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:05:12.047267255Z [2024-05-26 00:05:12,046: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:05:12.047721347Z [2024-05-26 00:05:12,047: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:05:12.048303378Z [2024-05-26 00:05:12,047: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:05:12.048728618Z [2024-05-26 00:05:12,048: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:05:12.049213179Z [2024-05-26 00:05:12,048: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:05:12.050012195Z [2024-05-26 00:05:12,049: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:05:12.170017347Z [2024-05-26 00:05:12,169: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:05:12.772615555Z [2024-05-26 00:05:12,772: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[256edc25-9260-4d20-b80a-703bc39f860f] succeeded in 2.2395993350000936s: None 2024-05-26T00:06:01.325960379Z [2024-05-26 00:06:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9b03edf-4902-48ca-ae2a-d206581451e9] received 2024-05-26T00:06:01.330225184Z [2024-05-26 00:06:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf601ea1-d965-4d23-b39d-61fac0c94029] received 2024-05-26T00:06:01.332487935Z [2024-05-26 00:06:01,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cc29e49-2d1e-4239-8f26-f0c1ff8faba2] received 2024-05-26T00:06:01.334348245Z [2024-05-26 00:06:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30604d7d-0045-46fe-b164-15843ae5bb0f] received 2024-05-26T00:06:01.362306198Z [2024-05-26 00:06:01,361: INFO/ForkPoolWorker-2] [30604d7d-0045-46fe-b164-15843ae5bb0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:06:01.363917275Z [2024-05-26 00:06:01,363: INFO/ForkPoolWorker-1] [3cc29e49-2d1e-4239-8f26-f0c1ff8faba2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:06:01.364191723Z [2024-05-26 00:06:01,363: INFO/ForkPoolWorker-15] [e9b03edf-4902-48ca-ae2a-d206581451e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:06:01.370345434Z [2024-05-26 00:06:01,369: INFO/ForkPoolWorker-16] [cf601ea1-d965-4d23-b39d-61fac0c94029] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:06:01.676680038Z [2024-05-26 00:06:01,672: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:06:01.701770617Z [2024-05-26 00:06:01,698: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:06:01.711247922Z [2024-05-26 00:06:01,704: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:06:01.751890281Z [2024-05-26 00:06:01,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:06:01.880587456Z [2024-05-26 00:06:01,880: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:06:01.884864665Z [2024-05-26 00:06:01,884: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:06:01.929206265Z [2024-05-26 00:06:01,928: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:06:01.932373400Z [2024-05-26 00:06:01,932: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:06:01.932550733Z [2024-05-26 00:06:01,932: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:06:01.932651604Z [2024-05-26 00:06:01,932: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:06:01.933182757Z [2024-05-26 00:06:01,933: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:06:02.063690144Z [2024-05-26 00:06:02,063: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:06:02.086372597Z [2024-05-26 00:06:02,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:06:02.623270021Z [2024-05-26 00:06:02,622: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9b03edf-4902-48ca-ae2a-d206581451e9] succeeded in 1.295157554999605s: None 2024-05-26T00:06:02.642037014Z [2024-05-26 00:06:02,641: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3cc29e49-2d1e-4239-8f26-f0c1ff8faba2] succeeded in 1.2967508269994141s: None 2024-05-26T00:06:02.994370595Z [2024-05-26 00:06:02,994: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:06:02.997810369Z [2024-05-26 00:06:02,997: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:06:03.016804832Z [2024-05-26 00:06:03,016: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:06:03.018021366Z [2024-05-26 00:06:03,017: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:06:03.018141921Z [2024-05-26 00:06:03,018: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:06:03.018312883Z [2024-05-26 00:06:03,018: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:06:03.018408469Z [2024-05-26 00:06:03,018: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:06:03.019022972Z [2024-05-26 00:06:03,018: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:06:03.019146859Z [2024-05-26 00:06:03,019: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:06:03.056832113Z [2024-05-26 00:06:03,056: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:06:03.060368907Z [2024-05-26 00:06:03,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:06:03.079721218Z [2024-05-26 00:06:03,079: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:06:03.083906186Z [2024-05-26 00:06:03,083: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:06:03.084070797Z [2024-05-26 00:06:03,083: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:06:03.084287988Z [2024-05-26 00:06:03,084: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:06:03.084437152Z [2024-05-26 00:06:03,084: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:06:03.084852657Z [2024-05-26 00:06:03,084: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:06:03.085001645Z [2024-05-26 00:06:03,084: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:06:03.108686905Z [2024-05-26 00:06:03,108: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:06:03.194919266Z [2024-05-26 00:06:03,194: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:06:04.930123958Z [2024-05-26 00:06:04,929: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cf601ea1-d965-4d23-b39d-61fac0c94029] succeeded in 3.5960309940001025s: None 2024-05-26T00:06:05.343193195Z [2024-05-26 00:06:05,342: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[30604d7d-0045-46fe-b164-15843ae5bb0f] succeeded in 4.005300568999701s: None 2024-05-26T00:07:01.220715601Z [2024-05-26 00:07:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63087593-5ea1-4783-a82c-6a0cc83daddb] received 2024-05-26T00:07:01.222914621Z [2024-05-26 00:07:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99ab1328-7f07-479e-8a9e-57d9caceb833] received 2024-05-26T00:07:01.231400231Z [2024-05-26 00:07:01,231: INFO/ForkPoolWorker-16] [99ab1328-7f07-479e-8a9e-57d9caceb833] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:07:01.231437448Z [2024-05-26 00:07:01,231: INFO/ForkPoolWorker-15] [63087593-5ea1-4783-a82c-6a0cc83daddb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:07:01.233560603Z [2024-05-26 00:07:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20071108-2c9c-4d48-9e34-3405e46fd6eb] received 2024-05-26T00:07:01.243038407Z [2024-05-26 00:07:01,242: INFO/ForkPoolWorker-1] [20071108-2c9c-4d48-9e34-3405e46fd6eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:07:01.603060026Z [2024-05-26 00:07:01,599: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:07:01.608446170Z [2024-05-26 00:07:01,605: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:07:01.617433149Z [2024-05-26 00:07:01,614: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:07:01.753780033Z [2024-05-26 00:07:01,753: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:07:01.757701074Z [2024-05-26 00:07:01,757: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:07:01.784401808Z [2024-05-26 00:07:01,784: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:07:01.785290966Z [2024-05-26 00:07:01,785: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:07:01.785357722Z [2024-05-26 00:07:01,785: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:07:01.785380180Z [2024-05-26 00:07:01,785: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:07:01.785597711Z [2024-05-26 00:07:01,785: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:07:01.895561223Z [2024-05-26 00:07:01,895: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:07:02.596725435Z [2024-05-26 00:07:02,596: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20071108-2c9c-4d48-9e34-3405e46fd6eb] succeeded in 1.361147577000338s: None 2024-05-26T00:07:02.823318094Z [2024-05-26 00:07:02,822: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:07:02.826695716Z [2024-05-26 00:07:02,826: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:07:02.843242526Z [2024-05-26 00:07:02,842: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:07:02.847294408Z [2024-05-26 00:07:02,846: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:07:02.848578870Z [2024-05-26 00:07:02,848: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:07:02.850140242Z [2024-05-26 00:07:02,849: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:07:02.850156300Z [2024-05-26 00:07:02,849: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:07:02.850339790Z [2024-05-26 00:07:02,850: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:07:02.850504251Z [2024-05-26 00:07:02,850: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:07:02.850798962Z [2024-05-26 00:07:02,850: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:07:02.850894062Z [2024-05-26 00:07:02,850: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:07:02.884228302Z [2024-05-26 00:07:02,883: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:07:02.885805724Z [2024-05-26 00:07:02,885: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:07:02.885859825Z [2024-05-26 00:07:02,885: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:07:02.886054029Z [2024-05-26 00:07:02,885: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:07:02.886082003Z [2024-05-26 00:07:02,886: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:07:02.886374928Z [2024-05-26 00:07:02,886: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:07:02.886416326Z [2024-05-26 00:07:02,886: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:07:02.941995871Z [2024-05-26 00:07:02,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:07:02.975605865Z [2024-05-26 00:07:02,975: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:07:04.908043903Z [2024-05-26 00:07:04,907: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[99ab1328-7f07-479e-8a9e-57d9caceb833] succeeded in 3.6826497949996337s: None 2024-05-26T00:07:05.465814979Z [2024-05-26 00:07:05,465: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63087593-5ea1-4783-a82c-6a0cc83daddb] succeeded in 4.242995320999398s: None 2024-05-26T00:08:01.180252831Z [2024-05-26 00:08:01,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cbdc08c-e7d5-4b70-8935-805a1a6a116f] received 2024-05-26T00:08:01.185194270Z [2024-05-26 00:08:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[221b4571-0459-42f6-8327-da6d56747d68] received 2024-05-26T00:08:01.188328287Z [2024-05-26 00:08:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f71dd429-78a4-4bb0-9285-c1ce7b96785d] received 2024-05-26T00:08:01.189782112Z [2024-05-26 00:08:01,189: INFO/ForkPoolWorker-15] [7cbdc08c-e7d5-4b70-8935-805a1a6a116f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:08:01.191856237Z [2024-05-26 00:08:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f39fadeb-e360-44f7-acb7-c637e69e5853] received 2024-05-26T00:08:01.207014805Z [2024-05-26 00:08:01,206: INFO/ForkPoolWorker-2] [f39fadeb-e360-44f7-acb7-c637e69e5853] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:08:01.207601764Z [2024-05-26 00:08:01,207: INFO/ForkPoolWorker-1] [f71dd429-78a4-4bb0-9285-c1ce7b96785d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:08:01.215513727Z [2024-05-26 00:08:01,215: INFO/ForkPoolWorker-16] [221b4571-0459-42f6-8327-da6d56747d68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:08:01.540652045Z [2024-05-26 00:08:01,536: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:08:01.561529799Z [2024-05-26 00:08:01,558: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:08:01.573562368Z [2024-05-26 00:08:01,570: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:08:01.593415128Z [2024-05-26 00:08:01,589: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:08:01.812776083Z [2024-05-26 00:08:01,812: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:08:01.817167959Z [2024-05-26 00:08:01,816: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:08:01.847704058Z [2024-05-26 00:08:01,847: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:08:01.848715965Z [2024-05-26 00:08:01,848: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:08:01.848920307Z [2024-05-26 00:08:01,848: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:08:01.849022695Z [2024-05-26 00:08:01,848: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:08:01.849268623Z [2024-05-26 00:08:01,849: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:08:01.930381445Z [2024-05-26 00:08:01,930: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:08:01.946906042Z [2024-05-26 00:08:01,946: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:08:02.544123585Z [2024-05-26 00:08:02,543: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f39fadeb-e360-44f7-acb7-c637e69e5853] succeeded in 1.349564702999487s: None 2024-05-26T00:08:02.709175685Z [2024-05-26 00:08:02,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7cbdc08c-e7d5-4b70-8935-805a1a6a116f] succeeded in 1.5264738579999175s: None 2024-05-26T00:08:02.906126697Z [2024-05-26 00:08:02,905: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:08:02.911331056Z [2024-05-26 00:08:02,910: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:08:02.968257669Z [2024-05-26 00:08:02,967: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:08:02.972978774Z [2024-05-26 00:08:02,972: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:08:02.977646007Z [2024-05-26 00:08:02,972: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:08:02.977950069Z [2024-05-26 00:08:02,977: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:08:02.978283804Z [2024-05-26 00:08:02,978: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:08:02.978725435Z [2024-05-26 00:08:02,978: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:08:02.980377749Z [2024-05-26 00:08:02,980: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:08:03.042003829Z [2024-05-26 00:08:03,041: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:08:03.045536447Z [2024-05-26 00:08:03,045: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:08:03.062531440Z [2024-05-26 00:08:03,062: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:08:03.063592210Z [2024-05-26 00:08:03,063: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:08:03.063632477Z [2024-05-26 00:08:03,063: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:08:03.063771313Z [2024-05-26 00:08:03,063: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:08:03.063780651Z [2024-05-26 00:08:03,063: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:08:03.064046841Z [2024-05-26 00:08:03,063: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:08:03.064073262Z [2024-05-26 00:08:03,063: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:08:03.125562149Z [2024-05-26 00:08:03,123: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:08:03.179686155Z [2024-05-26 00:08:03,179: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:08:05.186554792Z [2024-05-26 00:08:05,186: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f71dd429-78a4-4bb0-9285-c1ce7b96785d] succeeded in 3.991773275000014s: None 2024-05-26T00:08:05.709613000Z [2024-05-26 00:08:05,709: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[221b4571-0459-42f6-8327-da6d56747d68] succeeded in 4.52008046499941s: None 2024-05-26T00:09:01.040210686Z [2024-05-26 00:09:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9321be0-d7a5-49cc-a7fd-72095997ab8c] received 2024-05-26T00:09:01.044300584Z [2024-05-26 00:09:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fa2e973-8218-4147-afa4-8c46f8837d04] received 2024-05-26T00:09:01.051016387Z [2024-05-26 00:09:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b300906-50a5-4406-99ed-40817c39ed40] received 2024-05-26T00:09:01.059577997Z [2024-05-26 00:09:01,059: INFO/ForkPoolWorker-16] [2fa2e973-8218-4147-afa4-8c46f8837d04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:09:01.060933993Z [2024-05-26 00:09:01,060: INFO/ForkPoolWorker-1] [0b300906-50a5-4406-99ed-40817c39ed40] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:09:01.061879907Z [2024-05-26 00:09:01,061: INFO/ForkPoolWorker-15] [e9321be0-d7a5-49cc-a7fd-72095997ab8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:09:01.384523773Z [2024-05-26 00:09:01,381: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:09:01.435965951Z [2024-05-26 00:09:01,432: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:09:01.449978607Z [2024-05-26 00:09:01,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:09:01.584094387Z [2024-05-26 00:09:01,583: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:09:01.590822289Z [2024-05-26 00:09:01,590: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:09:01.625547117Z [2024-05-26 00:09:01,625: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:09:01.627107447Z [2024-05-26 00:09:01,626: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:09:01.627377247Z [2024-05-26 00:09:01,627: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:09:01.627471924Z [2024-05-26 00:09:01,627: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:09:01.630554980Z [2024-05-26 00:09:01,630: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:09:01.796600679Z [2024-05-26 00:09:01,796: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:09:02.575577532Z [2024-05-26 00:09:02,575: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b300906-50a5-4406-99ed-40817c39ed40] succeeded in 1.5228200299998207s: None 2024-05-26T00:09:02.970952947Z [2024-05-26 00:09:02,970: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:09:02.974565258Z [2024-05-26 00:09:02,974: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:09:03.005985898Z [2024-05-26 00:09:03,005: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:09:03.009544043Z [2024-05-26 00:09:03,009: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:09:03.009741132Z [2024-05-26 00:09:03,009: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:09:03.009948524Z [2024-05-26 00:09:03,009: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:09:03.010091347Z [2024-05-26 00:09:03,009: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:09:03.010519066Z [2024-05-26 00:09:03,010: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:09:03.010650226Z [2024-05-26 00:09:03,010: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:09:03.026002953Z [2024-05-26 00:09:03,025: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:09:03.029765229Z [2024-05-26 00:09:03,029: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:09:03.061943443Z [2024-05-26 00:09:03,061: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:09:03.063115254Z [2024-05-26 00:09:03,062: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:09:03.063235035Z [2024-05-26 00:09:03,063: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:09:03.063412929Z [2024-05-26 00:09:03,063: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:09:03.063510932Z [2024-05-26 00:09:03,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:09:03.063858612Z [2024-05-26 00:09:03,063: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:09:03.063977097Z [2024-05-26 00:09:03,063: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:09:03.163662399Z [2024-05-26 00:09:03,159: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:09:03.164752733Z [2024-05-26 00:09:03,164: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:09:05.002608588Z [2024-05-26 00:09:05,002: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2fa2e973-8218-4147-afa4-8c46f8837d04] succeeded in 3.954723952999302s: None 2024-05-26T00:09:05.425887314Z [2024-05-26 00:09:05,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9321be0-d7a5-49cc-a7fd-72095997ab8c] succeeded in 4.379741333000311s: None 2024-05-26T00:10:00.352405756Z [2024-05-26 00:10:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a280272b-20f6-49f6-878e-c783427a689c] received 2024-05-26T00:10:00.354649202Z [2024-05-26 00:10:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d7b32ed-d368-40f7-9b57-a0c7dfcf25c3] received 2024-05-26T00:10:00.358850627Z [2024-05-26 00:10:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee669c3f-9928-4f5d-8831-5b862ed87e6c] received 2024-05-26T00:10:00.360682581Z [2024-05-26 00:10:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11105724-459c-410a-97b3-a6c13780a558] received 2024-05-26T00:10:00.362667852Z [2024-05-26 00:10:00,362: INFO/ForkPoolWorker-15] [a280272b-20f6-49f6-878e-c783427a689c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:10:00.370089299Z [2024-05-26 00:10:00,369: INFO/ForkPoolWorker-16] [5d7b32ed-d368-40f7-9b57-a0c7dfcf25c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:10:00.372042031Z [2024-05-26 00:10:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2b1519c-82fd-4de5-8c68-e65a3370d729] received 2024-05-26T00:10:00.374477292Z [2024-05-26 00:10:00,374: INFO/ForkPoolWorker-2] [11105724-459c-410a-97b3-a6c13780a558] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:10:00.374655223Z [2024-05-26 00:10:00,372: INFO/ForkPoolWorker-1] [ee669c3f-9928-4f5d-8831-5b862ed87e6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:10:00.389086959Z [2024-05-26 00:10:00,388: INFO/ForkPoolWorker-3] [e2b1519c-82fd-4de5-8c68-e65a3370d729] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:10:00.693601123Z [2024-05-26 00:10:00,688: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:10:00.717308884Z [2024-05-26 00:10:00,711: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:10:00.772295078Z [2024-05-26 00:10:00,768: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:10:00.923564749Z [2024-05-26 00:10:00,923: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-26T00:10:00.927584150Z [2024-05-26 00:10:00,927: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:10:00.953508455Z [2024-05-26 00:10:00,953: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T00:10:00.955621920Z [2024-05-26 00:10:00,955: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:10:00.957500208Z [2024-05-26 00:10:00,955: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:10:00.957732112Z [2024-05-26 00:10:00,957: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-26T00:10:00.958997512Z [2024-05-26 00:10:00,958: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:10:01.070101248Z [2024-05-26 00:10:01,069: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:10:01.089258061Z [2024-05-26 00:10:01,089: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:10:01.126362460Z [2024-05-26 00:10:01,122: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:10:01.138733569Z [2024-05-26 00:10:01,128: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:10:01.694661708Z [2024-05-26 00:10:01,694: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ee669c3f-9928-4f5d-8831-5b862ed87e6c] succeeded in 1.333421542999531s: None 2024-05-26T00:10:01.729274945Z [2024-05-26 00:10:01,728: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e2b1519c-82fd-4de5-8c68-e65a3370d729] succeeded in 1.3513536709997425s: None 2024-05-26T00:10:02.230708749Z [2024-05-26 00:10:02,230: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:10:02.234167455Z [2024-05-26 00:10:02,233: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:10:02.255376920Z [2024-05-26 00:10:02,255: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:10:02.256880986Z [2024-05-26 00:10:02,256: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:10:02.257068349Z [2024-05-26 00:10:02,256: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:10:02.257752261Z [2024-05-26 00:10:02,257: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:10:02.258045819Z [2024-05-26 00:10:02,257: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:10:02.260738260Z [2024-05-26 00:10:02,260: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:10:02.260928630Z [2024-05-26 00:10:02,260: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:10:02.343509168Z [2024-05-26 00:10:02,343: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:10:02.399264027Z [2024-05-26 00:10:02,398: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:10:02.403289877Z [2024-05-26 00:10:02,402: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:10:02.433171372Z [2024-05-26 00:10:02,432: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:10:02.436590749Z [2024-05-26 00:10:02,436: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:10:02.436811184Z [2024-05-26 00:10:02,436: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:10:02.437035732Z [2024-05-26 00:10:02,436: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:10:02.437126666Z [2024-05-26 00:10:02,436: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:10:02.437529502Z [2024-05-26 00:10:02,437: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:10:02.437640390Z [2024-05-26 00:10:02,437: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:10:02.528482674Z [2024-05-26 00:10:02,528: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:10:02.627113967Z [2024-05-26 00:10:02,626: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:10:02.630529090Z [2024-05-26 00:10:02,630: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:10:02.653782288Z [2024-05-26 00:10:02,653: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:10:02.655296220Z [2024-05-26 00:10:02,655: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:10:02.655460997Z [2024-05-26 00:10:02,655: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:10:02.655779151Z [2024-05-26 00:10:02,655: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:10:02.655965330Z [2024-05-26 00:10:02,655: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:10:02.656287680Z [2024-05-26 00:10:02,656: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:10:02.656798583Z [2024-05-26 00:10:02,656: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:10:02.736800816Z [2024-05-26 00:10:02,736: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:10:03.377657210Z [2024-05-26 00:10:03,377: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a280272b-20f6-49f6-878e-c783427a689c] succeeded in 3.021719387000303s: None 2024-05-26T00:10:03.463620217Z [2024-05-26 00:10:03,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8febe860-420c-42f1-a509-fb875d4ab828] received 2024-05-26T00:10:03.464750050Z [2024-05-26 00:10:03,464: INFO/ForkPoolWorker-15] [8febe860-420c-42f1-a509-fb875d4ab828] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:10:03.730618962Z [2024-05-26 00:10:03,727: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:10:04.014475471Z [2024-05-26 00:10:04,013: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[11105724-459c-410a-97b3-a6c13780a558] succeeded in 3.6512464329998693s: None 2024-05-26T00:10:04.337809221Z [2024-05-26 00:10:04,337: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d7b32ed-d368-40f7-9b57-a0c7dfcf25c3] succeeded in 3.9815322769991326s: None 2024-05-26T00:10:05.097929532Z [2024-05-26 00:10:05,097: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:10:05.101210594Z [2024-05-26 00:10:05,100: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:10:05.129380320Z [2024-05-26 00:10:05,129: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:10:05.130844359Z [2024-05-26 00:10:05,130: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:10:05.130877384Z [2024-05-26 00:10:05,130: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:10:05.131034812Z [2024-05-26 00:10:05,130: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:10:05.131075900Z [2024-05-26 00:10:05,131: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:10:05.131343802Z [2024-05-26 00:10:05,131: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:10:05.131406317Z [2024-05-26 00:10:05,131: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:10:05.216250838Z [2024-05-26 00:10:05,216: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:10:05.920776826Z [2024-05-26 00:10:05,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8febe860-420c-42f1-a509-fb875d4ab828] succeeded in 2.4600170849998904s: None 2024-05-26T00:10:06.732225702Z [2024-05-26 00:10:06,731: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd3a72d0-1ddf-4f1a-b896-62c11314960f] received 2024-05-26T00:10:06.746532147Z [2024-05-26 00:10:06,746: INFO/ForkPoolWorker-15] [dd3a72d0-1ddf-4f1a-b896-62c11314960f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:10:07.020880229Z [2024-05-26 00:10:07,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:10:08.200247979Z [2024-05-26 00:10:08,199: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:10:08.203343557Z [2024-05-26 00:10:08,202: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:10:08.226770548Z [2024-05-26 00:10:08,226: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:10:08.228207430Z [2024-05-26 00:10:08,227: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:10:08.228227978Z [2024-05-26 00:10:08,228: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:10:08.228387216Z [2024-05-26 00:10:08,228: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:10:08.228399445Z [2024-05-26 00:10:08,228: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:10:08.228696893Z [2024-05-26 00:10:08,228: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:10:08.228732560Z [2024-05-26 00:10:08,228: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:10:08.328471061Z [2024-05-26 00:10:08,328: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:10:09.042068469Z [2024-05-26 00:10:09,041: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd3a72d0-1ddf-4f1a-b896-62c11314960f] succeeded in 2.306361324000136s: None 2024-05-26T00:10:09.705966736Z [2024-05-26 00:10:09,705: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8568ee37-4655-45fa-b412-4137a98586d6] received 2024-05-26T00:10:09.719176620Z [2024-05-26 00:10:09,718: INFO/ForkPoolWorker-15] [8568ee37-4655-45fa-b412-4137a98586d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:10:10.047224154Z [2024-05-26 00:10:10,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:10:11.162648250Z [2024-05-26 00:10:11,162: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:10:11.166144091Z [2024-05-26 00:10:11,165: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:10:11.187467745Z [2024-05-26 00:10:11,187: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:10:11.188926141Z [2024-05-26 00:10:11,188: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:10:11.189026940Z [2024-05-26 00:10:11,188: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:10:11.189213673Z [2024-05-26 00:10:11,189: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:10:11.189322361Z [2024-05-26 00:10:11,189: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:10:11.189632213Z [2024-05-26 00:10:11,189: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:10:11.189738561Z [2024-05-26 00:10:11,189: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:10:11.261505295Z [2024-05-26 00:10:11,261: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:10:11.869736461Z [2024-05-26 00:10:11,869: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8568ee37-4655-45fa-b412-4137a98586d6] succeeded in 2.161446991000048s: None 2024-05-26T00:11:00.564017596Z [2024-05-26 00:11:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e5860c2-3371-4bbb-81e9-2a14c9f1bf48] received 2024-05-26T00:11:00.575504942Z [2024-05-26 00:11:00,575: INFO/ForkPoolWorker-15] [1e5860c2-3371-4bbb-81e9-2a14c9f1bf48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:11:00.576413549Z [2024-05-26 00:11:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[519b0db1-0f75-42a6-9398-21abe4ed57b6] received 2024-05-26T00:11:00.579033991Z [2024-05-26 00:11:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[969c0009-d742-45e7-a74b-fd390338557b] received 2024-05-26T00:11:00.588540861Z [2024-05-26 00:11:00,588: INFO/ForkPoolWorker-16] [519b0db1-0f75-42a6-9398-21abe4ed57b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:11:00.594386254Z [2024-05-26 00:11:00,593: INFO/ForkPoolWorker-1] [969c0009-d742-45e7-a74b-fd390338557b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:11:00.903160742Z [2024-05-26 00:11:00,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:11:00.903836501Z [2024-05-26 00:11:00,899: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:11:00.904430881Z [2024-05-26 00:11:00,900: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:11:01.068473562Z [2024-05-26 00:11:01,068: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:11:01.072286494Z [2024-05-26 00:11:01,071: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:11:01.109132720Z [2024-05-26 00:11:01,108: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:11:01.111490898Z [2024-05-26 00:11:01,110: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:11:01.111686514Z [2024-05-26 00:11:01,111: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:11:01.111756526Z [2024-05-26 00:11:01,111: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:11:01.112027641Z [2024-05-26 00:11:01,111: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:11:01.228601704Z [2024-05-26 00:11:01,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:11:01.884555265Z [2024-05-26 00:11:01,884: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[519b0db1-0f75-42a6-9398-21abe4ed57b6] succeeded in 1.3052972890000092s: None 2024-05-26T00:11:02.261144921Z [2024-05-26 00:11:02,260: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:11:02.264583525Z [2024-05-26 00:11:02,264: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:11:02.291863816Z [2024-05-26 00:11:02,291: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:11:02.293614440Z [2024-05-26 00:11:02,293: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:11:02.293794624Z [2024-05-26 00:11:02,293: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:11:02.293997839Z [2024-05-26 00:11:02,293: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:11:02.294111333Z [2024-05-26 00:11:02,293: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:11:02.295044672Z [2024-05-26 00:11:02,294: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:11:02.295472197Z [2024-05-26 00:11:02,295: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:11:02.315613946Z [2024-05-26 00:11:02,315: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:11:02.320719904Z [2024-05-26 00:11:02,320: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:11:02.343190674Z [2024-05-26 00:11:02,342: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:11:02.344837824Z [2024-05-26 00:11:02,344: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:11:02.345069149Z [2024-05-26 00:11:02,344: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:11:02.345323244Z [2024-05-26 00:11:02,345: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:11:02.345569468Z [2024-05-26 00:11:02,345: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:11:02.348579931Z [2024-05-26 00:11:02,348: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:11:02.348751322Z [2024-05-26 00:11:02,348: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:11:02.384975936Z [2024-05-26 00:11:02,384: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:11:02.473599093Z [2024-05-26 00:11:02,473: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:11:04.124394844Z [2024-05-26 00:11:04,123: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e5860c2-3371-4bbb-81e9-2a14c9f1bf48] succeeded in 3.5572122920002585s: None 2024-05-26T00:11:05.791448461Z [2024-05-26 00:11:05,782: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[969c0009-d742-45e7-a74b-fd390338557b] succeeded in 5.2004339139994045s: None 2024-05-26T00:12:00.561804045Z [2024-05-26 00:12:00,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bca29e1-4c93-4aac-bc6d-561bf0119ffa] received 2024-05-26T00:12:00.567584458Z [2024-05-26 00:12:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc03474e-5a26-4250-80a2-259e2ce4603e] received 2024-05-26T00:12:00.570269229Z [2024-05-26 00:12:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97b95129-3501-4840-9cc3-4cd6b55005b6] received 2024-05-26T00:12:00.570991168Z [2024-05-26 00:12:00,570: INFO/ForkPoolWorker-15] [9bca29e1-4c93-4aac-bc6d-561bf0119ffa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:12:00.580362503Z [2024-05-26 00:12:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b198b4df-2f07-431a-933d-3f252fa1c5db] received 2024-05-26T00:12:00.580970488Z [2024-05-26 00:12:00,580: INFO/ForkPoolWorker-1] [97b95129-3501-4840-9cc3-4cd6b55005b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:12:00.592890630Z [2024-05-26 00:12:00,592: INFO/ForkPoolWorker-16] [dc03474e-5a26-4250-80a2-259e2ce4603e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:12:00.600349657Z [2024-05-26 00:12:00,598: INFO/ForkPoolWorker-2] [b198b4df-2f07-431a-933d-3f252fa1c5db] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:12:00.921434427Z [2024-05-26 00:12:00,916: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:12:00.988654388Z [2024-05-26 00:12:00,984: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:12:01.003551379Z [2024-05-26 00:12:00,997: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:12:01.059199430Z [2024-05-26 00:12:01,056: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:12:01.168868955Z [2024-05-26 00:12:01,168: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:12:01.172930568Z [2024-05-26 00:12:01,172: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:12:01.204093009Z [2024-05-26 00:12:01,203: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:12:01.216376813Z [2024-05-26 00:12:01,216: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:12:01.216810909Z [2024-05-26 00:12:01,216: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:12:01.217094341Z [2024-05-26 00:12:01,216: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:12:01.217556533Z [2024-05-26 00:12:01,217: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:12:01.296115931Z [2024-05-26 00:12:01,295: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:12:01.348914595Z [2024-05-26 00:12:01,348: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:12:01.882853025Z [2024-05-26 00:12:01,882: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dc03474e-5a26-4250-80a2-259e2ce4603e] succeeded in 1.3118280519993277s: None 2024-05-26T00:12:02.001518634Z [2024-05-26 00:12:02,001: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b198b4df-2f07-431a-933d-3f252fa1c5db] succeeded in 1.4181897900007243s: None 2024-05-26T00:12:02.190468132Z [2024-05-26 00:12:02,190: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:12:02.193678622Z [2024-05-26 00:12:02,193: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:12:02.217862707Z [2024-05-26 00:12:02,217: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:12:02.219353174Z [2024-05-26 00:12:02,219: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:12:02.219398952Z [2024-05-26 00:12:02,219: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:12:02.219537818Z [2024-05-26 00:12:02,219: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:12:02.219618469Z [2024-05-26 00:12:02,219: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:12:02.220143551Z [2024-05-26 00:12:02,219: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:12:02.220198403Z [2024-05-26 00:12:02,220: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:12:02.311978913Z [2024-05-26 00:12:02,311: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:12:02.315135570Z [2024-05-26 00:12:02,314: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:12:02.316686840Z [2024-05-26 00:12:02,316: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:12:02.345849174Z [2024-05-26 00:12:02,345: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:12:02.348426831Z [2024-05-26 00:12:02,348: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:12:02.348857646Z [2024-05-26 00:12:02,348: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:12:02.349362466Z [2024-05-26 00:12:02,348: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:12:02.349736162Z [2024-05-26 00:12:02,349: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:12:02.350547212Z [2024-05-26 00:12:02,350: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:12:02.350893661Z [2024-05-26 00:12:02,350: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:12:02.437678289Z [2024-05-26 00:12:02,437: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:12:03.859877958Z [2024-05-26 00:12:03,858: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9bca29e1-4c93-4aac-bc6d-561bf0119ffa] succeeded in 3.2948838560005242s: None 2024-05-26T00:12:04.955357630Z [2024-05-26 00:12:04,954: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[97b95129-3501-4840-9cc3-4cd6b55005b6] succeeded in 4.382779481000398s: None 2024-05-26T00:13:00.678961760Z [2024-05-26 00:13:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06acec16-f8d1-4e8e-8631-310b4a601961] received 2024-05-26T00:13:00.681018470Z [2024-05-26 00:13:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23033a43-ab36-467a-b938-b4ced8684d4f] received 2024-05-26T00:13:00.682460319Z [2024-05-26 00:13:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af9d35a8-31d0-42da-839e-6fe115828da6] received 2024-05-26T00:13:00.694786071Z [2024-05-26 00:13:00,694: INFO/ForkPoolWorker-15] [06acec16-f8d1-4e8e-8631-310b4a601961] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:13:00.698082874Z [2024-05-26 00:13:00,697: INFO/ForkPoolWorker-16] [23033a43-ab36-467a-b938-b4ced8684d4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:13:00.700579834Z [2024-05-26 00:13:00,700: INFO/ForkPoolWorker-1] [af9d35a8-31d0-42da-839e-6fe115828da6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:13:01.006602540Z [2024-05-26 00:13:01,002: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:13:01.028019982Z [2024-05-26 00:13:01,024: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:13:01.032963014Z [2024-05-26 00:13:01,029: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:13:01.189294605Z [2024-05-26 00:13:01,188: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T00:13:01.193310721Z [2024-05-26 00:13:01,192: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:13:01.218611930Z [2024-05-26 00:13:01,218: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:13:01.219740394Z [2024-05-26 00:13:01,219: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:13:01.219879850Z [2024-05-26 00:13:01,219: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:13:01.220021081Z [2024-05-26 00:13:01,219: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T00:13:01.220356765Z [2024-05-26 00:13:01,220: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:13:01.326102348Z [2024-05-26 00:13:01,325: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:13:01.897316906Z [2024-05-26 00:13:01,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06acec16-f8d1-4e8e-8631-310b4a601961] succeeded in 1.2145782500001587s: None 2024-05-26T00:13:02.160065364Z [2024-05-26 00:13:02,159: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:13:02.163529341Z [2024-05-26 00:13:02,163: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:13:02.194396974Z [2024-05-26 00:13:02,194: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:13:02.196181398Z [2024-05-26 00:13:02,195: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:13:02.196388015Z [2024-05-26 00:13:02,196: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:13:02.196670767Z [2024-05-26 00:13:02,196: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:13:02.196865851Z [2024-05-26 00:13:02,196: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:13:02.197476208Z [2024-05-26 00:13:02,197: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:13:02.197655744Z [2024-05-26 00:13:02,197: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:13:02.290223159Z [2024-05-26 00:13:02,289: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:13:02.315126498Z [2024-05-26 00:13:02,314: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:13:02.318610101Z [2024-05-26 00:13:02,318: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:13:02.335616974Z [2024-05-26 00:13:02,335: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:13:02.337317855Z [2024-05-26 00:13:02,337: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:13:02.337431199Z [2024-05-26 00:13:02,337: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:13:02.337614584Z [2024-05-26 00:13:02,337: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:13:02.337701333Z [2024-05-26 00:13:02,337: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:13:02.337973170Z [2024-05-26 00:13:02,337: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:13:02.338098311Z [2024-05-26 00:13:02,337: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:13:02.432786031Z [2024-05-26 00:13:02,432: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:13:03.778822997Z [2024-05-26 00:13:03,778: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[af9d35a8-31d0-42da-839e-6fe115828da6] succeeded in 3.0925374460002786s: None 2024-05-26T00:13:04.518068774Z [2024-05-26 00:13:04,516: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[23033a43-ab36-467a-b938-b4ced8684d4f] succeeded in 3.831180375999793s: None 2024-05-26T00:14:00.501068418Z [2024-05-26 00:14:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[352033f2-7557-439b-9725-a7102d46f5b0] received 2024-05-26T00:14:00.503501879Z [2024-05-26 00:14:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d98e897-44ed-4aa0-8662-2bf8506699d7] received 2024-05-26T00:14:00.510294679Z [2024-05-26 00:14:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5ac56dd-0cb0-4b1c-b6c3-372955315c2c] received 2024-05-26T00:14:00.518736431Z [2024-05-26 00:14:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67e931a9-39d0-4e34-82e0-2246608655b5] received 2024-05-26T00:14:00.519709012Z [2024-05-26 00:14:00,519: INFO/ForkPoolWorker-15] [352033f2-7557-439b-9725-a7102d46f5b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:14:00.524842913Z [2024-05-26 00:14:00,524: INFO/ForkPoolWorker-16] [9d98e897-44ed-4aa0-8662-2bf8506699d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:14:00.532696754Z [2024-05-26 00:14:00,531: INFO/ForkPoolWorker-1] [b5ac56dd-0cb0-4b1c-b6c3-372955315c2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:14:00.548940547Z [2024-05-26 00:14:00,548: INFO/ForkPoolWorker-2] [67e931a9-39d0-4e34-82e0-2246608655b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:14:00.953405644Z [2024-05-26 00:14:00,950: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:14:00.959444735Z [2024-05-26 00:14:00,955: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:14:01.044781511Z [2024-05-26 00:14:01,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:14:01.147738069Z [2024-05-26 00:14:01,144: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:14:01.170408560Z [2024-05-26 00:14:01,170: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:14:01.174224135Z [2024-05-26 00:14:01,173: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:14:01.199824704Z [2024-05-26 00:14:01,199: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:14:01.201060772Z [2024-05-26 00:14:01,200: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:14:01.201292345Z [2024-05-26 00:14:01,201: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:14:01.201436221Z [2024-05-26 00:14:01,201: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:14:01.201659028Z [2024-05-26 00:14:01,201: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:14:01.269856251Z [2024-05-26 00:14:01,269: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:14:01.309389357Z [2024-05-26 00:14:01,309: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:14:01.985820983Z [2024-05-26 00:14:01,985: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d98e897-44ed-4aa0-8662-2bf8506699d7] succeeded in 1.479037549000168s: None 2024-05-26T00:14:01.996616682Z [2024-05-26 00:14:01,996: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b5ac56dd-0cb0-4b1c-b6c3-372955315c2c] succeeded in 1.4835492150004939s: None 2024-05-26T00:14:02.221749273Z [2024-05-26 00:14:02,221: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:14:02.224957856Z [2024-05-26 00:14:02,224: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:14:02.246291975Z [2024-05-26 00:14:02,245: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:14:02.247735545Z [2024-05-26 00:14:02,247: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:14:02.247836966Z [2024-05-26 00:14:02,247: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:14:02.248091983Z [2024-05-26 00:14:02,247: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:14:02.248218795Z [2024-05-26 00:14:02,248: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:14:02.248541054Z [2024-05-26 00:14:02,248: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:14:02.248740183Z [2024-05-26 00:14:02,248: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:14:02.344509013Z [2024-05-26 00:14:02,344: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:14:02.443451110Z [2024-05-26 00:14:02,443: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:14:02.446774764Z [2024-05-26 00:14:02,446: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:14:02.468789570Z [2024-05-26 00:14:02,468: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:14:02.470405180Z [2024-05-26 00:14:02,470: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:14:02.470759685Z [2024-05-26 00:14:02,470: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:14:02.470821129Z [2024-05-26 00:14:02,470: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:14:02.470895171Z [2024-05-26 00:14:02,470: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:14:02.471348240Z [2024-05-26 00:14:02,471: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:14:02.471428284Z [2024-05-26 00:14:02,471: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:14:02.540244938Z [2024-05-26 00:14:02,539: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:14:03.759234655Z [2024-05-26 00:14:03,758: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[352033f2-7557-439b-9725-a7102d46f5b0] succeeded in 3.253503572000227s: None 2024-05-26T00:14:04.542341595Z [2024-05-26 00:14:04,540: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[67e931a9-39d0-4e34-82e0-2246608655b5] succeeded in 4.018591193999782s: None 2024-05-26T00:15:00.760223460Z [2024-05-26 00:15:00,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfadea91-2097-4288-b062-630e380baf05] received 2024-05-26T00:15:00.765706348Z [2024-05-26 00:15:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bab7e67b-1fec-406b-958e-f6a5c7c3506a] received 2024-05-26T00:15:00.772283683Z [2024-05-26 00:15:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84fe6804-8c22-46dc-b700-ce725dbb117c] received 2024-05-26T00:15:00.772326432Z [2024-05-26 00:15:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b53cb5a7-20ee-48c1-a654-f81d1d8b7ebf] received 2024-05-26T00:15:00.790613963Z [2024-05-26 00:15:00,788: INFO/ForkPoolWorker-15] [bfadea91-2097-4288-b062-630e380baf05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:15:00.791819662Z [2024-05-26 00:15:00,787: INFO/ForkPoolWorker-16] [bab7e67b-1fec-406b-958e-f6a5c7c3506a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:15:00.798210978Z [2024-05-26 00:15:00,797: INFO/ForkPoolWorker-1] [84fe6804-8c22-46dc-b700-ce725dbb117c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:15:00.798315473Z [2024-05-26 00:15:00,798: INFO/ForkPoolWorker-2] [b53cb5a7-20ee-48c1-a654-f81d1d8b7ebf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:15:01.124997135Z [2024-05-26 00:15:01,119: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:15:01.131555837Z [2024-05-26 00:15:01,127: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:15:01.134793963Z [2024-05-26 00:15:01,130: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:15:01.174714032Z [2024-05-26 00:15:01,171: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:15:01.348304742Z [2024-05-26 00:15:01,347: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:15:01.353171892Z [2024-05-26 00:15:01,352: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:15:01.377084436Z [2024-05-26 00:15:01,376: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:15:01.378371144Z [2024-05-26 00:15:01,378: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:15:01.378494792Z [2024-05-26 00:15:01,378: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:15:01.378561666Z [2024-05-26 00:15:01,378: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:15:01.378806901Z [2024-05-26 00:15:01,378: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:15:01.508035868Z [2024-05-26 00:15:01,507: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:15:02.125521892Z [2024-05-26 00:15:02,125: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b53cb5a7-20ee-48c1-a654-f81d1d8b7ebf] succeeded in 1.349978670999917s: None 2024-05-26T00:15:02.460973395Z [2024-05-26 00:15:02,460: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:15:02.464381479Z [2024-05-26 00:15:02,464: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:15:02.469145890Z [2024-05-26 00:15:02,468: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:15:02.472307214Z [2024-05-26 00:15:02,471: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:15:02.482971400Z [2024-05-26 00:15:02,482: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:15:02.486348034Z [2024-05-26 00:15:02,485: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:15:02.493123294Z [2024-05-26 00:15:02,492: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:15:02.496353195Z [2024-05-26 00:15:02,495: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:15:02.496501552Z [2024-05-26 00:15:02,496: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:15:02.497070434Z [2024-05-26 00:15:02,496: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:15:02.497239325Z [2024-05-26 00:15:02,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:15:02.497643096Z [2024-05-26 00:15:02,497: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:15:02.498204344Z [2024-05-26 00:15:02,498: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:15:02.510899773Z [2024-05-26 00:15:02,510: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:15:02.511979611Z [2024-05-26 00:15:02,511: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:15:02.515104128Z [2024-05-26 00:15:02,514: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:15:02.515117401Z [2024-05-26 00:15:02,515: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:15:02.515186968Z [2024-05-26 00:15:02,515: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:15:02.515226306Z [2024-05-26 00:15:02,515: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:15:02.515436348Z [2024-05-26 00:15:02,515: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:15:02.515473755Z [2024-05-26 00:15:02,515: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:15:02.517191388Z [2024-05-26 00:15:02,516: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:15:02.517234390Z [2024-05-26 00:15:02,517: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:15:02.517411151Z [2024-05-26 00:15:02,517: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:15:02.517523158Z [2024-05-26 00:15:02,517: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:15:02.518906555Z [2024-05-26 00:15:02,517: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:15:02.519035661Z [2024-05-26 00:15:02,518: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:15:02.593403503Z [2024-05-26 00:15:02,593: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:15:02.608994646Z [2024-05-26 00:15:02,608: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:15:02.628447734Z [2024-05-26 00:15:02,628: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:15:03.305344836Z [2024-05-26 00:15:03,304: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfadea91-2097-4288-b062-630e380baf05] succeeded in 2.54140792599992s: None 2024-05-26T00:15:04.179813081Z [2024-05-26 00:15:04,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0a62d7e-6ef7-411e-8c2f-da529bcceb12] received 2024-05-26T00:15:04.185931651Z [2024-05-26 00:15:04,185: INFO/ForkPoolWorker-15] [b0a62d7e-6ef7-411e-8c2f-da529bcceb12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:15:04.284621205Z [2024-05-26 00:15:04,284: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bab7e67b-1fec-406b-958e-f6a5c7c3506a] succeeded in 3.516708034000658s: None 2024-05-26T00:15:04.560527142Z [2024-05-26 00:15:04,560: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[84fe6804-8c22-46dc-b700-ce725dbb117c] succeeded in 3.789035815999341s: None 2024-05-26T00:15:04.568832068Z [2024-05-26 00:15:04,565: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:15:05.758191492Z [2024-05-26 00:15:05,757: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:15:05.761395729Z [2024-05-26 00:15:05,760: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:15:05.793105298Z [2024-05-26 00:15:05,792: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:15:05.795347660Z [2024-05-26 00:15:05,795: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:15:05.795725301Z [2024-05-26 00:15:05,795: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:15:05.797620972Z [2024-05-26 00:15:05,797: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:15:05.799653757Z [2024-05-26 00:15:05,799: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:15:05.800175729Z [2024-05-26 00:15:05,799: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:15:05.800442978Z [2024-05-26 00:15:05,800: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:15:05.880764480Z [2024-05-26 00:15:05,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:15:06.630597219Z [2024-05-26 00:15:06,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0a62d7e-6ef7-411e-8c2f-da529bcceb12] succeeded in 2.4486266560006698s: None 2024-05-26T00:15:06.646808769Z [2024-05-26 00:15:06,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0b01935-9103-43b0-b23e-f27bc4fd7de2] received 2024-05-26T00:15:06.656568252Z [2024-05-26 00:15:06,655: INFO/ForkPoolWorker-15] [f0b01935-9103-43b0-b23e-f27bc4fd7de2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:15:06.918021231Z [2024-05-26 00:15:06,914: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:15:07.979269577Z [2024-05-26 00:15:07,978: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:15:07.982745971Z [2024-05-26 00:15:07,982: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:15:08.018747102Z [2024-05-26 00:15:08,018: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:15:08.021010507Z [2024-05-26 00:15:08,020: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:15:08.021088067Z [2024-05-26 00:15:08,020: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:15:08.021309713Z [2024-05-26 00:15:08,021: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:15:08.021333883Z [2024-05-26 00:15:08,021: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:15:08.021723134Z [2024-05-26 00:15:08,021: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:15:08.021740902Z [2024-05-26 00:15:08,021: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:15:08.101709312Z [2024-05-26 00:15:08,101: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:15:08.712699155Z [2024-05-26 00:15:08,711: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0b01935-9103-43b0-b23e-f27bc4fd7de2] succeeded in 2.063983153000663s: None 2024-05-26T00:15:09.278415554Z [2024-05-26 00:15:09,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ee0aa51-93fc-4fc8-a5a1-f276ee73496e] received 2024-05-26T00:15:09.287620424Z [2024-05-26 00:15:09,286: INFO/ForkPoolWorker-15] [4ee0aa51-93fc-4fc8-a5a1-f276ee73496e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:15:09.563316092Z [2024-05-26 00:15:09,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:15:10.596270200Z [2024-05-26 00:15:10,595: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:15:10.599622459Z [2024-05-26 00:15:10,599: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:15:10.616594605Z [2024-05-26 00:15:10,616: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:15:10.617811222Z [2024-05-26 00:15:10,617: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:15:10.617823154Z [2024-05-26 00:15:10,617: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:15:10.618120878Z [2024-05-26 00:15:10,617: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:15:10.618151577Z [2024-05-26 00:15:10,617: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:15:10.618448936Z [2024-05-26 00:15:10,618: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:15:10.618463928Z [2024-05-26 00:15:10,618: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:15:10.701169101Z [2024-05-26 00:15:10,700: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:15:11.368229219Z [2024-05-26 00:15:11,367: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ee0aa51-93fc-4fc8-a5a1-f276ee73496e] succeeded in 2.087779020999733s: None 2024-05-26T00:16:00.967946926Z [2024-05-26 00:16:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83a9386e-f46c-499c-9523-72abe44d46bc] received 2024-05-26T00:16:00.971922973Z [2024-05-26 00:16:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52410538-6fcc-4c5f-9584-fbcdfeb202fa] received 2024-05-26T00:16:00.974960545Z [2024-05-26 00:16:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[929edb15-a226-4ab4-bfd2-33ed5efa6659] received 2024-05-26T00:16:00.980898356Z [2024-05-26 00:16:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ca4e1fb-1b9c-4d92-a946-a8c415f6e674] received 2024-05-26T00:16:00.987371142Z [2024-05-26 00:16:00,987: INFO/ForkPoolWorker-1] [929edb15-a226-4ab4-bfd2-33ed5efa6659] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:16:00.988285765Z [2024-05-26 00:16:00,987: INFO/ForkPoolWorker-15] [83a9386e-f46c-499c-9523-72abe44d46bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:16:00.988328347Z [2024-05-26 00:16:00,985: INFO/ForkPoolWorker-16] [52410538-6fcc-4c5f-9584-fbcdfeb202fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:16:00.997053113Z [2024-05-26 00:16:00,996: INFO/ForkPoolWorker-2] [1ca4e1fb-1b9c-4d92-a946-a8c415f6e674] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:16:01.469042664Z [2024-05-26 00:16:01,465: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:16:01.482729173Z [2024-05-26 00:16:01,478: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:16:01.548481616Z [2024-05-26 00:16:01,544: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:16:01.564463431Z [2024-05-26 00:16:01,552: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:16:01.848596578Z [2024-05-26 00:16:01,848: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:16:01.852209754Z [2024-05-26 00:16:01,851: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:16:01.855804261Z [2024-05-26 00:16:01,855: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:16:01.884507479Z [2024-05-26 00:16:01,884: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:16:01.885769714Z [2024-05-26 00:16:01,885: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:16:01.885789312Z [2024-05-26 00:16:01,885: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:16:01.885851985Z [2024-05-26 00:16:01,885: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:16:01.886057800Z [2024-05-26 00:16:01,885: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:16:01.997694834Z [2024-05-26 00:16:01,997: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:16:02.464871132Z [2024-05-26 00:16:02,464: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83a9386e-f46c-499c-9523-72abe44d46bc] succeeded in 1.4943962309998824s: None 2024-05-26T00:16:02.657641263Z [2024-05-26 00:16:02,657: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1ca4e1fb-1b9c-4d92-a946-a8c415f6e674] succeeded in 1.6727139120002903s: None 2024-05-26T00:16:02.936514467Z [2024-05-26 00:16:02,936: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:16:02.950920044Z [2024-05-26 00:16:02,939: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:16:02.983933300Z [2024-05-26 00:16:02,983: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:16:02.985410183Z [2024-05-26 00:16:02,985: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:16:02.985528361Z [2024-05-26 00:16:02,985: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:16:02.985715811Z [2024-05-26 00:16:02,985: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:16:02.985827967Z [2024-05-26 00:16:02,985: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:16:02.986131676Z [2024-05-26 00:16:02,985: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:16:02.986284939Z [2024-05-26 00:16:02,986: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:16:03.067491194Z [2024-05-26 00:16:03,067: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:16:03.144883703Z [2024-05-26 00:16:03,144: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:16:03.152245742Z [2024-05-26 00:16:03,151: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:16:03.172926702Z [2024-05-26 00:16:03,172: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:16:03.173651241Z [2024-05-26 00:16:03,173: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:16:03.173691042Z [2024-05-26 00:16:03,173: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:16:03.173904835Z [2024-05-26 00:16:03,173: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:16:03.173977221Z [2024-05-26 00:16:03,173: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:16:03.174272267Z [2024-05-26 00:16:03,174: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:16:03.174346688Z [2024-05-26 00:16:03,174: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:16:03.314871859Z [2024-05-26 00:16:03,314: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:16:05.667924525Z [2024-05-26 00:16:05,667: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[929edb15-a226-4ab4-bfd2-33ed5efa6659] succeeded in 4.690550377999898s: None 2024-05-26T00:16:06.074094722Z [2024-05-26 00:16:06,073: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[52410538-6fcc-4c5f-9584-fbcdfeb202fa] succeeded in 5.097385619999841s: None 2024-05-26T00:17:01.234706859Z [2024-05-26 00:17:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f5fe214-039d-49f8-9585-d565b84f2ba0] received 2024-05-26T00:17:01.240809354Z [2024-05-26 00:17:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52f9aa0a-5d74-4c29-bfad-04b0677a58ad] received 2024-05-26T00:17:01.253125861Z [2024-05-26 00:17:01,252: INFO/ForkPoolWorker-16] [52f9aa0a-5d74-4c29-bfad-04b0677a58ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:17:01.256181990Z [2024-05-26 00:17:01,255: INFO/ForkPoolWorker-15] [0f5fe214-039d-49f8-9585-d565b84f2ba0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:17:01.259644008Z [2024-05-26 00:17:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a68e2f84-b202-4110-b865-c8d567cebb2a] received 2024-05-26T00:17:01.292580648Z [2024-05-26 00:17:01,292: INFO/ForkPoolWorker-1] [a68e2f84-b202-4110-b865-c8d567cebb2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:17:01.570225170Z [2024-05-26 00:17:01,565: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:17:01.587065922Z [2024-05-26 00:17:01,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:17:01.639318803Z [2024-05-26 00:17:01,635: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:17:01.818722865Z [2024-05-26 00:17:01,818: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:17:01.822950788Z [2024-05-26 00:17:01,822: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:17:01.855664261Z [2024-05-26 00:17:01,855: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:17:01.859247969Z [2024-05-26 00:17:01,858: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:17:01.859480787Z [2024-05-26 00:17:01,859: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:17:01.859576166Z [2024-05-26 00:17:01,859: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:17:01.860042604Z [2024-05-26 00:17:01,859: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:17:02.008473468Z [2024-05-26 00:17:02,008: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:17:02.766233651Z [2024-05-26 00:17:02,765: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[52f9aa0a-5d74-4c29-bfad-04b0677a58ad] succeeded in 1.5234455680001702s: None 2024-05-26T00:17:02.950955625Z [2024-05-26 00:17:02,950: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:17:02.953238042Z [2024-05-26 00:17:02,952: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:17:02.954265390Z [2024-05-26 00:17:02,953: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:17:02.957118782Z [2024-05-26 00:17:02,956: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:17:02.977402394Z [2024-05-26 00:17:02,977: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:17:02.979266170Z [2024-05-26 00:17:02,978: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:17:02.979474820Z [2024-05-26 00:17:02,979: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:17:02.980019527Z [2024-05-26 00:17:02,979: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:17:02.980397123Z [2024-05-26 00:17:02,979: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:17:02.980875639Z [2024-05-26 00:17:02,980: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:17:02.981161249Z [2024-05-26 00:17:02,980: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:17:02.983696069Z [2024-05-26 00:17:02,983: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:17:02.985272173Z [2024-05-26 00:17:02,984: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:17:02.985288344Z [2024-05-26 00:17:02,985: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:17:02.985431722Z [2024-05-26 00:17:02,985: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:17:02.985445901Z [2024-05-26 00:17:02,985: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:17:02.985902206Z [2024-05-26 00:17:02,985: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:17:02.985944030Z [2024-05-26 00:17:02,985: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:17:03.066773434Z [2024-05-26 00:17:03,066: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:17:03.085841541Z [2024-05-26 00:17:03,085: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:17:05.292441928Z [2024-05-26 00:17:05,292: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a68e2f84-b202-4110-b865-c8d567cebb2a] succeeded in 4.0266623100005745s: None 2024-05-26T00:17:05.702325637Z [2024-05-26 00:17:05,701: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0f5fe214-039d-49f8-9585-d565b84f2ba0] succeeded in 4.462464319999526s: None 2024-05-26T00:18:00.324138134Z [2024-05-26 00:18:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8319ff65-97da-4ad0-83c1-f3ca9aabb1c9] received 2024-05-26T00:18:00.325709920Z [2024-05-26 00:18:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4d7716f-ebc3-4f32-b28d-8eaba66e6a2c] received 2024-05-26T00:18:00.338802376Z [2024-05-26 00:18:00,338: INFO/ForkPoolWorker-15] [8319ff65-97da-4ad0-83c1-f3ca9aabb1c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:18:00.340082705Z [2024-05-26 00:18:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66985bcb-38ba-4936-af0f-c3c7f87f53f3] received 2024-05-26T00:18:00.340888571Z [2024-05-26 00:18:00,340: INFO/ForkPoolWorker-16] [d4d7716f-ebc3-4f32-b28d-8eaba66e6a2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:18:00.342502804Z [2024-05-26 00:18:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85b42bf8-5253-4b43-80a2-b1b5f87174a8] received 2024-05-26T00:18:00.360495546Z [2024-05-26 00:18:00,360: INFO/ForkPoolWorker-2] [85b42bf8-5253-4b43-80a2-b1b5f87174a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:18:00.361325655Z [2024-05-26 00:18:00,361: INFO/ForkPoolWorker-1] [66985bcb-38ba-4936-af0f-c3c7f87f53f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:18:00.773996313Z [2024-05-26 00:18:00,753: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:18:00.783632870Z [2024-05-26 00:18:00,776: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:18:00.807642584Z [2024-05-26 00:18:00,798: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:18:01.192762647Z [2024-05-26 00:18:01,182: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:18:01.378816843Z [2024-05-26 00:18:01,378: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:18:01.726319296Z [2024-05-26 00:18:01,725: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:18:01.732336909Z [2024-05-26 00:18:01,731: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:18:01.803625432Z [2024-05-26 00:18:01,802: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:18:01.804976469Z [2024-05-26 00:18:01,804: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:18:01.805181998Z [2024-05-26 00:18:01,804: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:18:01.805447945Z [2024-05-26 00:18:01,805: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:18:01.805860973Z [2024-05-26 00:18:01,805: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:18:01.925505412Z [2024-05-26 00:18:01,925: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:18:02.078426671Z [2024-05-26 00:18:02,077: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66985bcb-38ba-4936-af0f-c3c7f87f53f3] succeeded in 1.7346661550000135s: None 2024-05-26T00:18:02.463595004Z [2024-05-26 00:18:02,463: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:18:02.468487208Z [2024-05-26 00:18:02,467: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:18:02.497154285Z [2024-05-26 00:18:02,496: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:18:02.498974800Z [2024-05-26 00:18:02,498: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:18:02.499104148Z [2024-05-26 00:18:02,498: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:18:02.499303509Z [2024-05-26 00:18:02,499: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:18:02.499364290Z [2024-05-26 00:18:02,499: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:18:02.500203935Z [2024-05-26 00:18:02,499: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:18:02.500401042Z [2024-05-26 00:18:02,500: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:18:02.614746715Z [2024-05-26 00:18:02,613: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:18:02.732755862Z [2024-05-26 00:18:02,732: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d4d7716f-ebc3-4f32-b28d-8eaba66e6a2c] succeeded in 2.4029101129999617s: None 2024-05-26T00:18:03.051559137Z [2024-05-26 00:18:03,051: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:18:03.054940808Z [2024-05-26 00:18:03,054: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:18:03.080225277Z [2024-05-26 00:18:03,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:18:03.082131495Z [2024-05-26 00:18:03,081: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:18:03.082311975Z [2024-05-26 00:18:03,082: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:18:03.082493191Z [2024-05-26 00:18:03,082: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:18:03.082618339Z [2024-05-26 00:18:03,082: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:18:03.084210350Z [2024-05-26 00:18:03,083: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:18:03.084279759Z [2024-05-26 00:18:03,084: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:18:03.168959918Z [2024-05-26 00:18:03,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:18:04.435397576Z [2024-05-26 00:18:04,425: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[85b42bf8-5253-4b43-80a2-b1b5f87174a8] succeeded in 4.07889374899969s: None 2024-05-26T00:18:05.543613347Z [2024-05-26 00:18:05,542: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8319ff65-97da-4ad0-83c1-f3ca9aabb1c9] succeeded in 5.21559698100009s: None 2024-05-26T00:19:00.700380507Z [2024-05-26 00:19:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[724c37d0-1ca0-4a06-a4a8-d1a944756409] received 2024-05-26T00:19:00.708269231Z [2024-05-26 00:19:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17997eee-d162-4ed8-8d48-6675ba034ba9] received 2024-05-26T00:19:00.718793805Z [2024-05-26 00:19:00,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7696b922-bf19-4e10-9c87-0648e6e938bc] received 2024-05-26T00:19:00.726220522Z [2024-05-26 00:19:00,725: INFO/ForkPoolWorker-15] [724c37d0-1ca0-4a06-a4a8-d1a944756409] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:19:00.733583241Z [2024-05-26 00:19:00,733: INFO/ForkPoolWorker-16] [17997eee-d162-4ed8-8d48-6675ba034ba9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:19:00.752497311Z [2024-05-26 00:19:00,751: INFO/ForkPoolWorker-1] [7696b922-bf19-4e10-9c87-0648e6e938bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:19:01.072991103Z [2024-05-26 00:19:01,069: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:19:01.212618485Z [2024-05-26 00:19:01,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:19:01.264791008Z [2024-05-26 00:19:01,259: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:19:01.490931176Z [2024-05-26 00:19:01,490: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:19:01.495912739Z [2024-05-26 00:19:01,495: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:19:01.529475646Z [2024-05-26 00:19:01,529: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:19:01.530583638Z [2024-05-26 00:19:01,530: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:19:01.530658969Z [2024-05-26 00:19:01,530: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:19:01.530710650Z [2024-05-26 00:19:01,530: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:19:01.531020502Z [2024-05-26 00:19:01,530: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:19:01.629613992Z [2024-05-26 00:19:01,629: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:19:02.301694809Z [2024-05-26 00:19:02,301: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7696b922-bf19-4e10-9c87-0648e6e938bc] succeeded in 1.579543812999873s: None 2024-05-26T00:19:02.455114403Z [2024-05-26 00:19:02,454: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:19:02.458533432Z [2024-05-26 00:19:02,458: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:19:02.481225972Z [2024-05-26 00:19:02,480: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:19:02.483137960Z [2024-05-26 00:19:02,482: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:19:02.483345202Z [2024-05-26 00:19:02,483: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:19:02.483679150Z [2024-05-26 00:19:02,483: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:19:02.483868067Z [2024-05-26 00:19:02,483: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:19:02.484342090Z [2024-05-26 00:19:02,484: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:19:02.484533088Z [2024-05-26 00:19:02,484: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:19:02.508303223Z [2024-05-26 00:19:02,507: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:19:02.511947983Z [2024-05-26 00:19:02,511: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:19:02.548403002Z [2024-05-26 00:19:02,548: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:19:02.549867032Z [2024-05-26 00:19:02,549: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:19:02.549881624Z [2024-05-26 00:19:02,549: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:19:02.550013756Z [2024-05-26 00:19:02,549: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:19:02.550027596Z [2024-05-26 00:19:02,549: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:19:02.550456094Z [2024-05-26 00:19:02,550: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:19:02.550571559Z [2024-05-26 00:19:02,550: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:19:02.590655077Z [2024-05-26 00:19:02,590: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:19:02.665249608Z [2024-05-26 00:19:02,664: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:19:04.431440186Z [2024-05-26 00:19:04,430: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[724c37d0-1ca0-4a06-a4a8-d1a944756409] succeeded in 3.7284890270002506s: None 2024-05-26T00:19:06.587823425Z [2024-05-26 00:19:06,587: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17997eee-d162-4ed8-8d48-6675ba034ba9] succeeded in 5.873961496999982s: None 2024-05-26T00:20:01.269199512Z [2024-05-26 00:20:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3594a965-7c92-447c-a06b-ea8ca13113fc] received 2024-05-26T00:20:01.272012080Z [2024-05-26 00:20:01,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0725171e-0cf4-431c-b34a-7da6e5c105c5] received 2024-05-26T00:20:01.274059378Z [2024-05-26 00:20:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32049a95-6e38-49c6-8ee1-a037e83d7aed] received 2024-05-26T00:20:01.276942322Z [2024-05-26 00:20:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e93e70cc-e1b1-423e-924b-cdae08d68773] received 2024-05-26T00:20:01.281300764Z [2024-05-26 00:20:01,281: INFO/ForkPoolWorker-1] [32049a95-6e38-49c6-8ee1-a037e83d7aed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:20:01.282127933Z [2024-05-26 00:20:01,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fffdd195-15c2-4c9d-be22-94a91c996ef1] received 2024-05-26T00:20:01.292006327Z [2024-05-26 00:20:01,291: INFO/ForkPoolWorker-15] [3594a965-7c92-447c-a06b-ea8ca13113fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:20:01.293918194Z [2024-05-26 00:20:01,293: INFO/ForkPoolWorker-2] [e93e70cc-e1b1-423e-924b-cdae08d68773] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:20:01.318105897Z [2024-05-26 00:20:01,317: INFO/ForkPoolWorker-16] [0725171e-0cf4-431c-b34a-7da6e5c105c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:20:01.374950078Z [2024-05-26 00:20:01,374: INFO/ForkPoolWorker-3] [fffdd195-15c2-4c9d-be22-94a91c996ef1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:20:01.700115495Z [2024-05-26 00:20:01,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:20:01.704032936Z [2024-05-26 00:20:01,699: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:20:01.780561881Z [2024-05-26 00:20:01,777: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:20:01.907056867Z [2024-05-26 00:20:01,898: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:20:01.996122071Z [2024-05-26 00:20:01,995: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:20:02.108770971Z [2024-05-26 00:20:02,104: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:20:02.470513244Z [2024-05-26 00:20:02,470: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-26T00:20:02.475260451Z [2024-05-26 00:20:02,474: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:20:02.548565038Z [2024-05-26 00:20:02,548: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T00:20:02.555250541Z [2024-05-26 00:20:02,555: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:20:02.555414441Z [2024-05-26 00:20:02,555: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:20:02.555536104Z [2024-05-26 00:20:02,555: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-26T00:20:02.555892778Z [2024-05-26 00:20:02,555: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:20:02.690137951Z [2024-05-26 00:20:02,688: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:20:02.714536764Z [2024-05-26 00:20:02,714: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0725171e-0cf4-431c-b34a-7da6e5c105c5] succeeded in 1.4375780840000516s: None 2024-05-26T00:20:03.442726801Z [2024-05-26 00:20:03,440: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[fffdd195-15c2-4c9d-be22-94a91c996ef1] succeeded in 2.1559109169993462s: None 2024-05-26T00:20:03.576282187Z [2024-05-26 00:20:03,575: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:20:03.579839468Z [2024-05-26 00:20:03,579: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:20:03.589952245Z [2024-05-26 00:20:03,589: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:20:03.592976297Z [2024-05-26 00:20:03,592: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:20:03.634660823Z [2024-05-26 00:20:03,634: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:20:03.638266268Z [2024-05-26 00:20:03,637: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:20:03.638294628Z [2024-05-26 00:20:03,638: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:20:03.638544289Z [2024-05-26 00:20:03,638: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:20:03.638651893Z [2024-05-26 00:20:03,638: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:20:03.639049266Z [2024-05-26 00:20:03,638: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:20:03.639379367Z [2024-05-26 00:20:03,639: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:20:03.649151167Z [2024-05-26 00:20:03,648: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:20:03.653656096Z [2024-05-26 00:20:03,653: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:20:03.653691518Z [2024-05-26 00:20:03,653: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:20:03.654267719Z [2024-05-26 00:20:03,653: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:20:03.654411146Z [2024-05-26 00:20:03,654: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:20:03.654817139Z [2024-05-26 00:20:03,654: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:20:03.654929257Z [2024-05-26 00:20:03,654: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:20:03.763785236Z [2024-05-26 00:20:03,763: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:20:03.771870727Z [2024-05-26 00:20:03,771: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:20:04.055293191Z [2024-05-26 00:20:04,054: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:20:04.060055264Z [2024-05-26 00:20:04,058: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:20:04.082827637Z [2024-05-26 00:20:04,082: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:20:04.086621950Z [2024-05-26 00:20:04,086: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:20:04.086742579Z [2024-05-26 00:20:04,086: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:20:04.086984481Z [2024-05-26 00:20:04,086: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:20:04.087096916Z [2024-05-26 00:20:04,086: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:20:04.087714988Z [2024-05-26 00:20:04,087: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:20:04.087940044Z [2024-05-26 00:20:04,087: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:20:04.225765552Z [2024-05-26 00:20:04,225: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:20:04.832528623Z [2024-05-26 00:20:04,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3594a965-7c92-447c-a06b-ea8ca13113fc] succeeded in 3.5588317860001553s: None 2024-05-26T00:20:05.323147388Z [2024-05-26 00:20:05,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a67a1eeb-89ad-460e-a630-46fe4105fd8b] received 2024-05-26T00:20:05.342096065Z [2024-05-26 00:20:05,341: INFO/ForkPoolWorker-15] [a67a1eeb-89ad-460e-a630-46fe4105fd8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:20:05.846898035Z [2024-05-26 00:20:05,846: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[32049a95-6e38-49c6-8ee1-a037e83d7aed] succeeded in 4.571713934999934s: None 2024-05-26T00:20:05.873384411Z [2024-05-26 00:20:05,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:20:06.554871618Z [2024-05-26 00:20:06,554: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e93e70cc-e1b1-423e-924b-cdae08d68773] succeeded in 5.271403888999885s: None 2024-05-26T00:20:07.082131003Z [2024-05-26 00:20:07,081: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:20:07.085560138Z [2024-05-26 00:20:07,085: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:20:07.118354085Z [2024-05-26 00:20:07,117: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:20:07.120448983Z [2024-05-26 00:20:07,120: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:20:07.120778764Z [2024-05-26 00:20:07,120: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:20:07.121194701Z [2024-05-26 00:20:07,120: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:20:07.121548480Z [2024-05-26 00:20:07,121: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:20:07.122327876Z [2024-05-26 00:20:07,122: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:20:07.122809665Z [2024-05-26 00:20:07,122: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:20:07.238367240Z [2024-05-26 00:20:07,237: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:20:07.920734989Z [2024-05-26 00:20:07,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a67a1eeb-89ad-460e-a630-46fe4105fd8b] succeeded in 2.5921614150001915s: None 2024-05-26T00:20:08.131494961Z [2024-05-26 00:20:08,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6be9b08d-b054-42b8-8d1d-4c0bc8edff7d] received 2024-05-26T00:20:08.139113625Z [2024-05-26 00:20:08,138: INFO/ForkPoolWorker-15] [6be9b08d-b054-42b8-8d1d-4c0bc8edff7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:20:08.470356494Z [2024-05-26 00:20:08,466: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:20:09.643276892Z [2024-05-26 00:20:09,642: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:20:09.646823820Z [2024-05-26 00:20:09,646: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:20:09.680795566Z [2024-05-26 00:20:09,680: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:20:09.682496511Z [2024-05-26 00:20:09,682: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:20:09.682645591Z [2024-05-26 00:20:09,682: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:20:09.682851386Z [2024-05-26 00:20:09,682: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:20:09.682991677Z [2024-05-26 00:20:09,682: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:20:09.683313373Z [2024-05-26 00:20:09,683: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:20:09.683963745Z [2024-05-26 00:20:09,683: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:20:09.865458910Z [2024-05-26 00:20:09,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:20:10.515530588Z [2024-05-26 00:20:10,514: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6be9b08d-b054-42b8-8d1d-4c0bc8edff7d] succeeded in 2.3822874379993664s: None 2024-05-26T00:20:11.182944264Z [2024-05-26 00:20:11,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a0dd9e4-3c14-4b6c-bd2c-a15a358d4d75] received 2024-05-26T00:20:11.193543010Z [2024-05-26 00:20:11,190: INFO/ForkPoolWorker-15] [3a0dd9e4-3c14-4b6c-bd2c-a15a358d4d75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:20:11.504658438Z [2024-05-26 00:20:11,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:20:12.739485418Z [2024-05-26 00:20:12,739: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:20:12.743287009Z [2024-05-26 00:20:12,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:20:12.766958129Z [2024-05-26 00:20:12,766: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:20:12.769102205Z [2024-05-26 00:20:12,768: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:20:12.769373382Z [2024-05-26 00:20:12,769: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:20:12.769749930Z [2024-05-26 00:20:12,769: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:20:12.770004247Z [2024-05-26 00:20:12,769: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:20:12.770600282Z [2024-05-26 00:20:12,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:20:12.770879578Z [2024-05-26 00:20:12,770: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:20:12.858897667Z [2024-05-26 00:20:12,858: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:20:13.455429060Z [2024-05-26 00:20:13,454: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a0dd9e4-3c14-4b6c-bd2c-a15a358d4d75] succeeded in 2.269342071999745s: None 2024-05-26T00:21:00.650428642Z [2024-05-26 00:21:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8131121-3560-4fee-b7c3-8d05f0ce574a] received 2024-05-26T00:21:00.655922284Z [2024-05-26 00:21:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29bb5fe8-3d8e-4625-8459-2c4fd9e8df10] received 2024-05-26T00:21:00.659977719Z [2024-05-26 00:21:00,659: INFO/ForkPoolWorker-15] [e8131121-3560-4fee-b7c3-8d05f0ce574a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:21:00.665222103Z [2024-05-26 00:21:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[567bb9a0-6916-40e5-94b4-4b2f83608113] received 2024-05-26T00:21:00.675737934Z [2024-05-26 00:21:00,675: INFO/ForkPoolWorker-16] [29bb5fe8-3d8e-4625-8459-2c4fd9e8df10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:21:00.680608819Z [2024-05-26 00:21:00,680: INFO/ForkPoolWorker-1] [567bb9a0-6916-40e5-94b4-4b2f83608113] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:21:01.014810881Z [2024-05-26 00:21:01,011: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:21:01.022577523Z [2024-05-26 00:21:01,018: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:21:01.037514358Z [2024-05-26 00:21:01,034: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:21:01.187492423Z [2024-05-26 00:21:01,187: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:21:01.191992624Z [2024-05-26 00:21:01,191: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:21:01.220477339Z [2024-05-26 00:21:01,220: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:21:01.221698671Z [2024-05-26 00:21:01,221: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:21:01.221916198Z [2024-05-26 00:21:01,221: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:21:01.222062515Z [2024-05-26 00:21:01,221: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:21:01.222341428Z [2024-05-26 00:21:01,222: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:21:01.310444050Z [2024-05-26 00:21:01,310: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:21:01.931469669Z [2024-05-26 00:21:01,930: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[567bb9a0-6916-40e5-94b4-4b2f83608113] succeeded in 1.2642161740004667s: None 2024-05-26T00:21:02.153380710Z [2024-05-26 00:21:02,152: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:21:02.156916347Z [2024-05-26 00:21:02,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:21:02.178526794Z [2024-05-26 00:21:02,178: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:21:02.179960784Z [2024-05-26 00:21:02,179: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:21:02.179986257Z [2024-05-26 00:21:02,179: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:21:02.180194481Z [2024-05-26 00:21:02,179: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:21:02.180207776Z [2024-05-26 00:21:02,180: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:21:02.180692704Z [2024-05-26 00:21:02,180: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:21:02.180703318Z [2024-05-26 00:21:02,180: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:21:02.247108335Z [2024-05-26 00:21:02,246: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:21:02.250583643Z [2024-05-26 00:21:02,250: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:21:02.275496887Z [2024-05-26 00:21:02,275: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:21:02.276872150Z [2024-05-26 00:21:02,276: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:21:02.276986947Z [2024-05-26 00:21:02,276: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:21:02.277179759Z [2024-05-26 00:21:02,276: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:21:02.277287981Z [2024-05-26 00:21:02,277: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:21:02.277626228Z [2024-05-26 00:21:02,277: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:21:02.277653708Z [2024-05-26 00:21:02,277: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:21:02.290309714Z [2024-05-26 00:21:02,288: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:21:02.372759531Z [2024-05-26 00:21:02,372: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:21:04.459212525Z [2024-05-26 00:21:04,457: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8131121-3560-4fee-b7c3-8d05f0ce574a] succeeded in 3.8053811250001672s: None 2024-05-26T00:21:04.995191149Z [2024-05-26 00:21:04,994: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29bb5fe8-3d8e-4625-8459-2c4fd9e8df10] succeeded in 4.337667941999825s: None 2024-05-26T00:22:01.302315209Z [2024-05-26 00:22:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1a80749-80ed-459a-af10-ddb72c4c6592] received 2024-05-26T00:22:01.307737794Z [2024-05-26 00:22:01,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41a5bfb1-0e7f-4a2a-8dfa-b7f69bff6d94] received 2024-05-26T00:22:01.310734449Z [2024-05-26 00:22:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2b3f95c-1cd2-47de-95c1-2e07a92757bf] received 2024-05-26T00:22:01.320937850Z [2024-05-26 00:22:01,320: INFO/ForkPoolWorker-1] [d2b3f95c-1cd2-47de-95c1-2e07a92757bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:22:01.324559039Z [2024-05-26 00:22:01,323: INFO/ForkPoolWorker-15] [c1a80749-80ed-459a-af10-ddb72c4c6592] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:22:01.326707223Z [2024-05-26 00:22:01,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3302a96b-7030-45d7-8317-1e5f19b569bc] received 2024-05-26T00:22:01.327454921Z [2024-05-26 00:22:01,327: INFO/ForkPoolWorker-16] [41a5bfb1-0e7f-4a2a-8dfa-b7f69bff6d94] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:22:01.340345740Z [2024-05-26 00:22:01,339: INFO/ForkPoolWorker-2] [3302a96b-7030-45d7-8317-1e5f19b569bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:22:01.659383537Z [2024-05-26 00:22:01,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:22:01.675253174Z [2024-05-26 00:22:01,671: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:22:01.713178039Z [2024-05-26 00:22:01,707: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:22:01.767621414Z [2024-05-26 00:22:01,743: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:22:01.985599740Z [2024-05-26 00:22:01,985: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:22:01.989470549Z [2024-05-26 00:22:01,989: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:22:02.011874025Z [2024-05-26 00:22:02,011: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:22:02.015913724Z [2024-05-26 00:22:02,015: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:22:02.016827263Z [2024-05-26 00:22:02,016: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:22:02.016937395Z [2024-05-26 00:22:02,016: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:22:02.017016298Z [2024-05-26 00:22:02,016: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:22:02.017235863Z [2024-05-26 00:22:02,017: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:22:02.100978517Z [2024-05-26 00:22:02,100: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:22:02.672537396Z [2024-05-26 00:22:02,672: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[41a5bfb1-0e7f-4a2a-8dfa-b7f69bff6d94] succeeded in 1.3618558489997667s: None 2024-05-26T00:22:02.903453828Z [2024-05-26 00:22:02,903: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3302a96b-7030-45d7-8317-1e5f19b569bc] succeeded in 1.572431497999787s: None 2024-05-26T00:22:03.120515283Z [2024-05-26 00:22:03,120: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:22:03.123757536Z [2024-05-26 00:22:03,123: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:22:03.157591208Z [2024-05-26 00:22:03,157: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:22:03.161679841Z [2024-05-26 00:22:03,161: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:22:03.163229574Z [2024-05-26 00:22:03,162: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:22:03.165452382Z [2024-05-26 00:22:03,165: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:22:03.165677022Z [2024-05-26 00:22:03,165: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:22:03.166001801Z [2024-05-26 00:22:03,165: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:22:03.166113057Z [2024-05-26 00:22:03,165: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:22:03.166416179Z [2024-05-26 00:22:03,166: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:22:03.166499253Z [2024-05-26 00:22:03,166: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:22:03.210880838Z [2024-05-26 00:22:03,210: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:22:03.212643520Z [2024-05-26 00:22:03,212: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:22:03.212875940Z [2024-05-26 00:22:03,212: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:22:03.213530954Z [2024-05-26 00:22:03,212: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:22:03.213543109Z [2024-05-26 00:22:03,213: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:22:03.214132135Z [2024-05-26 00:22:03,213: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:22:03.214345116Z [2024-05-26 00:22:03,214: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:22:03.263008947Z [2024-05-26 00:22:03,262: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:22:03.301086392Z [2024-05-26 00:22:03,300: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:22:05.456232740Z [2024-05-26 00:22:05,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1a80749-80ed-459a-af10-ddb72c4c6592] succeeded in 4.150844433000202s: None 2024-05-26T00:22:05.754654600Z [2024-05-26 00:22:05,754: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2b3f95c-1cd2-47de-95c1-2e07a92757bf] succeeded in 4.44140927799981s: None 2024-05-26T00:23:00.325586929Z [2024-05-26 00:23:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29017bfa-9c4d-49cb-b5b8-588a75faef1c] received 2024-05-26T00:23:00.336807165Z [2024-05-26 00:23:00,336: INFO/ForkPoolWorker-15] [29017bfa-9c4d-49cb-b5b8-588a75faef1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:23:00.346078360Z [2024-05-26 00:23:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[888976f6-c545-40b6-a2cd-9ec19fe25a36] received 2024-05-26T00:23:00.351881440Z [2024-05-26 00:23:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8acdf011-cab0-4e3a-af7e-8dd95ed97b3d] received 2024-05-26T00:23:00.361081378Z [2024-05-26 00:23:00,360: INFO/ForkPoolWorker-16] [888976f6-c545-40b6-a2cd-9ec19fe25a36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:23:00.372632166Z [2024-05-26 00:23:00,372: INFO/ForkPoolWorker-1] [8acdf011-cab0-4e3a-af7e-8dd95ed97b3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:23:00.665896505Z [2024-05-26 00:23:00,662: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:23:00.669137690Z [2024-05-26 00:23:00,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:23:00.713366501Z [2024-05-26 00:23:00,709: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:23:00.890287668Z [2024-05-26 00:23:00,889: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:23:00.894692849Z [2024-05-26 00:23:00,894: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:23:00.917843449Z [2024-05-26 00:23:00,917: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:23:00.918849356Z [2024-05-26 00:23:00,918: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:23:00.919029281Z [2024-05-26 00:23:00,918: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:23:00.919170259Z [2024-05-26 00:23:00,919: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:23:00.919434745Z [2024-05-26 00:23:00,919: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:23:01.022546487Z [2024-05-26 00:23:01,022: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:23:01.624927756Z [2024-05-26 00:23:01,624: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8acdf011-cab0-4e3a-af7e-8dd95ed97b3d] succeeded in 1.2668824979991768s: None 2024-05-26T00:23:01.787927462Z [2024-05-26 00:23:01,787: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:23:01.791383038Z [2024-05-26 00:23:01,790: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:23:01.824291697Z [2024-05-26 00:23:01,823: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:23:01.828126502Z [2024-05-26 00:23:01,827: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:23:01.828354989Z [2024-05-26 00:23:01,828: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:23:01.828675606Z [2024-05-26 00:23:01,828: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:23:01.828882270Z [2024-05-26 00:23:01,828: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:23:01.829233986Z [2024-05-26 00:23:01,829: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:23:01.829427240Z [2024-05-26 00:23:01,829: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:23:01.836243620Z [2024-05-26 00:23:01,835: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:23:01.839560226Z [2024-05-26 00:23:01,839: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:23:01.856487510Z [2024-05-26 00:23:01,856: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:23:01.857757704Z [2024-05-26 00:23:01,857: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:23:01.857770209Z [2024-05-26 00:23:01,857: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:23:01.857869212Z [2024-05-26 00:23:01,857: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:23:01.857936160Z [2024-05-26 00:23:01,857: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:23:01.858176267Z [2024-05-26 00:23:01,858: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:23:01.858241941Z [2024-05-26 00:23:01,858: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:23:01.900031072Z [2024-05-26 00:23:01,899: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:23:01.920272539Z [2024-05-26 00:23:01,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:23:03.521402910Z [2024-05-26 00:23:03,520: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29017bfa-9c4d-49cb-b5b8-588a75faef1c] succeeded in 3.1936958320002304s: None 2024-05-26T00:23:03.969308994Z [2024-05-26 00:23:03,968: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[888976f6-c545-40b6-a2cd-9ec19fe25a36] succeeded in 3.6212695100002747s: None 2024-05-26T00:24:00.479281466Z [2024-05-26 00:24:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cdca7b7-5452-4044-a8d6-f149ac93200b] received 2024-05-26T00:24:00.486748205Z [2024-05-26 00:24:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb91d237-5ee3-42a2-b9eb-6ecdac381067] received 2024-05-26T00:24:00.493960965Z [2024-05-26 00:24:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d628985b-e6fe-4603-a20d-c291f31d6b1e] received 2024-05-26T00:24:00.499658420Z [2024-05-26 00:24:00,499: INFO/ForkPoolWorker-15] [3cdca7b7-5452-4044-a8d6-f149ac93200b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:24:00.504146957Z [2024-05-26 00:24:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7ac0c14-1be4-4232-ae78-a74638f67dda] received 2024-05-26T00:24:00.510059685Z [2024-05-26 00:24:00,509: INFO/ForkPoolWorker-16] [cb91d237-5ee3-42a2-b9eb-6ecdac381067] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:24:00.515934360Z [2024-05-26 00:24:00,515: INFO/ForkPoolWorker-1] [d628985b-e6fe-4603-a20d-c291f31d6b1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:24:00.518255026Z [2024-05-26 00:24:00,517: INFO/ForkPoolWorker-2] [b7ac0c14-1be4-4232-ae78-a74638f67dda] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:24:00.901222353Z [2024-05-26 00:24:00,897: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:24:00.916477695Z [2024-05-26 00:24:00,911: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:24:00.919829660Z [2024-05-26 00:24:00,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:24:01.025813367Z [2024-05-26 00:24:01,021: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:24:01.147230034Z [2024-05-26 00:24:01,146: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:24:01.151915867Z [2024-05-26 00:24:01,151: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:24:01.178193292Z [2024-05-26 00:24:01,177: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:24:01.185093863Z [2024-05-26 00:24:01,184: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:24:01.186589429Z [2024-05-26 00:24:01,186: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:24:01.186787721Z [2024-05-26 00:24:01,186: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:24:01.187089633Z [2024-05-26 00:24:01,186: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:24:01.188322967Z [2024-05-26 00:24:01,188: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:24:01.383413646Z [2024-05-26 00:24:01,383: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:24:01.833640923Z [2024-05-26 00:24:01,833: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3cdca7b7-5452-4044-a8d6-f149ac93200b] succeeded in 1.342398882999987s: None 2024-05-26T00:24:02.061896480Z [2024-05-26 00:24:02,061: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b7ac0c14-1be4-4232-ae78-a74638f67dda] succeeded in 1.5545951209996929s: None 2024-05-26T00:24:02.315466791Z [2024-05-26 00:24:02,315: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:24:02.319253536Z [2024-05-26 00:24:02,318: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:24:02.345124657Z [2024-05-26 00:24:02,344: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:24:02.347620607Z [2024-05-26 00:24:02,347: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:24:02.347668580Z [2024-05-26 00:24:02,347: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:24:02.347994981Z [2024-05-26 00:24:02,347: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:24:02.348076922Z [2024-05-26 00:24:02,347: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:24:02.348854278Z [2024-05-26 00:24:02,348: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:24:02.349005587Z [2024-05-26 00:24:02,348: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:24:02.462348320Z [2024-05-26 00:24:02,461: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:24:02.477277375Z [2024-05-26 00:24:02,476: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:24:02.480603851Z [2024-05-26 00:24:02,480: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:24:02.508331960Z [2024-05-26 00:24:02,507: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:24:02.509982219Z [2024-05-26 00:24:02,509: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:24:02.509995519Z [2024-05-26 00:24:02,509: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:24:02.510208548Z [2024-05-26 00:24:02,509: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:24:02.510254617Z [2024-05-26 00:24:02,510: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:24:02.510642339Z [2024-05-26 00:24:02,510: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:24:02.510683186Z [2024-05-26 00:24:02,510: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:24:02.633954641Z [2024-05-26 00:24:02,633: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:24:04.009704818Z [2024-05-26 00:24:04,009: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb91d237-5ee3-42a2-b9eb-6ecdac381067] succeeded in 3.518635794000147s: None 2024-05-26T00:24:04.848938017Z [2024-05-26 00:24:04,848: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d628985b-e6fe-4603-a20d-c291f31d6b1e] succeeded in 4.350291703999574s: None 2024-05-26T00:25:00.506840536Z [2024-05-26 00:25:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[525355ae-4715-43b1-ac5b-437d8631c21d] received 2024-05-26T00:25:00.509044523Z [2024-05-26 00:25:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a478c9bf-273a-458f-b353-ed83ac533110] received 2024-05-26T00:25:00.510808082Z [2024-05-26 00:25:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7952c722-1e69-49a9-b5d0-e50b076b7dba] received 2024-05-26T00:25:00.515881011Z [2024-05-26 00:25:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[741a6fb0-d8dd-47e2-9fae-ef3cce687c96] received 2024-05-26T00:25:00.529641460Z [2024-05-26 00:25:00,529: INFO/ForkPoolWorker-1] [7952c722-1e69-49a9-b5d0-e50b076b7dba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:25:00.531385103Z [2024-05-26 00:25:00,529: INFO/ForkPoolWorker-15] [525355ae-4715-43b1-ac5b-437d8631c21d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:25:00.531590997Z [2024-05-26 00:25:00,531: INFO/ForkPoolWorker-16] [a478c9bf-273a-458f-b353-ed83ac533110] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:25:00.533071493Z [2024-05-26 00:25:00,532: INFO/ForkPoolWorker-2] [741a6fb0-d8dd-47e2-9fae-ef3cce687c96] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:25:00.883130228Z [2024-05-26 00:25:00,880: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:25:00.908547658Z [2024-05-26 00:25:00,904: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:25:00.982295767Z [2024-05-26 00:25:00,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:25:01.021370330Z [2024-05-26 00:25:01,013: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:25:01.109503732Z [2024-05-26 00:25:01,108: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:25:01.118524001Z [2024-05-26 00:25:01,115: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:25:01.160166537Z [2024-05-26 00:25:01,159: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:25:01.166681964Z [2024-05-26 00:25:01,161: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:25:01.166704805Z [2024-05-26 00:25:01,165: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:25:01.166708781Z [2024-05-26 00:25:01,166: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:25:01.166722221Z [2024-05-26 00:25:01,166: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:25:01.256548127Z [2024-05-26 00:25:01,256: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:25:01.806603912Z [2024-05-26 00:25:01,806: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[741a6fb0-d8dd-47e2-9fae-ef3cce687c96] succeeded in 1.2887677429998803s: None 2024-05-26T00:25:02.290864144Z [2024-05-26 00:25:02,290: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:25:02.293973629Z [2024-05-26 00:25:02,293: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:25:02.326162833Z [2024-05-26 00:25:02,325: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:25:02.327388093Z [2024-05-26 00:25:02,327: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:25:02.327504878Z [2024-05-26 00:25:02,327: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:25:02.327783816Z [2024-05-26 00:25:02,327: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:25:02.327867806Z [2024-05-26 00:25:02,327: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:25:02.328434870Z [2024-05-26 00:25:02,328: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:25:02.328515488Z [2024-05-26 00:25:02,328: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:25:02.340457212Z [2024-05-26 00:25:02,340: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:25:02.345019714Z [2024-05-26 00:25:02,344: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:25:02.364163483Z [2024-05-26 00:25:02,363: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:25:02.366841780Z [2024-05-26 00:25:02,366: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:25:02.367590468Z [2024-05-26 00:25:02,367: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:25:02.368386319Z [2024-05-26 00:25:02,368: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:25:02.368489522Z [2024-05-26 00:25:02,368: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:25:02.368650341Z [2024-05-26 00:25:02,368: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:25:02.368748150Z [2024-05-26 00:25:02,368: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:25:02.369030593Z [2024-05-26 00:25:02,368: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:25:02.369173860Z [2024-05-26 00:25:02,368: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:25:02.400429727Z [2024-05-26 00:25:02,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:25:02.403024262Z [2024-05-26 00:25:02,402: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:25:02.403063082Z [2024-05-26 00:25:02,402: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:25:02.403106021Z [2024-05-26 00:25:02,402: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:25:02.403119883Z [2024-05-26 00:25:02,403: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:25:02.403425200Z [2024-05-26 00:25:02,403: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:25:02.403438796Z [2024-05-26 00:25:02,403: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:25:02.411125422Z [2024-05-26 00:25:02,410: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:25:02.450492954Z [2024-05-26 00:25:02,450: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:25:02.505947459Z [2024-05-26 00:25:02,505: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:25:03.146951100Z [2024-05-26 00:25:03,146: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[525355ae-4715-43b1-ac5b-437d8631c21d] succeeded in 2.6301495739999154s: None 2024-05-26T00:25:03.224956967Z [2024-05-26 00:25:03,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a7c4b55-e8c4-498e-af1f-62e6a62a718a] received 2024-05-26T00:25:03.231400371Z [2024-05-26 00:25:03,231: INFO/ForkPoolWorker-15] [2a7c4b55-e8c4-498e-af1f-62e6a62a718a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:25:03.503877428Z [2024-05-26 00:25:03,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:25:03.946362768Z [2024-05-26 00:25:03,945: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7952c722-1e69-49a9-b5d0-e50b076b7dba] succeeded in 3.4265281609996237s: None 2024-05-26T00:25:04.347638051Z [2024-05-26 00:25:04,347: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a478c9bf-273a-458f-b353-ed83ac533110] succeeded in 3.8342040239995185s: None 2024-05-26T00:25:04.825466737Z [2024-05-26 00:25:04,825: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:25:04.829543984Z [2024-05-26 00:25:04,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:25:04.853216263Z [2024-05-26 00:25:04,853: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:25:04.854809963Z [2024-05-26 00:25:04,854: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:25:04.854992011Z [2024-05-26 00:25:04,854: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:25:04.855204753Z [2024-05-26 00:25:04,855: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:25:04.855356424Z [2024-05-26 00:25:04,855: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:25:04.855714931Z [2024-05-26 00:25:04,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:25:04.855879703Z [2024-05-26 00:25:04,855: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:25:04.940767374Z [2024-05-26 00:25:04,940: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:25:05.739933452Z [2024-05-26 00:25:05,737: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2a7c4b55-e8c4-498e-af1f-62e6a62a718a] succeeded in 2.5110244850002346s: None 2024-05-26T00:25:05.801143443Z [2024-05-26 00:25:05,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[857d4586-43c0-408c-a4ef-305f302ee4f9] received 2024-05-26T00:25:05.816405235Z [2024-05-26 00:25:05,816: INFO/ForkPoolWorker-15] [857d4586-43c0-408c-a4ef-305f302ee4f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:25:06.148908246Z [2024-05-26 00:25:06,145: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:25:07.316892048Z [2024-05-26 00:25:07,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:25:07.320246389Z [2024-05-26 00:25:07,319: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:25:07.343877997Z [2024-05-26 00:25:07,343: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:25:07.345807538Z [2024-05-26 00:25:07,345: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:25:07.345982116Z [2024-05-26 00:25:07,345: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:25:07.346357784Z [2024-05-26 00:25:07,346: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:25:07.346556671Z [2024-05-26 00:25:07,346: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:25:07.347244637Z [2024-05-26 00:25:07,346: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:25:07.347969277Z [2024-05-26 00:25:07,346: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:25:07.429574502Z [2024-05-26 00:25:07,429: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:25:08.122300356Z [2024-05-26 00:25:08,121: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[857d4586-43c0-408c-a4ef-305f302ee4f9] succeeded in 2.318956115999754s: None 2024-05-26T00:25:08.206998409Z [2024-05-26 00:25:08,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05689ee8-3421-481c-aa93-44d6013999e2] received 2024-05-26T00:25:08.218506606Z [2024-05-26 00:25:08,218: INFO/ForkPoolWorker-15] [05689ee8-3421-481c-aa93-44d6013999e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:25:08.560538755Z [2024-05-26 00:25:08,557: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:25:09.650861192Z [2024-05-26 00:25:09,650: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:25:09.653811912Z [2024-05-26 00:25:09,653: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:25:09.686150931Z [2024-05-26 00:25:09,685: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:25:09.687863981Z [2024-05-26 00:25:09,687: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:25:09.687895952Z [2024-05-26 00:25:09,687: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:25:09.688084108Z [2024-05-26 00:25:09,687: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:25:09.688142535Z [2024-05-26 00:25:09,688: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:25:09.688590069Z [2024-05-26 00:25:09,688: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:25:09.688676571Z [2024-05-26 00:25:09,688: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:25:09.790181986Z [2024-05-26 00:25:09,789: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:25:10.427028077Z [2024-05-26 00:25:10,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05689ee8-3421-481c-aa93-44d6013999e2] succeeded in 2.217564611999478s: None 2024-05-26T00:26:00.443316276Z [2024-05-26 00:26:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78da93b5-c105-4cad-a8ba-c615f4e86090] received 2024-05-26T00:26:00.447116216Z [2024-05-26 00:26:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[799e892e-b36d-4bfa-a141-1c906276473d] received 2024-05-26T00:26:00.457169163Z [2024-05-26 00:26:00,456: INFO/ForkPoolWorker-15] [78da93b5-c105-4cad-a8ba-c615f4e86090] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:26:00.462519494Z [2024-05-26 00:26:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed6060de-d365-40e7-8ae2-fa2e4ab0f96b] received 2024-05-26T00:26:00.463186312Z [2024-05-26 00:26:00,462: INFO/ForkPoolWorker-16] [799e892e-b36d-4bfa-a141-1c906276473d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:26:00.467085015Z [2024-05-26 00:26:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e588b13-2cd2-46fd-bce7-458382e8a9af] received 2024-05-26T00:26:00.487848930Z [2024-05-26 00:26:00,487: INFO/ForkPoolWorker-1] [ed6060de-d365-40e7-8ae2-fa2e4ab0f96b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:26:00.491402629Z [2024-05-26 00:26:00,491: INFO/ForkPoolWorker-2] [1e588b13-2cd2-46fd-bce7-458382e8a9af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:26:00.874321508Z [2024-05-26 00:26:00,870: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:26:00.880672774Z [2024-05-26 00:26:00,877: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:26:00.902881495Z [2024-05-26 00:26:00,897: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:26:00.938962414Z [2024-05-26 00:26:00,935: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:26:01.091623917Z [2024-05-26 00:26:01,091: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:26:01.096304416Z [2024-05-26 00:26:01,095: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:26:01.126759719Z [2024-05-26 00:26:01,126: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:26:01.129342351Z [2024-05-26 00:26:01,129: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:26:01.129407397Z [2024-05-26 00:26:01,129: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:26:01.129417801Z [2024-05-26 00:26:01,129: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:26:01.129626800Z [2024-05-26 00:26:01,129: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:26:01.147893403Z [2024-05-26 00:26:01,147: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:26:01.233959360Z [2024-05-26 00:26:01,233: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:26:01.844234621Z [2024-05-26 00:26:01,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78da93b5-c105-4cad-a8ba-c615f4e86090] succeeded in 1.3943951409992223s: None 2024-05-26T00:26:01.895799329Z [2024-05-26 00:26:01,895: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1e588b13-2cd2-46fd-bce7-458382e8a9af] succeeded in 1.4224546680006824s: None 2024-05-26T00:26:02.226862618Z [2024-05-26 00:26:02,226: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:26:02.230230878Z [2024-05-26 00:26:02,229: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:26:02.257045164Z [2024-05-26 00:26:02,256: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:26:02.259115139Z [2024-05-26 00:26:02,258: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:26:02.259252693Z [2024-05-26 00:26:02,259: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:26:02.259505184Z [2024-05-26 00:26:02,259: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:26:02.259844039Z [2024-05-26 00:26:02,259: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:26:02.260327496Z [2024-05-26 00:26:02,260: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:26:02.260362466Z [2024-05-26 00:26:02,260: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:26:02.379503795Z [2024-05-26 00:26:02,379: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:26:02.490021072Z [2024-05-26 00:26:02,489: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:26:02.493120983Z [2024-05-26 00:26:02,492: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:26:02.520077959Z [2024-05-26 00:26:02,519: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:26:02.523810067Z [2024-05-26 00:26:02,523: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:26:02.523831431Z [2024-05-26 00:26:02,523: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:26:02.523956780Z [2024-05-26 00:26:02,523: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:26:02.523965331Z [2024-05-26 00:26:02,523: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:26:02.524247772Z [2024-05-26 00:26:02,524: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:26:02.524255472Z [2024-05-26 00:26:02,524: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:26:02.616563232Z [2024-05-26 00:26:02,615: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:26:04.728611659Z [2024-05-26 00:26:04,728: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed6060de-d365-40e7-8ae2-fa2e4ab0f96b] succeeded in 4.258776229999967s: None 2024-05-26T00:26:04.989315317Z [2024-05-26 00:26:04,988: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[799e892e-b36d-4bfa-a141-1c906276473d] succeeded in 4.536357699999826s: None 2024-05-26T00:26:43.459431416Z [2024-05-26 00:26:43,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a3f12ac-c171-4896-b05e-ee4a6405ecfe] received 2024-05-26T00:26:43.469054981Z [2024-05-26 00:26:43,468: INFO/ForkPoolWorker-15] [4a3f12ac-c171-4896-b05e-ee4a6405ecfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:26:43.743056368Z [2024-05-26 00:26:43,740: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:26:43.892372223Z [2024-05-26 00:26:43,891: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T00:26:43.896504887Z [2024-05-26 00:26:43,896: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:26:43.921309313Z [2024-05-26 00:26:43,921: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:26:43.922803053Z [2024-05-26 00:26:43,922: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:26:43.923056935Z [2024-05-26 00:26:43,922: INFO/ForkPoolWorker-15] Read SDNC 70899a71-e430-48c8-a75f-e8e9ee1aa330 (epa_03) 2024-05-26T00:26:43.923330781Z [2024-05-26 00:26:43,923: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '70899a71-e430-48c8-a75f-e8e9ee1aa330', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-05-26T00:26:43.923613497Z [2024-05-26 00:26:43,923: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T00:26:43.923975842Z [2024-05-26 00:26:43,923: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:26:43.932498665Z [2024-05-26 00:26:43,932: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 2024-05-26T00:26:44.042345544Z [2024-05-26 00:26:44,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:26:44.729744482Z [2024-05-26 00:26:44,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a3f12ac-c171-4896-b05e-ee4a6405ecfe] succeeded in 1.2671338009995452s: None 2024-05-26T00:27:00.457841829Z [2024-05-26 00:27:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8319a46b-2f04-474f-99a0-68052addbd00] received 2024-05-26T00:27:00.465306151Z [2024-05-26 00:27:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3f15b21-7926-40b6-9ebd-a416057c24e3] received 2024-05-26T00:27:00.472640435Z [2024-05-26 00:27:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3117aa51-5f7a-4748-8841-a4b28a7509da] received 2024-05-26T00:27:00.482623807Z [2024-05-26 00:27:00,482: INFO/ForkPoolWorker-16] [f3f15b21-7926-40b6-9ebd-a416057c24e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:27:00.482977124Z [2024-05-26 00:27:00,482: INFO/ForkPoolWorker-15] [8319a46b-2f04-474f-99a0-68052addbd00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:27:00.484516652Z [2024-05-26 00:27:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0768efda-3cb6-4039-964e-dec874108ce1] received 2024-05-26T00:27:00.485600405Z [2024-05-26 00:27:00,485: INFO/ForkPoolWorker-1] [3117aa51-5f7a-4748-8841-a4b28a7509da] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:27:00.520456367Z [2024-05-26 00:27:00,520: INFO/ForkPoolWorker-2] [0768efda-3cb6-4039-964e-dec874108ce1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:27:00.849729866Z [2024-05-26 00:27:00,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:27:00.948836560Z [2024-05-26 00:27:00,945: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:27:01.123486787Z [2024-05-26 00:27:01,119: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:27:01.139974797Z [2024-05-26 00:27:01,136: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:27:01.350000392Z [2024-05-26 00:27:01,349: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:27:01.354263994Z [2024-05-26 00:27:01,353: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:27:01.423005599Z [2024-05-26 00:27:01,422: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:27:01.425413485Z [2024-05-26 00:27:01,425: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:27:01.427246493Z [2024-05-26 00:27:01,427: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:27:01.427294802Z [2024-05-26 00:27:01,427: INFO/ForkPoolWorker-2] Read SDNC 70899a71-e430-48c8-a75f-e8e9ee1aa330 (epa_03) 2024-05-26T00:27:01.427480737Z [2024-05-26 00:27:01,427: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '70899a71-e430-48c8-a75f-e8e9ee1aa330', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-05-26T00:27:01.427686801Z [2024-05-26 00:27:01,427: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:27:01.427934804Z [2024-05-26 00:27:01,427: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:27:01.429942241Z [2024-05-26 00:27:01,429: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:27:01.435378056Z [2024-05-26 00:27:01,435: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 2024-05-26T00:27:01.457714709Z [2024-05-26 00:27:01,457: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:27:01.458590043Z [2024-05-26 00:27:01,458: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:27:01.458600831Z [2024-05-26 00:27:01,458: INFO/ForkPoolWorker-1] Read SDNC 70899a71-e430-48c8-a75f-e8e9ee1aa330 (epa_03) 2024-05-26T00:27:01.458715832Z [2024-05-26 00:27:01,458: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '70899a71-e430-48c8-a75f-e8e9ee1aa330', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-05-26T00:27:01.458724485Z [2024-05-26 00:27:01,458: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:27:01.458912193Z [2024-05-26 00:27:01,458: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:27:01.465976038Z [2024-05-26 00:27:01,465: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 2024-05-26T00:27:01.523868270Z [2024-05-26 00:27:01,523: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:27:01.565547242Z [2024-05-26 00:27:01,565: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:27:02.241617283Z [2024-05-26 00:27:02,241: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0768efda-3cb6-4039-964e-dec874108ce1] succeeded in 1.7448831159999827s: None 2024-05-26T00:27:02.418485739Z [2024-05-26 00:27:02,418: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3117aa51-5f7a-4748-8841-a4b28a7509da] succeeded in 1.9426297259997227s: None 2024-05-26T00:27:02.476787623Z [2024-05-26 00:27:02,476: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:27:02.480160128Z [2024-05-26 00:27:02,479: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:27:02.499204472Z [2024-05-26 00:27:02,499: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:27:02.501786854Z [2024-05-26 00:27:02,501: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:27:02.501801060Z [2024-05-26 00:27:02,501: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:27:02.501893953Z [2024-05-26 00:27:02,501: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:27:02.501920958Z [2024-05-26 00:27:02,501: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:27:02.502128994Z [2024-05-26 00:27:02,502: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:27:02.502178434Z [2024-05-26 00:27:02,502: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:27:02.599407519Z [2024-05-26 00:27:02,599: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:27:02.643366401Z [2024-05-26 00:27:02,643: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:27:02.646663765Z [2024-05-26 00:27:02,646: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:27:02.680688164Z [2024-05-26 00:27:02,680: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:27:02.681925984Z [2024-05-26 00:27:02,681: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:27:02.682098254Z [2024-05-26 00:27:02,681: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:27:02.682303545Z [2024-05-26 00:27:02,682: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:27:02.682398896Z [2024-05-26 00:27:02,682: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:27:02.682691868Z [2024-05-26 00:27:02,682: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:27:02.682861153Z [2024-05-26 00:27:02,682: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:27:02.757889622Z [2024-05-26 00:27:02,757: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:27:04.182971894Z [2024-05-26 00:27:04,182: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8319a46b-2f04-474f-99a0-68052addbd00] succeeded in 3.714203358999839s: None 2024-05-26T00:27:05.391147410Z [2024-05-26 00:27:05,390: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3f15b21-7926-40b6-9ebd-a416057c24e3] succeeded in 4.923851905999982s: None 2024-05-26T00:28:01.394179110Z [2024-05-26 00:28:01,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa875bb6-02c8-499f-bcdd-d7596171218c] received 2024-05-26T00:28:01.397418936Z [2024-05-26 00:28:01,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[867f7e11-8542-4a38-9013-1a4a18fac89a] received 2024-05-26T00:28:01.404292811Z [2024-05-26 00:28:01,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d89c4db7-6e0e-4102-b840-cbdb9f2a2c05] received 2024-05-26T00:28:01.405990917Z [2024-05-26 00:28:01,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db4fd833-f849-414b-b6fa-c2f7da0be61b] received 2024-05-26T00:28:01.408681061Z [2024-05-26 00:28:01,408: INFO/ForkPoolWorker-15] [aa875bb6-02c8-499f-bcdd-d7596171218c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:28:01.409648377Z [2024-05-26 00:28:01,409: INFO/ForkPoolWorker-16] [867f7e11-8542-4a38-9013-1a4a18fac89a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:28:01.416576020Z [2024-05-26 00:28:01,416: INFO/ForkPoolWorker-2] [db4fd833-f849-414b-b6fa-c2f7da0be61b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:28:01.421342771Z [2024-05-26 00:28:01,420: INFO/ForkPoolWorker-1] [d89c4db7-6e0e-4102-b840-cbdb9f2a2c05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:28:01.422447643Z [2024-05-26 00:28:01,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92057c4f-cd67-4db2-a6da-fd18cd9650c6] received 2024-05-26T00:28:01.443697653Z [2024-05-26 00:28:01,443: INFO/ForkPoolWorker-3] [92057c4f-cd67-4db2-a6da-fd18cd9650c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:28:01.741001030Z [2024-05-26 00:28:01,737: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:28:01.804046603Z [2024-05-26 00:28:01,800: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:28:01.919635014Z [2024-05-26 00:28:01,919: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T00:28:01.923611901Z [2024-05-26 00:28:01,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:28:01.950884856Z [2024-05-26 00:28:01,950: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:28:01.952063837Z [2024-05-26 00:28:01,951: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:28:01.952291278Z [2024-05-26 00:28:01,952: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:28:01.952453099Z [2024-05-26 00:28:01,952: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T00:28:01.952799292Z [2024-05-26 00:28:01,952: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:28:01.961113199Z [2024-05-26 00:28:01,960: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:28:01.964618493Z [2024-05-26 00:28:01,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:28:01.965908626Z [2024-05-26 00:28:01,965: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T00:28:01.968512886Z [2024-05-26 00:28:01,968: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:28:01.999375895Z [2024-05-26 00:28:01,999: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:28:02.006020034Z [2024-05-26 00:28:02,005: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:28:02.006236152Z [2024-05-26 00:28:02,005: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:28:02.006445271Z [2024-05-26 00:28:02,006: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T00:28:02.006721488Z [2024-05-26 00:28:02,006: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:28:02.010029806Z [2024-05-26 00:28:02,005: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:28:02.010234072Z [2024-05-26 00:28:02,009: ERROR/ForkPoolWorker-15] [aa875bb6-02c8-499f-bcdd-d7596171218c] Failed to execute task Dag 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330' could not be found; either it does not exist or it failed to parse.. 2024-05-26T00:28:02.010242361Z Traceback (most recent call last): 2024-05-26T00:28:02.010246537Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T00:28:02.010250668Z args.func(args) 2024-05-26T00:28:02.010254668Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T00:28:02.010258135Z return func(*args, **kwargs) 2024-05-26T00:28:02.010261144Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T00:28:02.010264245Z return f(*args, **kwargs) 2024-05-26T00:28:02.010267143Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T00:28:02.010270157Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T00:28:02.010273088Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T00:28:02.010276207Z raise AirflowException( 2024-05-26T00:28:02.010279704Z airflow.exceptions.AirflowException: Dag 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330' could not be found; either it does not exist or it failed to parse. 2024-05-26T00:28:02.034274635Z [2024-05-26 00:28:02,033: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa875bb6-02c8-499f-bcdd-d7596171218c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id aa875bb6-02c8-499f-bcdd-d7596171218c') 2024-05-26T00:28:02.034311182Z Traceback (most recent call last): 2024-05-26T00:28:02.034322252Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T00:28:02.034325465Z R = retval = fun(*args, **kwargs) 2024-05-26T00:28:02.034328447Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T00:28:02.034331790Z return self.run(*args, **kwargs) 2024-05-26T00:28:02.034335469Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T00:28:02.034338848Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T00:28:02.034341736Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T00:28:02.034345182Z raise AirflowException(msg) 2024-05-26T00:28:02.034348965Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id aa875bb6-02c8-499f-bcdd-d7596171218c 2024-05-26T00:28:02.059172877Z [2024-05-26 00:28:02,055: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:28:02.088066010Z [2024-05-26 00:28:02,084: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:28:02.321155788Z [2024-05-26 00:28:02,320: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:28:02.325818040Z [2024-05-26 00:28:02,325: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:28:02.356456015Z [2024-05-26 00:28:02,356: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:28:02.357821019Z [2024-05-26 00:28:02,357: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:28:02.357950744Z [2024-05-26 00:28:02,357: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:28:02.358054893Z [2024-05-26 00:28:02,357: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:28:02.358388386Z [2024-05-26 00:28:02,358: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:28:02.389879881Z [2024-05-26 00:28:02,389: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:28:02.537679731Z [2024-05-26 00:28:02,537: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:28:03.284595666Z [2024-05-26 00:28:03,284: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[db4fd833-f849-414b-b6fa-c2f7da0be61b] succeeded in 1.8751710489996185s: None 2024-05-26T00:28:03.394243720Z [2024-05-26 00:28:03,391: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[867f7e11-8542-4a38-9013-1a4a18fac89a] succeeded in 1.9901010119992861s: None 2024-05-26T00:28:03.602821996Z [2024-05-26 00:28:03,602: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T00:28:03.606059226Z [2024-05-26 00:28:03,605: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:28:03.653755515Z [2024-05-26 00:28:03,653: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T00:28:03.660227376Z [2024-05-26 00:28:03,659: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:28:03.661543888Z [2024-05-26 00:28:03,660: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:28:03.661882710Z [2024-05-26 00:28:03,661: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:28:03.662106378Z [2024-05-26 00:28:03,661: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T00:28:03.664221811Z [2024-05-26 00:28:03,664: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:28:03.664344587Z [2024-05-26 00:28:03,664: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:28:03.802812608Z [2024-05-26 00:28:03,802: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:28:03.808990242Z [2024-05-26 00:28:03,808: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:28:03.812979517Z [2024-05-26 00:28:03,812: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:28:03.904757314Z [2024-05-26 00:28:03,904: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:28:03.912878918Z [2024-05-26 00:28:03,912: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:28:03.913065491Z [2024-05-26 00:28:03,912: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:28:03.913278247Z [2024-05-26 00:28:03,913: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:28:03.913437170Z [2024-05-26 00:28:03,913: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:28:03.913842625Z [2024-05-26 00:28:03,913: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:28:03.919030089Z [2024-05-26 00:28:03,918: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:28:04.024221889Z [2024-05-26 00:28:04,023: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:28:05.716979744Z [2024-05-26 00:28:05,716: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d89c4db7-6e0e-4102-b840-cbdb9f2a2c05] succeeded in 4.309457274000124s: None 2024-05-26T00:28:05.932511200Z [2024-05-26 00:28:05,931: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[92057c4f-cd67-4db2-a6da-fd18cd9650c6] succeeded in 4.504653064000195s: None 2024-05-26T00:28:13.208363000Z [2024-05-26 00:28:13,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a36401ab-12d4-4501-8c10-5b085f12c125] received 2024-05-26T00:28:13.214788388Z [2024-05-26 00:28:13,214: INFO/ForkPoolWorker-15] [a36401ab-12d4-4501-8c10-5b085f12c125] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:28:13.520377516Z [2024-05-26 00:28:13,517: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:28:13.667330908Z [2024-05-26 00:28:13,666: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T00:28:13.671310020Z [2024-05-26 00:28:13,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:28:13.699510287Z [2024-05-26 00:28:13,699: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:28:13.701400813Z [2024-05-26 00:28:13,701: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:28:13.701551713Z [2024-05-26 00:28:13,701: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:28:13.701688689Z [2024-05-26 00:28:13,701: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T00:28:13.702103491Z [2024-05-26 00:28:13,701: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:28:13.713855390Z [2024-05-26 00:28:13,713: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:28:13.714056861Z [2024-05-26 00:28:13,713: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:28:13.715038509Z [2024-05-26 00:28:13,714: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T00:28:13.718404215Z [2024-05-26 00:28:13,718: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:28:13.735783205Z [2024-05-26 00:28:13,735: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:28:13.738152754Z [2024-05-26 00:28:13,737: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:28:13.738375685Z [2024-05-26 00:28:13,738: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:28:13.738550706Z [2024-05-26 00:28:13,738: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T00:28:13.739852675Z [2024-05-26 00:28:13,738: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:28:13.748594531Z [2024-05-26 00:28:13,746: ERROR/ForkPoolWorker-15] [a36401ab-12d4-4501-8c10-5b085f12c125] Failed to execute task Dag 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330' could not be found; either it does not exist or it failed to parse.. 2024-05-26T00:28:13.748624798Z Traceback (most recent call last): 2024-05-26T00:28:13.748632679Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T00:28:13.748639893Z args.func(args) 2024-05-26T00:28:13.748647166Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T00:28:13.748654605Z return func(*args, **kwargs) 2024-05-26T00:28:13.748660958Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T00:28:13.748667306Z return f(*args, **kwargs) 2024-05-26T00:28:13.748673631Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T00:28:13.748680000Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T00:28:13.748686418Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T00:28:13.748692761Z raise AirflowException( 2024-05-26T00:28:13.748701071Z airflow.exceptions.AirflowException: Dag 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330' could not be found; either it does not exist or it failed to parse. 2024-05-26T00:28:13.780913462Z [2024-05-26 00:28:13,780: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a36401ab-12d4-4501-8c10-5b085f12c125] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a36401ab-12d4-4501-8c10-5b085f12c125') 2024-05-26T00:28:13.780972994Z Traceback (most recent call last): 2024-05-26T00:28:13.780983945Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T00:28:13.780992466Z R = retval = fun(*args, **kwargs) 2024-05-26T00:28:13.781000736Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T00:28:13.781008896Z return self.run(*args, **kwargs) 2024-05-26T00:28:13.781017842Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T00:28:13.781027397Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T00:28:13.781035576Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T00:28:13.781044378Z raise AirflowException(msg) 2024-05-26T00:28:13.781055553Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a36401ab-12d4-4501-8c10-5b085f12c125 2024-05-26T00:29:01.352697524Z [2024-05-26 00:29:01,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[399618b8-6819-449c-bc71-5c9e53172695] received 2024-05-26T00:29:01.354368792Z [2024-05-26 00:29:01,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fbe8b63-55c2-487e-b05f-909bfa71ddb9] received 2024-05-26T00:29:01.355786337Z [2024-05-26 00:29:01,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[253fbd6e-d178-45ff-86aa-6bf291e02dd7] received 2024-05-26T00:29:01.358241332Z [2024-05-26 00:29:01,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02147c0a-1fe4-4d67-b562-9f796be243ce] received 2024-05-26T00:29:01.374683590Z [2024-05-26 00:29:01,374: INFO/ForkPoolWorker-1] [253fbd6e-d178-45ff-86aa-6bf291e02dd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:29:01.375403247Z [2024-05-26 00:29:01,375: INFO/ForkPoolWorker-16] [3fbe8b63-55c2-487e-b05f-909bfa71ddb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:29:01.376158480Z [2024-05-26 00:29:01,375: INFO/ForkPoolWorker-15] [399618b8-6819-449c-bc71-5c9e53172695] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:29:01.376310623Z [2024-05-26 00:29:01,375: INFO/ForkPoolWorker-2] [02147c0a-1fe4-4d67-b562-9f796be243ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:29:01.669748305Z [2024-05-26 00:29:01,666: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:29:01.706850496Z [2024-05-26 00:29:01,701: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:29:01.776026417Z [2024-05-26 00:29:01,771: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:29:01.788681677Z [2024-05-26 00:29:01,785: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:29:01.958415891Z [2024-05-26 00:29:01,957: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:29:01.962129532Z [2024-05-26 00:29:01,961: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:29:01.988854583Z [2024-05-26 00:29:01,988: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:29:01.989650070Z [2024-05-26 00:29:01,989: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:29:01.989718451Z [2024-05-26 00:29:01,989: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:29:01.989799679Z [2024-05-26 00:29:01,989: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:29:01.990016684Z [2024-05-26 00:29:01,989: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:29:02.003208751Z [2024-05-26 00:29:01,999: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:29:02.008503923Z [2024-05-26 00:29:02,008: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:29:02.038877788Z [2024-05-26 00:29:02,038: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:29:02.043117458Z [2024-05-26 00:29:02,039: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:29:02.043361664Z [2024-05-26 00:29:02,043: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:29:02.043556476Z [2024-05-26 00:29:02,043: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:29:02.044080784Z [2024-05-26 00:29:02,043: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:29:02.058076599Z [2024-05-26 00:29:02,057: WARNING/ForkPoolWorker-1] Dag 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:29:02.058524362Z [2024-05-26 00:29:02,058: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:29:02.059395895Z [2024-05-26 00:29:02,059: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:29:02.062214777Z [2024-05-26 00:29:02,061: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:29:02.091571049Z [2024-05-26 00:29:02,091: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:29:02.092973946Z [2024-05-26 00:29:02,092: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:29:02.093217492Z [2024-05-26 00:29:02,092: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:29:02.093494595Z [2024-05-26 00:29:02,093: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:29:02.093897619Z [2024-05-26 00:29:02,093: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:29:02.098389055Z [2024-05-26 00:29:02,097: ERROR/ForkPoolWorker-1] [253fbd6e-d178-45ff-86aa-6bf291e02dd7] Failed to execute task Dag 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330' could not be found; either it does not exist or it failed to parse.. 2024-05-26T00:29:02.098407631Z Traceback (most recent call last): 2024-05-26T00:29:02.098411900Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T00:29:02.098435731Z args.func(args) 2024-05-26T00:29:02.098440551Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T00:29:02.098444808Z return func(*args, **kwargs) 2024-05-26T00:29:02.098448328Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T00:29:02.098451830Z return f(*args, **kwargs) 2024-05-26T00:29:02.098455196Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T00:29:02.098458546Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T00:29:02.098461813Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T00:29:02.098465651Z raise AirflowException( 2024-05-26T00:29:02.098469546Z airflow.exceptions.AirflowException: Dag 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330' could not be found; either it does not exist or it failed to parse. 2024-05-26T00:29:02.111906253Z [2024-05-26 00:29:02,111: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:29:02.120866563Z [2024-05-26 00:29:02,120: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[253fbd6e-d178-45ff-86aa-6bf291e02dd7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 253fbd6e-d178-45ff-86aa-6bf291e02dd7') 2024-05-26T00:29:02.120909993Z Traceback (most recent call last): 2024-05-26T00:29:02.120916864Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T00:29:02.120920459Z R = retval = fun(*args, **kwargs) 2024-05-26T00:29:02.120923921Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T00:29:02.120927622Z return self.run(*args, **kwargs) 2024-05-26T00:29:02.120931651Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T00:29:02.120935608Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T00:29:02.120938951Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T00:29:02.120943557Z raise AirflowException(msg) 2024-05-26T00:29:02.120947550Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 253fbd6e-d178-45ff-86aa-6bf291e02dd7 2024-05-26T00:29:02.762950872Z [2024-05-26 00:29:02,762: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[02147c0a-1fe4-4d67-b562-9f796be243ce] succeeded in 1.4024529360003726s: None 2024-05-26T00:29:02.885546551Z [2024-05-26 00:29:02,885: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:29:02.888731759Z [2024-05-26 00:29:02,888: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:29:02.916625537Z [2024-05-26 00:29:02,916: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:29:02.920500008Z [2024-05-26 00:29:02,920: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:29:02.921570117Z [2024-05-26 00:29:02,920: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:29:02.921879669Z [2024-05-26 00:29:02,921: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:29:02.922050553Z [2024-05-26 00:29:02,921: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:29:02.922443064Z [2024-05-26 00:29:02,922: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:29:02.923776929Z [2024-05-26 00:29:02,922: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:29:02.953029897Z [2024-05-26 00:29:02,952: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:29:02.955994514Z [2024-05-26 00:29:02,955: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:29:02.984342302Z [2024-05-26 00:29:02,984: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:29:02.987413136Z [2024-05-26 00:29:02,987: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:29:02.987500408Z [2024-05-26 00:29:02,987: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:29:02.987689683Z [2024-05-26 00:29:02,987: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:29:02.987767751Z [2024-05-26 00:29:02,987: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:29:02.988019916Z [2024-05-26 00:29:02,987: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:29:02.988116059Z [2024-05-26 00:29:02,988: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:29:03.020137573Z [2024-05-26 00:29:03,019: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:29:03.092364725Z [2024-05-26 00:29:03,092: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:29:04.893386228Z [2024-05-26 00:29:04,892: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3fbe8b63-55c2-487e-b05f-909bfa71ddb9] succeeded in 3.5366075500005536s: None 2024-05-26T00:29:05.305447009Z [2024-05-26 00:29:05,304: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[399618b8-6819-449c-bc71-5c9e53172695] succeeded in 3.94890100900011s: None 2024-05-26T00:30:00.350329653Z [2024-05-26 00:30:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1dd91c0-3706-4bee-8e4f-c4aae978dc2a] received 2024-05-26T00:30:00.352824763Z [2024-05-26 00:30:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a15312f4-c3a5-420f-b809-ed34930e7643] received 2024-05-26T00:30:00.362973258Z [2024-05-26 00:30:00,362: INFO/ForkPoolWorker-16] [a15312f4-c3a5-420f-b809-ed34930e7643] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:30:00.368388182Z [2024-05-26 00:30:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4b1214f-a19f-4e90-9993-c04754a3fd83] received 2024-05-26T00:30:00.373412645Z [2024-05-26 00:30:00,373: INFO/ForkPoolWorker-15] [d1dd91c0-3706-4bee-8e4f-c4aae978dc2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:30:00.380714733Z [2024-05-26 00:30:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf1f43c8-6420-4457-b5cf-63e32a8e6f2c] received 2024-05-26T00:30:00.384361716Z [2024-05-26 00:30:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1063b9b6-f6fa-425f-b4bf-6b218d4bcd70] received 2024-05-26T00:30:00.390384180Z [2024-05-26 00:30:00,389: INFO/ForkPoolWorker-2] [cf1f43c8-6420-4457-b5cf-63e32a8e6f2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:30:00.394006151Z [2024-05-26 00:30:00,393: INFO/ForkPoolWorker-1] [d4b1214f-a19f-4e90-9993-c04754a3fd83] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:30:00.400630987Z [2024-05-26 00:30:00,400: INFO/ForkPoolWorker-3] [1063b9b6-f6fa-425f-b4bf-6b218d4bcd70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:30:00.690127339Z [2024-05-26 00:30:00,685: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:30:00.814785124Z [2024-05-26 00:30:00,800: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:30:00.866784906Z [2024-05-26 00:30:00,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:30:00.881381925Z [2024-05-26 00:30:00,874: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:30:00.916623682Z [2024-05-26 00:30:00,897: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:30:01.226226865Z [2024-05-26 00:30:01,225: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:30:01.249642851Z [2024-05-26 00:30:01,249: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:30:01.262557548Z [2024-05-26 00:30:01,262: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:30:01.325402669Z [2024-05-26 00:30:01,325: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:30:01.328277325Z [2024-05-26 00:30:01,328: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:30:01.328397311Z [2024-05-26 00:30:01,328: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:30:01.328453262Z [2024-05-26 00:30:01,328: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:30:01.328634319Z [2024-05-26 00:30:01,328: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:30:01.468324438Z [2024-05-26 00:30:01,468: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:30:01.912476245Z [2024-05-26 00:30:01,912: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a15312f4-c3a5-420f-b809-ed34930e7643] succeeded in 1.5575106710002729s: None 2024-05-26T00:30:02.059898952Z [2024-05-26 00:30:02,059: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d4b1214f-a19f-4e90-9993-c04754a3fd83] succeeded in 1.6892614250000406s: None 2024-05-26T00:30:02.155069767Z [2024-05-26 00:30:02,154: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T00:30:02.158319499Z [2024-05-26 00:30:02,157: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:30:02.188750118Z [2024-05-26 00:30:02,188: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T00:30:02.192455479Z [2024-05-26 00:30:02,191: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:30:02.192841928Z [2024-05-26 00:30:02,192: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:30:02.193318202Z [2024-05-26 00:30:02,192: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:30:02.193577407Z [2024-05-26 00:30:02,193: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T00:30:02.194160279Z [2024-05-26 00:30:02,193: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:30:02.194552972Z [2024-05-26 00:30:02,194: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:30:02.294096844Z [2024-05-26 00:30:02,293: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:30:02.388972173Z [2024-05-26 00:30:02,388: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:30:02.392237253Z [2024-05-26 00:30:02,391: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:30:02.409902719Z [2024-05-26 00:30:02,409: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:30:02.411150716Z [2024-05-26 00:30:02,410: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:30:02.411303789Z [2024-05-26 00:30:02,411: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:30:02.411513126Z [2024-05-26 00:30:02,411: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:30:02.411775513Z [2024-05-26 00:30:02,411: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:30:02.412056955Z [2024-05-26 00:30:02,411: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:30:02.412612299Z [2024-05-26 00:30:02,412: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:30:02.490171699Z [2024-05-26 00:30:02,489: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:30:02.503969824Z [2024-05-26 00:30:02,503: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:30:02.507186451Z [2024-05-26 00:30:02,506: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:30:02.533621925Z [2024-05-26 00:30:02,533: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:30:02.534622243Z [2024-05-26 00:30:02,534: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:30:02.534657286Z [2024-05-26 00:30:02,534: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:30:02.534762991Z [2024-05-26 00:30:02,534: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:30:02.534840018Z [2024-05-26 00:30:02,534: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:30:02.535104316Z [2024-05-26 00:30:02,534: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:30:02.535204403Z [2024-05-26 00:30:02,535: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:30:02.606088419Z [2024-05-26 00:30:02,605: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:30:03.194891615Z [2024-05-26 00:30:03,194: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1dd91c0-3706-4bee-8e4f-c4aae978dc2a] succeeded in 2.8408900639997228s: None 2024-05-26T00:30:03.389935668Z [2024-05-26 00:30:03,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79acf268-3d2f-4f40-a25e-ea932387810c] received 2024-05-26T00:30:03.419842315Z [2024-05-26 00:30:03,417: INFO/ForkPoolWorker-15] [79acf268-3d2f-4f40-a25e-ea932387810c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:30:03.742315124Z [2024-05-26 00:30:03,739: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:30:03.800773203Z [2024-05-26 00:30:03,800: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1063b9b6-f6fa-425f-b4bf-6b218d4bcd70] succeeded in 3.4138891950005927s: None 2024-05-26T00:30:04.340682560Z [2024-05-26 00:30:04,340: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cf1f43c8-6420-4457-b5cf-63e32a8e6f2c] succeeded in 3.958080520999829s: None 2024-05-26T00:30:05.182496242Z [2024-05-26 00:30:05,182: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:30:05.187089730Z [2024-05-26 00:30:05,186: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:30:05.213976618Z [2024-05-26 00:30:05,213: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:30:05.215439982Z [2024-05-26 00:30:05,215: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:30:05.215689042Z [2024-05-26 00:30:05,215: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:30:05.215897943Z [2024-05-26 00:30:05,215: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:30:05.216051445Z [2024-05-26 00:30:05,215: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:30:05.216650317Z [2024-05-26 00:30:05,216: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:30:05.216842242Z [2024-05-26 00:30:05,216: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:30:05.303423198Z [2024-05-26 00:30:05,303: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:30:05.967624906Z [2024-05-26 00:30:05,967: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79acf268-3d2f-4f40-a25e-ea932387810c] succeeded in 2.5663864620000822s: None 2024-05-26T00:30:06.071736371Z [2024-05-26 00:30:06,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc9859f1-0334-4a46-9a99-075e73d66978] received 2024-05-26T00:30:06.080775055Z [2024-05-26 00:30:06,080: INFO/ForkPoolWorker-15] [bc9859f1-0334-4a46-9a99-075e73d66978] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:30:06.463700304Z [2024-05-26 00:30:06,456: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:30:07.595187788Z [2024-05-26 00:30:07,594: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:30:07.598375991Z [2024-05-26 00:30:07,597: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:30:07.621474029Z [2024-05-26 00:30:07,621: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:30:07.625736458Z [2024-05-26 00:30:07,625: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:30:07.626559437Z [2024-05-26 00:30:07,626: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:30:07.627284352Z [2024-05-26 00:30:07,626: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:30:07.627707511Z [2024-05-26 00:30:07,627: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:30:07.628436253Z [2024-05-26 00:30:07,628: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:30:07.628834202Z [2024-05-26 00:30:07,628: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:30:07.718786336Z [2024-05-26 00:30:07,718: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:30:08.307958462Z [2024-05-26 00:30:08,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc9859f1-0334-4a46-9a99-075e73d66978] succeeded in 2.2338148930002717s: None 2024-05-26T00:30:08.492639393Z [2024-05-26 00:30:08,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1adfffe-5189-4570-862d-e9900410cedc] received 2024-05-26T00:30:08.504753589Z [2024-05-26 00:30:08,504: INFO/ForkPoolWorker-15] [c1adfffe-5189-4570-862d-e9900410cedc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:30:08.842022541Z [2024-05-26 00:30:08,839: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:30:09.927204462Z [2024-05-26 00:30:09,926: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:30:09.930540666Z [2024-05-26 00:30:09,930: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:30:09.955368863Z [2024-05-26 00:30:09,955: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:30:09.956952588Z [2024-05-26 00:30:09,956: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:30:09.957060930Z [2024-05-26 00:30:09,956: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:30:09.957240308Z [2024-05-26 00:30:09,957: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:30:09.957344686Z [2024-05-26 00:30:09,957: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:30:09.957659023Z [2024-05-26 00:30:09,957: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:30:09.957778283Z [2024-05-26 00:30:09,957: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:30:10.074464824Z [2024-05-26 00:30:10,074: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:30:10.653461359Z [2024-05-26 00:30:10,653: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1adfffe-5189-4570-862d-e9900410cedc] succeeded in 2.1559622739996485s: None 2024-05-26T00:31:01.279868103Z [2024-05-26 00:31:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[014406ff-fd73-49b0-9fbb-d0d8907001d1] received 2024-05-26T00:31:01.286184047Z [2024-05-26 00:31:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28ce5687-edbb-4da4-a591-33b9cf65f0c5] received 2024-05-26T00:31:01.288872329Z [2024-05-26 00:31:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1206c425-20c9-4199-833c-288b7579fe60] received 2024-05-26T00:31:01.307089740Z [2024-05-26 00:31:01,306: INFO/ForkPoolWorker-1] [1206c425-20c9-4199-833c-288b7579fe60] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:31:01.315399635Z [2024-05-26 00:31:01,315: INFO/ForkPoolWorker-15] [014406ff-fd73-49b0-9fbb-d0d8907001d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:31:01.316004789Z [2024-05-26 00:31:01,315: INFO/ForkPoolWorker-16] [28ce5687-edbb-4da4-a591-33b9cf65f0c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:31:01.614018863Z [2024-05-26 00:31:01,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:31:01.634733493Z [2024-05-26 00:31:01,631: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:31:01.648644239Z [2024-05-26 00:31:01,630: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:31:01.786089558Z [2024-05-26 00:31:01,785: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:31:01.790236462Z [2024-05-26 00:31:01,789: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:31:01.818431594Z [2024-05-26 00:31:01,818: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:31:01.819596669Z [2024-05-26 00:31:01,819: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:31:01.819709077Z [2024-05-26 00:31:01,819: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:31:01.819810512Z [2024-05-26 00:31:01,819: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:31:01.820091549Z [2024-05-26 00:31:01,819: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:31:01.920267042Z [2024-05-26 00:31:01,919: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:31:02.580830144Z [2024-05-26 00:31:02,580: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1206c425-20c9-4199-833c-288b7579fe60] succeeded in 1.2830104270005904s: None 2024-05-26T00:31:02.757390349Z [2024-05-26 00:31:02,756: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:31:02.760476530Z [2024-05-26 00:31:02,759: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:31:02.803605998Z [2024-05-26 00:31:02,803: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:31:02.806797286Z [2024-05-26 00:31:02,806: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:31:02.806950483Z [2024-05-26 00:31:02,806: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:31:02.807329168Z [2024-05-26 00:31:02,806: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:31:02.807753336Z [2024-05-26 00:31:02,807: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:31:02.808363709Z [2024-05-26 00:31:02,808: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:31:02.808618661Z [2024-05-26 00:31:02,808: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:31:02.932796384Z [2024-05-26 00:31:02,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:31:03.055936236Z [2024-05-26 00:31:03,055: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:31:03.059126510Z [2024-05-26 00:31:03,058: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:31:03.077854901Z [2024-05-26 00:31:03,077: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:31:03.079029355Z [2024-05-26 00:31:03,078: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:31:03.079050712Z [2024-05-26 00:31:03,078: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:31:03.079150124Z [2024-05-26 00:31:03,078: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:31:03.079163667Z [2024-05-26 00:31:03,079: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:31:03.079435508Z [2024-05-26 00:31:03,079: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:31:03.079445459Z [2024-05-26 00:31:03,079: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:31:03.183099158Z [2024-05-26 00:31:03,179: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:31:04.712729818Z [2024-05-26 00:31:04,712: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[28ce5687-edbb-4da4-a591-33b9cf65f0c5] succeeded in 3.423777674000121s: None 2024-05-26T00:31:06.272397247Z [2024-05-26 00:31:06,271: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[014406ff-fd73-49b0-9fbb-d0d8907001d1] succeeded in 4.990096890000132s: None 2024-05-26T00:32:00.423392306Z [2024-05-26 00:32:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[939815b1-4cad-4937-b794-e2b400699c97] received 2024-05-26T00:32:00.426730472Z [2024-05-26 00:32:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c31d2c9-d9d7-42d2-ab5d-f855be4a6fda] received 2024-05-26T00:32:00.448145939Z [2024-05-26 00:32:00,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2acf9643-0139-4619-b154-c383caf7c628] received 2024-05-26T00:32:00.449844617Z [2024-05-26 00:32:00,449: INFO/ForkPoolWorker-16] [3c31d2c9-d9d7-42d2-ab5d-f855be4a6fda] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:32:00.450762698Z [2024-05-26 00:32:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9775e1d-7533-4a0f-af9e-922bc5345b15] received 2024-05-26T00:32:00.457245611Z [2024-05-26 00:32:00,453: INFO/ForkPoolWorker-15] [939815b1-4cad-4937-b794-e2b400699c97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:32:00.460610648Z [2024-05-26 00:32:00,460: INFO/ForkPoolWorker-1] [2acf9643-0139-4619-b154-c383caf7c628] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:32:00.469897525Z [2024-05-26 00:32:00,469: INFO/ForkPoolWorker-2] [c9775e1d-7533-4a0f-af9e-922bc5345b15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:32:00.781307432Z [2024-05-26 00:32:00,774: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:32:00.867211074Z [2024-05-26 00:32:00,863: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:32:00.871594922Z [2024-05-26 00:32:00,868: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:32:00.875072492Z [2024-05-26 00:32:00,871: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:32:01.076416782Z [2024-05-26 00:32:01,075: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:32:01.080518102Z [2024-05-26 00:32:01,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:32:01.112604674Z [2024-05-26 00:32:01,112: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:32:01.114647370Z [2024-05-26 00:32:01,114: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:32:01.114714294Z [2024-05-26 00:32:01,114: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:32:01.114743394Z [2024-05-26 00:32:01,114: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:32:01.114928322Z [2024-05-26 00:32:01,114: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:32:01.185173723Z [2024-05-26 00:32:01,184: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:32:01.239334952Z [2024-05-26 00:32:01,239: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:32:01.707296293Z [2024-05-26 00:32:01,706: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3c31d2c9-d9d7-42d2-ab5d-f855be4a6fda] succeeded in 1.2714476840001225s: None 2024-05-26T00:32:01.876180540Z [2024-05-26 00:32:01,875: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2acf9643-0139-4619-b154-c383caf7c628] succeeded in 1.425395485000081s: None 2024-05-26T00:32:02.087141893Z [2024-05-26 00:32:02,086: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:32:02.090347257Z [2024-05-26 00:32:02,089: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:32:02.111990981Z [2024-05-26 00:32:02,111: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:32:02.113388275Z [2024-05-26 00:32:02,113: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:32:02.113401670Z [2024-05-26 00:32:02,113: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:32:02.113537208Z [2024-05-26 00:32:02,113: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:32:02.113569522Z [2024-05-26 00:32:02,113: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:32:02.113790609Z [2024-05-26 00:32:02,113: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:32:02.113828790Z [2024-05-26 00:32:02,113: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:32:02.191206116Z [2024-05-26 00:32:02,190: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:32:02.194825078Z [2024-05-26 00:32:02,194: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:32:02.216233827Z [2024-05-26 00:32:02,216: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:32:02.219327009Z [2024-05-26 00:32:02,219: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:32:02.220483472Z [2024-05-26 00:32:02,220: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:32:02.220721643Z [2024-05-26 00:32:02,220: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:32:02.220956510Z [2024-05-26 00:32:02,220: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:32:02.221138220Z [2024-05-26 00:32:02,221: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:32:02.221501530Z [2024-05-26 00:32:02,221: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:32:02.221690373Z [2024-05-26 00:32:02,221: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:32:02.305222535Z [2024-05-26 00:32:02,304: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:32:03.921051160Z [2024-05-26 00:32:03,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[939815b1-4cad-4937-b794-e2b400699c97] succeeded in 3.4910651209993375s: None 2024-05-26T00:32:04.146058984Z [2024-05-26 00:32:04,145: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c9775e1d-7533-4a0f-af9e-922bc5345b15] succeeded in 3.692750416000308s: None 2024-05-26T00:33:00.406497932Z [2024-05-26 00:33:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6a465b4-44ad-49cf-8475-549babe20c85] received 2024-05-26T00:33:00.409306045Z [2024-05-26 00:33:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7e77ade-c44d-4efc-bc0a-027e2e402f19] received 2024-05-26T00:33:00.418503208Z [2024-05-26 00:33:00,418: INFO/ForkPoolWorker-16] [b7e77ade-c44d-4efc-bc0a-027e2e402f19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:33:00.419876261Z [2024-05-26 00:33:00,419: INFO/ForkPoolWorker-15] [a6a465b4-44ad-49cf-8475-549babe20c85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:33:00.420106985Z [2024-05-26 00:33:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9191f47-9600-4935-83b0-4da7f5f6029a] received 2024-05-26T00:33:00.436665859Z [2024-05-26 00:33:00,436: INFO/ForkPoolWorker-1] [e9191f47-9600-4935-83b0-4da7f5f6029a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:33:00.779739786Z [2024-05-26 00:33:00,774: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:33:00.783800463Z [2024-05-26 00:33:00,780: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:33:00.831610720Z [2024-05-26 00:33:00,828: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:33:00.946228566Z [2024-05-26 00:33:00,945: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:33:00.950284451Z [2024-05-26 00:33:00,949: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:33:00.984844931Z [2024-05-26 00:33:00,984: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:33:00.986334635Z [2024-05-26 00:33:00,986: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:33:00.986512889Z [2024-05-26 00:33:00,986: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:33:00.986589855Z [2024-05-26 00:33:00,986: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:33:00.986847311Z [2024-05-26 00:33:00,986: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:33:01.093094820Z [2024-05-26 00:33:01,092: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:33:01.704154401Z [2024-05-26 00:33:01,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e9191f47-9600-4935-83b0-4da7f5f6029a] succeeded in 1.2824488200003543s: None 2024-05-26T00:33:01.989988267Z [2024-05-26 00:33:01,989: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:33:01.993779687Z [2024-05-26 00:33:01,993: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:33:01.995176502Z [2024-05-26 00:33:01,994: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:33:01.998501189Z [2024-05-26 00:33:01,998: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:33:02.024367260Z [2024-05-26 00:33:02,024: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:33:02.024728165Z [2024-05-26 00:33:02,024: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:33:02.025642124Z [2024-05-26 00:33:02,025: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:33:02.025661216Z [2024-05-26 00:33:02,025: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:33:02.025723714Z [2024-05-26 00:33:02,025: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:33:02.025784404Z [2024-05-26 00:33:02,025: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:33:02.026035306Z [2024-05-26 00:33:02,025: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:33:02.026091542Z [2024-05-26 00:33:02,026: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:33:02.026334569Z [2024-05-26 00:33:02,026: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:33:02.026412197Z [2024-05-26 00:33:02,026: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:33:02.026617813Z [2024-05-26 00:33:02,026: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:33:02.026766478Z [2024-05-26 00:33:02,026: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:33:02.027137115Z [2024-05-26 00:33:02,026: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:33:02.027269014Z [2024-05-26 00:33:02,027: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:33:02.107513643Z [2024-05-26 00:33:02,107: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:33:02.113763773Z [2024-05-26 00:33:02,113: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:33:03.578434640Z [2024-05-26 00:33:03,577: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6a465b4-44ad-49cf-8475-549babe20c85] succeeded in 3.167801345999578s: None 2024-05-26T00:33:03.947096907Z [2024-05-26 00:33:03,946: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b7e77ade-c44d-4efc-bc0a-027e2e402f19] succeeded in 3.5355683719999433s: None 2024-05-26T00:34:00.385731665Z [2024-05-26 00:34:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2601eddd-2651-4725-ac48-37d2c0fbb32a] received 2024-05-26T00:34:00.395769556Z [2024-05-26 00:34:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[814def64-d42b-4873-a962-a41a444ba733] received 2024-05-26T00:34:00.397035481Z [2024-05-26 00:34:00,396: INFO/ForkPoolWorker-15] [2601eddd-2651-4725-ac48-37d2c0fbb32a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:34:00.402003892Z [2024-05-26 00:34:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d4e1f9e-25c1-40cc-a463-c9594857feb0] received 2024-05-26T00:34:00.405042468Z [2024-05-26 00:34:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e571dbca-ccd6-41d9-91a6-623044fbc6e7] received 2024-05-26T00:34:00.419002117Z [2024-05-26 00:34:00,418: INFO/ForkPoolWorker-1] [9d4e1f9e-25c1-40cc-a463-c9594857feb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:34:00.426208972Z [2024-05-26 00:34:00,425: INFO/ForkPoolWorker-16] [814def64-d42b-4873-a962-a41a444ba733] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:34:00.438279150Z [2024-05-26 00:34:00,437: INFO/ForkPoolWorker-2] [e571dbca-ccd6-41d9-91a6-623044fbc6e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:34:00.809912114Z [2024-05-26 00:34:00,806: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:34:00.886490609Z [2024-05-26 00:34:00,882: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:34:00.907239176Z [2024-05-26 00:34:00,904: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:34:00.975767818Z [2024-05-26 00:34:00,971: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:34:01.065554509Z [2024-05-26 00:34:01,065: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:34:01.069688856Z [2024-05-26 00:34:01,069: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:34:01.100374030Z [2024-05-26 00:34:01,100: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:34:01.101991805Z [2024-05-26 00:34:01,101: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:34:01.102099220Z [2024-05-26 00:34:01,101: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:34:01.102155121Z [2024-05-26 00:34:01,102: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:34:01.102892496Z [2024-05-26 00:34:01,102: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:34:01.141478736Z [2024-05-26 00:34:01,141: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:34:01.217970888Z [2024-05-26 00:34:01,217: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:34:01.792757346Z [2024-05-26 00:34:01,792: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2601eddd-2651-4725-ac48-37d2c0fbb32a] succeeded in 1.4048842760003026s: None 2024-05-26T00:34:01.894535417Z [2024-05-26 00:34:01,894: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e571dbca-ccd6-41d9-91a6-623044fbc6e7] succeeded in 1.4841195319995677s: None 2024-05-26T00:34:02.122929366Z [2024-05-26 00:34:02,122: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:34:02.127031770Z [2024-05-26 00:34:02,126: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:34:02.143929684Z [2024-05-26 00:34:02,143: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:34:02.145401712Z [2024-05-26 00:34:02,145: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:34:02.145580735Z [2024-05-26 00:34:02,145: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:34:02.145787484Z [2024-05-26 00:34:02,145: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:34:02.145957556Z [2024-05-26 00:34:02,145: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:34:02.146325006Z [2024-05-26 00:34:02,146: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:34:02.146468092Z [2024-05-26 00:34:02,146: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:34:02.246133898Z [2024-05-26 00:34:02,245: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:34:02.267100505Z [2024-05-26 00:34:02,266: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:34:02.270247773Z [2024-05-26 00:34:02,269: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:34:02.294699727Z [2024-05-26 00:34:02,294: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:34:02.296512984Z [2024-05-26 00:34:02,296: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:34:02.296638778Z [2024-05-26 00:34:02,296: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:34:02.296845168Z [2024-05-26 00:34:02,296: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:34:02.296920323Z [2024-05-26 00:34:02,296: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:34:02.297263177Z [2024-05-26 00:34:02,297: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:34:02.297335572Z [2024-05-26 00:34:02,297: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:34:02.407751430Z [2024-05-26 00:34:02,407: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:34:03.877764981Z [2024-05-26 00:34:03,877: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[814def64-d42b-4873-a962-a41a444ba733] succeeded in 3.4739754550000725s: None 2024-05-26T00:34:04.375222018Z [2024-05-26 00:34:04,374: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9d4e1f9e-25c1-40cc-a463-c9594857feb0] succeeded in 3.968638393999754s: None 2024-05-26T00:35:00.326896383Z [2024-05-26 00:35:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d995127-3844-44d4-a757-14a505899449] received 2024-05-26T00:35:00.330639997Z [2024-05-26 00:35:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[731a60e3-a84b-4265-b404-a4aab549239f] received 2024-05-26T00:35:00.337563720Z [2024-05-26 00:35:00,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53832b4a-a5a8-45dd-a124-e454bc275eee] received 2024-05-26T00:35:00.341867908Z [2024-05-26 00:35:00,341: INFO/ForkPoolWorker-15] [6d995127-3844-44d4-a757-14a505899449] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:35:00.342565321Z [2024-05-26 00:35:00,342: INFO/ForkPoolWorker-16] [731a60e3-a84b-4265-b404-a4aab549239f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:35:00.348596987Z [2024-05-26 00:35:00,348: INFO/ForkPoolWorker-1] [53832b4a-a5a8-45dd-a124-e454bc275eee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:35:00.356367831Z [2024-05-26 00:35:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbc68517-d2b2-46da-a803-7eb9cad865b8] received 2024-05-26T00:35:00.378804273Z [2024-05-26 00:35:00,378: INFO/ForkPoolWorker-2] [cbc68517-d2b2-46da-a803-7eb9cad865b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:35:00.743813326Z [2024-05-26 00:35:00,734: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:35:00.756466997Z [2024-05-26 00:35:00,751: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:35:00.779215400Z [2024-05-26 00:35:00,772: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:35:00.839079522Z [2024-05-26 00:35:00,835: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:35:00.954280828Z [2024-05-26 00:35:00,953: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:35:00.958354958Z [2024-05-26 00:35:00,957: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:35:00.988947688Z [2024-05-26 00:35:00,988: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:35:00.990130973Z [2024-05-26 00:35:00,989: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:35:00.990529314Z [2024-05-26 00:35:00,990: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:35:00.990704316Z [2024-05-26 00:35:00,990: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:35:00.990986477Z [2024-05-26 00:35:00,990: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:35:01.116167145Z [2024-05-26 00:35:01,115: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:35:01.777810537Z [2024-05-26 00:35:01,777: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[53832b4a-a5a8-45dd-a124-e454bc275eee] succeeded in 1.4382134940005926s: None 2024-05-26T00:35:02.070903543Z [2024-05-26 00:35:02,070: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:35:02.074147531Z [2024-05-26 00:35:02,073: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:35:02.100671260Z [2024-05-26 00:35:02,100: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:35:02.102138194Z [2024-05-26 00:35:02,101: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:35:02.102351339Z [2024-05-26 00:35:02,102: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:35:02.102581893Z [2024-05-26 00:35:02,102: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:35:02.102725287Z [2024-05-26 00:35:02,102: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:35:02.103032833Z [2024-05-26 00:35:02,102: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:35:02.103112963Z [2024-05-26 00:35:02,103: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:35:02.148681059Z [2024-05-26 00:35:02,148: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:35:02.151634681Z [2024-05-26 00:35:02,151: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:35:02.183927039Z [2024-05-26 00:35:02,183: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:35:02.186357440Z [2024-05-26 00:35:02,186: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:35:02.188080933Z [2024-05-26 00:35:02,187: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:35:02.188144824Z [2024-05-26 00:35:02,188: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:35:02.188326515Z [2024-05-26 00:35:02,188: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:35:02.188491173Z [2024-05-26 00:35:02,188: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:35:02.188754217Z [2024-05-26 00:35:02,188: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:35:02.188803164Z [2024-05-26 00:35:02,188: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:35:02.217954049Z [2024-05-26 00:35:02,217: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:35:02.221156898Z [2024-05-26 00:35:02,220: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:35:02.240235417Z [2024-05-26 00:35:02,239: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:35:02.242452322Z [2024-05-26 00:35:02,242: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:35:02.242929435Z [2024-05-26 00:35:02,242: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:35:02.243296750Z [2024-05-26 00:35:02,242: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:35:02.243791020Z [2024-05-26 00:35:02,243: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:35:02.244244730Z [2024-05-26 00:35:02,244: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:35:02.244892998Z [2024-05-26 00:35:02,244: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:35:02.269131163Z [2024-05-26 00:35:02,268: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:35:02.358209592Z [2024-05-26 00:35:02,357: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:35:02.700640124Z [2024-05-26 00:35:02,700: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[731a60e3-a84b-4265-b404-a4aab549239f] succeeded in 2.3676352239999687s: None 2024-05-26T00:35:02.937352076Z [2024-05-26 00:35:02,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e872475-3d50-4dca-a1ba-61061706df02] received 2024-05-26T00:35:02.943599034Z [2024-05-26 00:35:02,943: INFO/ForkPoolWorker-16] [6e872475-3d50-4dca-a1ba-61061706df02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:35:03.221197034Z [2024-05-26 00:35:03,217: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:35:03.730233644Z [2024-05-26 00:35:03,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d995127-3844-44d4-a757-14a505899449] succeeded in 3.4002137839997886s: None 2024-05-26T00:35:04.349780826Z [2024-05-26 00:35:04,349: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cbc68517-d2b2-46da-a803-7eb9cad865b8] succeeded in 3.990345201999844s: None 2024-05-26T00:35:04.492328271Z [2024-05-26 00:35:04,487: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:35:04.492352933Z [2024-05-26 00:35:04,490: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:35:04.554258225Z [2024-05-26 00:35:04,554: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:35:04.559358166Z [2024-05-26 00:35:04,559: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:35:04.559419101Z [2024-05-26 00:35:04,559: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:35:04.559657864Z [2024-05-26 00:35:04,559: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:35:04.559729106Z [2024-05-26 00:35:04,559: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:35:04.560088915Z [2024-05-26 00:35:04,559: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:35:04.560156646Z [2024-05-26 00:35:04,560: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:35:04.701887680Z [2024-05-26 00:35:04,701: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:35:05.329757943Z [2024-05-26 00:35:05,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58cbed19-38d9-4aaa-9562-ef4195d5ad6e] received 2024-05-26T00:35:05.359365801Z [2024-05-26 00:35:05,359: INFO/ForkPoolWorker-15] [58cbed19-38d9-4aaa-9562-ef4195d5ad6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:35:05.367719568Z [2024-05-26 00:35:05,367: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e872475-3d50-4dca-a1ba-61061706df02] succeeded in 2.4294316069999695s: None 2024-05-26T00:35:05.643871868Z [2024-05-26 00:35:05,640: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:35:06.714203932Z [2024-05-26 00:35:06,713: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:35:06.717255782Z [2024-05-26 00:35:06,716: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:35:06.742622631Z [2024-05-26 00:35:06,742: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:35:06.744919878Z [2024-05-26 00:35:06,744: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:35:06.745088999Z [2024-05-26 00:35:06,744: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:35:06.745419460Z [2024-05-26 00:35:06,744: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:35:06.745429634Z [2024-05-26 00:35:06,745: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:35:06.745863614Z [2024-05-26 00:35:06,745: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:35:06.746015213Z [2024-05-26 00:35:06,745: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:35:06.839339249Z [2024-05-26 00:35:06,838: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:35:07.441244005Z [2024-05-26 00:35:07,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f52700e-57de-472b-88ab-376e4260000d] received 2024-05-26T00:35:07.450480735Z [2024-05-26 00:35:07,450: INFO/ForkPoolWorker-16] [4f52700e-57de-472b-88ab-376e4260000d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:35:07.475829068Z [2024-05-26 00:35:07,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58cbed19-38d9-4aaa-9562-ef4195d5ad6e] succeeded in 2.143258952999531s: None 2024-05-26T00:35:07.709621305Z [2024-05-26 00:35:07,706: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:35:08.872763726Z [2024-05-26 00:35:08,872: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:35:08.877665368Z [2024-05-26 00:35:08,876: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:35:08.897607796Z [2024-05-26 00:35:08,897: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:35:08.899785989Z [2024-05-26 00:35:08,899: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:35:08.900004115Z [2024-05-26 00:35:08,899: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:35:08.900386466Z [2024-05-26 00:35:08,900: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:35:08.900609778Z [2024-05-26 00:35:08,900: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:35:08.901069293Z [2024-05-26 00:35:08,900: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:35:08.901295681Z [2024-05-26 00:35:08,901: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:35:08.999723148Z [2024-05-26 00:35:08,999: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:35:09.688167981Z [2024-05-26 00:35:09,687: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f52700e-57de-472b-88ab-376e4260000d] succeeded in 2.243401652999637s: None 2024-05-26T00:36:00.305757370Z [2024-05-26 00:36:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[490e5bf9-3562-4211-8fba-d8148be0201b] received 2024-05-26T00:36:00.308599677Z [2024-05-26 00:36:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f095ff0-1915-421b-b4bf-405363b3becf] received 2024-05-26T00:36:00.320427733Z [2024-05-26 00:36:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[499b656e-62a7-40f1-8325-53da2277fea4] received 2024-05-26T00:36:00.325545450Z [2024-05-26 00:36:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b128cfd8-20e9-49af-8162-382ad1ed9510] received 2024-05-26T00:36:00.327068279Z [2024-05-26 00:36:00,326: INFO/ForkPoolWorker-16] [6f095ff0-1915-421b-b4bf-405363b3becf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:36:00.335857107Z [2024-05-26 00:36:00,335: INFO/ForkPoolWorker-15] [490e5bf9-3562-4211-8fba-d8148be0201b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:36:00.340718405Z [2024-05-26 00:36:00,340: INFO/ForkPoolWorker-1] [499b656e-62a7-40f1-8325-53da2277fea4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:36:00.348902613Z [2024-05-26 00:36:00,348: INFO/ForkPoolWorker-2] [b128cfd8-20e9-49af-8162-382ad1ed9510] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:36:00.667377323Z [2024-05-26 00:36:00,664: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:36:00.731672176Z [2024-05-26 00:36:00,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:36:00.868687626Z [2024-05-26 00:36:00,864: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:36:00.943092484Z [2024-05-26 00:36:00,939: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:36:00.958428300Z [2024-05-26 00:36:00,958: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:36:00.971636062Z [2024-05-26 00:36:00,971: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:36:01.028706672Z [2024-05-26 00:36:01,028: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:36:01.032350221Z [2024-05-26 00:36:01,032: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:36:01.032770175Z [2024-05-26 00:36:01,032: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:36:01.032869749Z [2024-05-26 00:36:01,032: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:36:01.033311289Z [2024-05-26 00:36:01,033: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:36:01.190933903Z [2024-05-26 00:36:01,190: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:36:01.287744414Z [2024-05-26 00:36:01,287: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:36:01.816339269Z [2024-05-26 00:36:01,815: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6f095ff0-1915-421b-b4bf-405363b3becf] succeeded in 1.4995681600003081s: None 2024-05-26T00:36:01.919433285Z [2024-05-26 00:36:01,918: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[499b656e-62a7-40f1-8325-53da2277fea4] succeeded in 1.5961576670006252s: None 2024-05-26T00:36:02.266125970Z [2024-05-26 00:36:02,265: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:36:02.269631702Z [2024-05-26 00:36:02,269: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:36:02.269811200Z [2024-05-26 00:36:02,269: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:36:02.273034694Z [2024-05-26 00:36:02,272: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:36:02.292529458Z [2024-05-26 00:36:02,292: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:36:02.293924083Z [2024-05-26 00:36:02,293: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:36:02.294403721Z [2024-05-26 00:36:02,293: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:36:02.294576081Z [2024-05-26 00:36:02,294: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:36:02.294603658Z [2024-05-26 00:36:02,294: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:36:02.294857912Z [2024-05-26 00:36:02,294: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:36:02.294986691Z [2024-05-26 00:36:02,294: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:36:02.296047761Z [2024-05-26 00:36:02,295: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:36:02.297193353Z [2024-05-26 00:36:02,297: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:36:02.297400118Z [2024-05-26 00:36:02,297: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:36:02.297626874Z [2024-05-26 00:36:02,297: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:36:02.297703780Z [2024-05-26 00:36:02,297: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:36:02.298274095Z [2024-05-26 00:36:02,298: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:36:02.298392438Z [2024-05-26 00:36:02,298: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:36:02.379611781Z [2024-05-26 00:36:02,379: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:36:02.386141428Z [2024-05-26 00:36:02,385: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:36:04.106176132Z [2024-05-26 00:36:04,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[490e5bf9-3562-4211-8fba-d8148be0201b] succeeded in 3.795052437999402s: None 2024-05-26T00:36:04.182673868Z [2024-05-26 00:36:04,182: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b128cfd8-20e9-49af-8162-382ad1ed9510] succeeded in 3.8497250469999926s: None 2024-05-26T00:37:00.581396612Z [2024-05-26 00:37:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ce96362-11a9-4c7c-9eea-6860ee092907] received 2024-05-26T00:37:00.584167455Z [2024-05-26 00:37:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90957522-37af-4af8-8205-feb0129c269d] received 2024-05-26T00:37:00.591150951Z [2024-05-26 00:37:00,590: INFO/ForkPoolWorker-15] [0ce96362-11a9-4c7c-9eea-6860ee092907] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:37:00.596726754Z [2024-05-26 00:37:00,596: INFO/ForkPoolWorker-16] [90957522-37af-4af8-8205-feb0129c269d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:37:00.603246503Z [2024-05-26 00:37:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e004ba5d-b238-4494-9be2-b582b73f90cc] received 2024-05-26T00:37:00.610887670Z [2024-05-26 00:37:00,610: INFO/ForkPoolWorker-1] [e004ba5d-b238-4494-9be2-b582b73f90cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:37:00.896299722Z [2024-05-26 00:37:00,893: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:37:00.913409100Z [2024-05-26 00:37:00,910: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:37:00.984971209Z [2024-05-26 00:37:00,981: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:37:01.077240249Z [2024-05-26 00:37:01,076: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:37:01.081716296Z [2024-05-26 00:37:01,081: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:37:01.103358826Z [2024-05-26 00:37:01,103: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:37:01.104813653Z [2024-05-26 00:37:01,104: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:37:01.105056905Z [2024-05-26 00:37:01,104: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:37:01.105113707Z [2024-05-26 00:37:01,105: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:37:01.105364664Z [2024-05-26 00:37:01,105: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:37:01.222324543Z [2024-05-26 00:37:01,222: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:37:02.186293604Z [2024-05-26 00:37:02,185: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:37:02.189847490Z [2024-05-26 00:37:02,189: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:37:02.190686444Z [2024-05-26 00:37:02,190: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90957522-37af-4af8-8205-feb0129c269d] succeeded in 1.6037236199999825s: None 2024-05-26T00:37:02.225088987Z [2024-05-26 00:37:02,224: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:37:02.233098966Z [2024-05-26 00:37:02,232: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:37:02.233479807Z [2024-05-26 00:37:02,232: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:37:02.233852222Z [2024-05-26 00:37:02,233: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:37:02.234110487Z [2024-05-26 00:37:02,233: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:37:02.234708514Z [2024-05-26 00:37:02,234: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:37:02.235102366Z [2024-05-26 00:37:02,234: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:37:02.312692186Z [2024-05-26 00:37:02,312: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:37:02.440583496Z [2024-05-26 00:37:02,440: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:37:02.443753692Z [2024-05-26 00:37:02,443: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:37:02.472664251Z [2024-05-26 00:37:02,472: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:37:02.474846736Z [2024-05-26 00:37:02,474: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:37:02.474939867Z [2024-05-26 00:37:02,474: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:37:02.475207236Z [2024-05-26 00:37:02,474: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:37:02.475266699Z [2024-05-26 00:37:02,475: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:37:02.475747945Z [2024-05-26 00:37:02,475: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:37:02.475830401Z [2024-05-26 00:37:02,475: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:37:02.570281676Z [2024-05-26 00:37:02,570: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:37:04.451652161Z [2024-05-26 00:37:04,443: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ce96362-11a9-4c7c-9eea-6860ee092907] succeeded in 3.859536264999406s: None 2024-05-26T00:37:04.790425504Z [2024-05-26 00:37:04,790: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e004ba5d-b238-4494-9be2-b582b73f90cc] succeeded in 4.1853351299996575s: None 2024-05-26T00:38:01.071286481Z [2024-05-26 00:38:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b84216a-3c77-4fd2-b2ea-00b790300822] received 2024-05-26T00:38:01.079662486Z [2024-05-26 00:38:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ffe04fa-9e25-4e09-8c09-362161fa2871] received 2024-05-26T00:38:01.081431606Z [2024-05-26 00:38:01,081: INFO/ForkPoolWorker-15] [7b84216a-3c77-4fd2-b2ea-00b790300822] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:38:01.087579554Z [2024-05-26 00:38:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1e71388-6119-46a2-bd98-15adb2502c37] received 2024-05-26T00:38:01.094710717Z [2024-05-26 00:38:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34c00258-4590-4261-af18-cf37cc9cb1f8] received 2024-05-26T00:38:01.102249851Z [2024-05-26 00:38:01,097: INFO/ForkPoolWorker-16] [8ffe04fa-9e25-4e09-8c09-362161fa2871] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:38:01.105375846Z [2024-05-26 00:38:01,104: INFO/ForkPoolWorker-1] [e1e71388-6119-46a2-bd98-15adb2502c37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:38:01.113944645Z [2024-05-26 00:38:01,113: INFO/ForkPoolWorker-2] [34c00258-4590-4261-af18-cf37cc9cb1f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:38:01.400029119Z [2024-05-26 00:38:01,396: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:38:01.446082652Z [2024-05-26 00:38:01,442: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:38:01.508757145Z [2024-05-26 00:38:01,505: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:38:01.579596057Z [2024-05-26 00:38:01,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:38:01.609723275Z [2024-05-26 00:38:01,609: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:38:01.613726650Z [2024-05-26 00:38:01,613: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:38:01.644062933Z [2024-05-26 00:38:01,643: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:38:01.648403809Z [2024-05-26 00:38:01,648: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:38:01.648644264Z [2024-05-26 00:38:01,648: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:38:01.648750683Z [2024-05-26 00:38:01,648: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:38:01.649057218Z [2024-05-26 00:38:01,648: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:38:01.774381190Z [2024-05-26 00:38:01,774: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:38:01.835567020Z [2024-05-26 00:38:01,835: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:38:02.378569275Z [2024-05-26 00:38:02,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b84216a-3c77-4fd2-b2ea-00b790300822] succeeded in 1.3055266490000577s: None 2024-05-26T00:38:02.457966504Z [2024-05-26 00:38:02,457: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[34c00258-4590-4261-af18-cf37cc9cb1f8] succeeded in 1.3531695439996838s: None 2024-05-26T00:38:02.766629254Z [2024-05-26 00:38:02,766: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:38:02.769988694Z [2024-05-26 00:38:02,769: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:38:02.800624420Z [2024-05-26 00:38:02,800: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:38:02.804472832Z [2024-05-26 00:38:02,804: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:38:02.804681419Z [2024-05-26 00:38:02,804: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:38:02.805026555Z [2024-05-26 00:38:02,804: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:38:02.805198294Z [2024-05-26 00:38:02,805: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:38:02.805615172Z [2024-05-26 00:38:02,805: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:38:02.805809814Z [2024-05-26 00:38:02,805: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:38:02.914189810Z [2024-05-26 00:38:02,913: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:38:02.930290278Z [2024-05-26 00:38:02,929: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:38:02.933576601Z [2024-05-26 00:38:02,933: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:38:02.962408939Z [2024-05-26 00:38:02,962: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:38:02.964294776Z [2024-05-26 00:38:02,964: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:38:02.965904298Z [2024-05-26 00:38:02,964: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:38:02.966114887Z [2024-05-26 00:38:02,965: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:38:02.966177927Z [2024-05-26 00:38:02,966: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:38:02.966482436Z [2024-05-26 00:38:02,966: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:38:02.966512214Z [2024-05-26 00:38:02,966: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:38:03.088756487Z [2024-05-26 00:38:03,088: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:38:04.535710167Z [2024-05-26 00:38:04,534: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e1e71388-6119-46a2-bd98-15adb2502c37] succeeded in 3.4377194280004915s: None 2024-05-26T00:38:05.060449335Z [2024-05-26 00:38:05,060: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ffe04fa-9e25-4e09-8c09-362161fa2871] succeeded in 3.9769039270004214s: None 2024-05-26T00:39:00.848039089Z [2024-05-26 00:39:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c7ea61e-d9b9-40f1-98e3-5454266c2a31] received 2024-05-26T00:39:00.868129658Z [2024-05-26 00:39:00,867: INFO/ForkPoolWorker-15] [3c7ea61e-d9b9-40f1-98e3-5454266c2a31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:39:00.868720240Z [2024-05-26 00:39:00,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5af6352b-8943-4ad6-94e3-ca4006b6c732] received 2024-05-26T00:39:00.872038267Z [2024-05-26 00:39:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b22f99af-3909-44b4-8556-88960f5088d2] received 2024-05-26T00:39:00.884526156Z [2024-05-26 00:39:00,884: INFO/ForkPoolWorker-16] [5af6352b-8943-4ad6-94e3-ca4006b6c732] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:39:00.887599757Z [2024-05-26 00:39:00,887: INFO/ForkPoolWorker-1] [b22f99af-3909-44b4-8556-88960f5088d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:39:01.185940975Z [2024-05-26 00:39:01,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:39:01.193674626Z [2024-05-26 00:39:01,189: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:39:01.214928852Z [2024-05-26 00:39:01,211: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:39:01.390048297Z [2024-05-26 00:39:01,389: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:39:01.394277965Z [2024-05-26 00:39:01,393: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:39:01.434562511Z [2024-05-26 00:39:01,434: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:39:01.436379288Z [2024-05-26 00:39:01,436: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:39:01.436431905Z [2024-05-26 00:39:01,436: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:39:01.436511496Z [2024-05-26 00:39:01,436: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:39:01.436746351Z [2024-05-26 00:39:01,436: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:39:01.523749895Z [2024-05-26 00:39:01,523: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:39:02.200942498Z [2024-05-26 00:39:02,200: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b22f99af-3909-44b4-8556-88960f5088d2] succeeded in 1.32673466200049s: None 2024-05-26T00:39:02.521221455Z [2024-05-26 00:39:02,520: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:39:02.524657430Z [2024-05-26 00:39:02,524: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:39:02.557137244Z [2024-05-26 00:39:02,556: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:39:02.558504628Z [2024-05-26 00:39:02,558: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:39:02.558703817Z [2024-05-26 00:39:02,558: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:39:02.558945195Z [2024-05-26 00:39:02,558: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:39:02.559106634Z [2024-05-26 00:39:02,558: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:39:02.559454352Z [2024-05-26 00:39:02,559: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:39:02.559674466Z [2024-05-26 00:39:02,559: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:39:02.654814773Z [2024-05-26 00:39:02,654: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:39:02.674599543Z [2024-05-26 00:39:02,674: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:39:02.677722269Z [2024-05-26 00:39:02,677: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:39:02.707088819Z [2024-05-26 00:39:02,706: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:39:02.708502050Z [2024-05-26 00:39:02,708: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:39:02.708521265Z [2024-05-26 00:39:02,708: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:39:02.708673768Z [2024-05-26 00:39:02,708: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:39:02.708715984Z [2024-05-26 00:39:02,708: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:39:02.708970561Z [2024-05-26 00:39:02,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:39:02.709010636Z [2024-05-26 00:39:02,708: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:39:02.799994724Z [2024-05-26 00:39:02,799: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:39:04.796154205Z [2024-05-26 00:39:04,795: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5af6352b-8943-4ad6-94e3-ca4006b6c732] succeeded in 3.9251594600000317s: None 2024-05-26T00:39:05.925987201Z [2024-05-26 00:39:05,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c7ea61e-d9b9-40f1-98e3-5454266c2a31] succeeded in 5.071808929999861s: None 2024-05-26T00:40:00.875853929Z [2024-05-26 00:40:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34773470-991d-427b-a5d2-afd64f6cdaee] received 2024-05-26T00:40:00.880294082Z [2024-05-26 00:40:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac52c8a2-f1f5-4fc7-a83a-1fc96728c797] received 2024-05-26T00:40:00.883951068Z [2024-05-26 00:40:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[791e463f-9770-4b1b-932e-aa540ec77be2] received 2024-05-26T00:40:00.886489640Z [2024-05-26 00:40:00,886: INFO/ForkPoolWorker-15] [34773470-991d-427b-a5d2-afd64f6cdaee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:40:00.886983405Z [2024-05-26 00:40:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb2dd2a7-6b3f-43a8-84c8-583b9d605049] received 2024-05-26T00:40:00.889816269Z [2024-05-26 00:40:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1628b717-add8-4ace-9148-f8de30e79038] received 2024-05-26T00:40:00.904938870Z [2024-05-26 00:40:00,904: INFO/ForkPoolWorker-16] [ac52c8a2-f1f5-4fc7-a83a-1fc96728c797] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:40:00.910619212Z [2024-05-26 00:40:00,910: INFO/ForkPoolWorker-2] [bb2dd2a7-6b3f-43a8-84c8-583b9d605049] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:40:00.922533895Z [2024-05-26 00:40:00,922: INFO/ForkPoolWorker-1] [791e463f-9770-4b1b-932e-aa540ec77be2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:40:00.937651063Z [2024-05-26 00:40:00,937: INFO/ForkPoolWorker-3] [1628b717-add8-4ace-9148-f8de30e79038] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:40:01.240988463Z [2024-05-26 00:40:01,233: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:40:01.316315794Z [2024-05-26 00:40:01,312: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:40:01.326995622Z [2024-05-26 00:40:01,315: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:40:01.483200507Z [2024-05-26 00:40:01,482: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:40:01.487352964Z [2024-05-26 00:40:01,486: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:40:01.528621580Z [2024-05-26 00:40:01,528: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:40:01.532413873Z [2024-05-26 00:40:01,532: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:40:01.532537437Z [2024-05-26 00:40:01,532: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:40:01.532603950Z [2024-05-26 00:40:01,532: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:40:01.532826807Z [2024-05-26 00:40:01,532: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:40:01.550781694Z [2024-05-26 00:40:01,541: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:40:01.598141761Z [2024-05-26 00:40:01,594: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:40:01.680348274Z [2024-05-26 00:40:01,680: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:40:01.941321492Z [2024-05-26 00:40:01,940: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:40:02.344696513Z [2024-05-26 00:40:02,344: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac52c8a2-f1f5-4fc7-a83a-1fc96728c797] succeeded in 1.4622906819995478s: None 2024-05-26T00:40:02.607117565Z [2024-05-26 00:40:02,606: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[791e463f-9770-4b1b-932e-aa540ec77be2] succeeded in 1.7198035680003159s: None 2024-05-26T00:40:02.811370043Z [2024-05-26 00:40:02,811: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:40:02.814680989Z [2024-05-26 00:40:02,814: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:40:02.845734869Z [2024-05-26 00:40:02,845: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:40:02.849377573Z [2024-05-26 00:40:02,848: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:40:02.849585585Z [2024-05-26 00:40:02,849: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:40:02.849819561Z [2024-05-26 00:40:02,849: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:40:02.850016444Z [2024-05-26 00:40:02,849: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:40:02.850523272Z [2024-05-26 00:40:02,850: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:40:02.851192892Z [2024-05-26 00:40:02,850: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:40:02.931218385Z [2024-05-26 00:40:02,930: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:40:03.102894556Z [2024-05-26 00:40:03,102: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:40:03.106111366Z [2024-05-26 00:40:03,105: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:40:03.143272579Z [2024-05-26 00:40:03,143: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:40:03.146648397Z [2024-05-26 00:40:03,146: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:40:03.146692962Z [2024-05-26 00:40:03,146: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:40:03.147254603Z [2024-05-26 00:40:03,146: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:40:03.147341734Z [2024-05-26 00:40:03,147: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:40:03.147680973Z [2024-05-26 00:40:03,147: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:40:03.147744713Z [2024-05-26 00:40:03,147: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:40:03.162490288Z [2024-05-26 00:40:03,162: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T00:40:03.167595058Z [2024-05-26 00:40:03,165: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:40:03.193423499Z [2024-05-26 00:40:03,193: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T00:40:03.194811382Z [2024-05-26 00:40:03,194: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:40:03.194823330Z [2024-05-26 00:40:03,194: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:40:03.194963070Z [2024-05-26 00:40:03,194: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:40:03.195005459Z [2024-05-26 00:40:03,194: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T00:40:03.195685537Z [2024-05-26 00:40:03,195: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:40:03.195810909Z [2024-05-26 00:40:03,195: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:40:03.288088258Z [2024-05-26 00:40:03,287: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:40:03.370919043Z [2024-05-26 00:40:03,370: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:40:04.292483389Z [2024-05-26 00:40:04,292: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34773470-991d-427b-a5d2-afd64f6cdaee] succeeded in 3.412429756000165s: None 2024-05-26T00:40:04.734331595Z [2024-05-26 00:40:04,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[990d2ad0-6cfc-42aa-b37f-b7266775882f] received 2024-05-26T00:40:04.748586849Z [2024-05-26 00:40:04,748: INFO/ForkPoolWorker-15] [990d2ad0-6cfc-42aa-b37f-b7266775882f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:40:04.946397462Z [2024-05-26 00:40:04,946: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bb2dd2a7-6b3f-43a8-84c8-583b9d605049] succeeded in 4.054991550000523s: None 2024-05-26T00:40:05.108826585Z [2024-05-26 00:40:05,104: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:40:05.226536546Z [2024-05-26 00:40:05,226: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1628b717-add8-4ace-9148-f8de30e79038] succeeded in 4.328339960999983s: None 2024-05-26T00:40:06.433620066Z [2024-05-26 00:40:06,433: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:40:06.437034367Z [2024-05-26 00:40:06,436: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:40:06.464708331Z [2024-05-26 00:40:06,464: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:40:06.467921466Z [2024-05-26 00:40:06,467: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:40:06.468148187Z [2024-05-26 00:40:06,467: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:40:06.468467686Z [2024-05-26 00:40:06,468: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:40:06.468676859Z [2024-05-26 00:40:06,468: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:40:06.469113692Z [2024-05-26 00:40:06,468: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:40:06.469329384Z [2024-05-26 00:40:06,469: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:40:06.575479457Z [2024-05-26 00:40:06,575: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:40:07.248237299Z [2024-05-26 00:40:07,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42d6e9d0-c88a-4bb8-8315-528fbb48ccad] received 2024-05-26T00:40:07.261891323Z [2024-05-26 00:40:07,261: INFO/ForkPoolWorker-16] [42d6e9d0-c88a-4bb8-8315-528fbb48ccad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:40:07.328050959Z [2024-05-26 00:40:07,327: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[990d2ad0-6cfc-42aa-b37f-b7266775882f] succeeded in 2.5880928879996645s: None 2024-05-26T00:40:07.618157789Z [2024-05-26 00:40:07,615: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:40:08.750664821Z [2024-05-26 00:40:08,750: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:40:08.754080192Z [2024-05-26 00:40:08,753: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:40:08.782954704Z [2024-05-26 00:40:08,782: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:40:08.784648911Z [2024-05-26 00:40:08,784: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:40:08.784767592Z [2024-05-26 00:40:08,784: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:40:08.784995122Z [2024-05-26 00:40:08,784: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:40:08.785143946Z [2024-05-26 00:40:08,784: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:40:08.785552567Z [2024-05-26 00:40:08,785: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:40:08.785677429Z [2024-05-26 00:40:08,785: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:40:08.887744271Z [2024-05-26 00:40:08,887: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:40:09.472263841Z [2024-05-26 00:40:09,471: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42d6e9d0-c88a-4bb8-8315-528fbb48ccad] succeeded in 2.2220053729997744s: None 2024-05-26T00:40:09.780768910Z [2024-05-26 00:40:09,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16761059-2b5a-4d10-a55b-1f506895b5e6] received 2024-05-26T00:40:09.802464394Z [2024-05-26 00:40:09,802: INFO/ForkPoolWorker-15] [16761059-2b5a-4d10-a55b-1f506895b5e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:40:10.112905446Z [2024-05-26 00:40:10,109: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:40:11.356530034Z [2024-05-26 00:40:11,356: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:40:11.359606828Z [2024-05-26 00:40:11,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:40:11.376036851Z [2024-05-26 00:40:11,375: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:40:11.377171320Z [2024-05-26 00:40:11,376: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:40:11.377298191Z [2024-05-26 00:40:11,377: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:40:11.377464466Z [2024-05-26 00:40:11,377: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:40:11.377551708Z [2024-05-26 00:40:11,377: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:40:11.378217643Z [2024-05-26 00:40:11,378: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:40:11.378286923Z [2024-05-26 00:40:11,378: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:40:11.457992731Z [2024-05-26 00:40:11,457: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:40:11.994758327Z [2024-05-26 00:40:11,994: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16761059-2b5a-4d10-a55b-1f506895b5e6] succeeded in 2.2116479380001692s: None 2024-05-26T00:41:00.372305965Z [2024-05-26 00:41:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2b1575e-e18f-44a3-956b-a69e4afab0b5] received 2024-05-26T00:41:00.374398154Z [2024-05-26 00:41:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2152f53a-72a0-42bb-9532-6c8f5bf50c1a] received 2024-05-26T00:41:00.384063833Z [2024-05-26 00:41:00,383: INFO/ForkPoolWorker-15] [b2b1575e-e18f-44a3-956b-a69e4afab0b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:41:00.384729715Z [2024-05-26 00:41:00,384: INFO/ForkPoolWorker-16] [2152f53a-72a0-42bb-9532-6c8f5bf50c1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:41:00.392414465Z [2024-05-26 00:41:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f70cea38-7ae5-4dcc-8c91-bb6986aae1cc] received 2024-05-26T00:41:00.412986794Z [2024-05-26 00:41:00,412: INFO/ForkPoolWorker-1] [f70cea38-7ae5-4dcc-8c91-bb6986aae1cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:41:00.672798998Z [2024-05-26 00:41:00,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:41:00.723651366Z [2024-05-26 00:41:00,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:41:00.727842734Z [2024-05-26 00:41:00,724: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:41:00.928489699Z [2024-05-26 00:41:00,927: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:41:00.933759023Z [2024-05-26 00:41:00,933: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:41:00.966113952Z [2024-05-26 00:41:00,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:41:00.968198657Z [2024-05-26 00:41:00,967: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:41:00.968640732Z [2024-05-26 00:41:00,968: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:41:00.968661216Z [2024-05-26 00:41:00,968: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:41:00.969998615Z [2024-05-26 00:41:00,968: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:41:01.076251245Z [2024-05-26 00:41:01,075: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:41:01.636533198Z [2024-05-26 00:41:01,636: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2152f53a-72a0-42bb-9532-6c8f5bf50c1a] succeeded in 1.2595743820002099s: None 2024-05-26T00:41:01.851040409Z [2024-05-26 00:41:01,850: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:41:01.854324493Z [2024-05-26 00:41:01,853: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:41:01.891431314Z [2024-05-26 00:41:01,891: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:41:01.894260846Z [2024-05-26 00:41:01,893: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:41:01.894455929Z [2024-05-26 00:41:01,894: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:41:01.894697276Z [2024-05-26 00:41:01,894: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:41:01.894852585Z [2024-05-26 00:41:01,894: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:41:01.895311953Z [2024-05-26 00:41:01,895: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:41:01.895482455Z [2024-05-26 00:41:01,895: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:41:02.034659515Z [2024-05-26 00:41:02,034: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:41:02.038465353Z [2024-05-26 00:41:02,038: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:41:02.041742153Z [2024-05-26 00:41:02,041: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:41:02.064587671Z [2024-05-26 00:41:02,064: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:41:02.066058067Z [2024-05-26 00:41:02,065: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:41:02.066199064Z [2024-05-26 00:41:02,065: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:41:02.066416677Z [2024-05-26 00:41:02,066: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:41:02.066562783Z [2024-05-26 00:41:02,066: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:41:02.066828207Z [2024-05-26 00:41:02,066: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:41:02.066939000Z [2024-05-26 00:41:02,066: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:41:02.148646411Z [2024-05-26 00:41:02,148: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:41:03.592486904Z [2024-05-26 00:41:03,591: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2b1575e-e18f-44a3-956b-a69e4afab0b5] succeeded in 3.2162480809993212s: None 2024-05-26T00:41:04.075670279Z [2024-05-26 00:41:04,075: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f70cea38-7ae5-4dcc-8c91-bb6986aae1cc] succeeded in 3.6733347970002797s: None 2024-05-26T00:42:00.753994457Z [2024-05-26 00:42:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fea09ca1-8a9d-40d9-9848-22b015e840d5] received 2024-05-26T00:42:00.763548556Z [2024-05-26 00:42:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6772c13-04b9-4961-ad81-53d4cbaba97e] received 2024-05-26T00:42:00.776613824Z [2024-05-26 00:42:00,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[818dbf9e-cded-4287-a892-a499548c28b2] received 2024-05-26T00:42:00.778256050Z [2024-05-26 00:42:00,777: INFO/ForkPoolWorker-16] [a6772c13-04b9-4961-ad81-53d4cbaba97e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:42:00.779103148Z [2024-05-26 00:42:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57e17850-1125-4ca2-ba42-82191ede666c] received 2024-05-26T00:42:00.794041093Z [2024-05-26 00:42:00,793: INFO/ForkPoolWorker-15] [fea09ca1-8a9d-40d9-9848-22b015e840d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:42:00.797494094Z [2024-05-26 00:42:00,796: INFO/ForkPoolWorker-2] [57e17850-1125-4ca2-ba42-82191ede666c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:42:00.802426312Z [2024-05-26 00:42:00,802: INFO/ForkPoolWorker-1] [818dbf9e-cded-4287-a892-a499548c28b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:42:01.087212920Z [2024-05-26 00:42:01,084: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:42:01.116419441Z [2024-05-26 00:42:01,113: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:42:01.150202281Z [2024-05-26 00:42:01,146: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:42:01.188782032Z [2024-05-26 00:42:01,184: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:42:01.441454616Z [2024-05-26 00:42:01,441: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:42:01.514616339Z [2024-05-26 00:42:01,514: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:42:01.518997490Z [2024-05-26 00:42:01,518: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:42:01.547728055Z [2024-05-26 00:42:01,547: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:42:01.548796883Z [2024-05-26 00:42:01,548: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:42:01.548953371Z [2024-05-26 00:42:01,548: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:42:01.549038839Z [2024-05-26 00:42:01,548: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:42:01.549360232Z [2024-05-26 00:42:01,549: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:42:01.687856671Z [2024-05-26 00:42:01,687: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:42:01.942850252Z [2024-05-26 00:42:01,942: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fea09ca1-8a9d-40d9-9848-22b015e840d5] succeeded in 1.1865579309996974s: None 2024-05-26T00:42:02.279383473Z [2024-05-26 00:42:02,279: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[57e17850-1125-4ca2-ba42-82191ede666c] succeeded in 1.497769707999396s: None 2024-05-26T00:42:02.320060148Z [2024-05-26 00:42:02,319: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:42:02.323371376Z [2024-05-26 00:42:02,322: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:42:02.352883021Z [2024-05-26 00:42:02,352: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:42:02.356040518Z [2024-05-26 00:42:02,355: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:42:02.356410537Z [2024-05-26 00:42:02,356: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:42:02.356841774Z [2024-05-26 00:42:02,356: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:42:02.357046419Z [2024-05-26 00:42:02,356: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:42:02.357559396Z [2024-05-26 00:42:02,357: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:42:02.358360195Z [2024-05-26 00:42:02,358: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:42:02.467709258Z [2024-05-26 00:42:02,467: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:42:02.470669544Z [2024-05-26 00:42:02,470: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:42:02.474143791Z [2024-05-26 00:42:02,473: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:42:02.493649643Z [2024-05-26 00:42:02,493: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:42:02.494993182Z [2024-05-26 00:42:02,494: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:42:02.495150526Z [2024-05-26 00:42:02,494: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:42:02.495371980Z [2024-05-26 00:42:02,495: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:42:02.495572046Z [2024-05-26 00:42:02,495: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:42:02.495998195Z [2024-05-26 00:42:02,495: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:42:02.496195115Z [2024-05-26 00:42:02,496: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:42:02.596578352Z [2024-05-26 00:42:02,596: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:42:04.096674289Z [2024-05-26 00:42:04,096: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[818dbf9e-cded-4287-a892-a499548c28b2] succeeded in 3.313101880999966s: None 2024-05-26T00:42:04.255339022Z [2024-05-26 00:42:04,254: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6772c13-04b9-4961-ad81-53d4cbaba97e] succeeded in 3.4885793430003105s: None 2024-05-26T00:43:01.226875898Z [2024-05-26 00:43:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31bf6697-cc65-432b-be61-19e36b6df2cb] received 2024-05-26T00:43:01.236398251Z [2024-05-26 00:43:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[032b14c6-98d9-49cc-9844-615b5bbb41bf] received 2024-05-26T00:43:01.248093270Z [2024-05-26 00:43:01,247: INFO/ForkPoolWorker-15] [31bf6697-cc65-432b-be61-19e36b6df2cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:43:01.250466263Z [2024-05-26 00:43:01,250: INFO/ForkPoolWorker-16] [032b14c6-98d9-49cc-9844-615b5bbb41bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:43:01.263072847Z [2024-05-26 00:43:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2ec7375-a428-4b84-8cf5-563526f2460f] received 2024-05-26T00:43:01.285740774Z [2024-05-26 00:43:01,285: INFO/ForkPoolWorker-1] [f2ec7375-a428-4b84-8cf5-563526f2460f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:43:01.563851105Z [2024-05-26 00:43:01,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:43:01.568958643Z [2024-05-26 00:43:01,565: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:43:01.620538599Z [2024-05-26 00:43:01,615: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:43:01.801000971Z [2024-05-26 00:43:01,800: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:43:01.805805125Z [2024-05-26 00:43:01,805: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:43:01.863163904Z [2024-05-26 00:43:01,862: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:43:01.868842031Z [2024-05-26 00:43:01,868: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:43:01.869193552Z [2024-05-26 00:43:01,868: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:43:01.869421696Z [2024-05-26 00:43:01,869: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:43:01.869965381Z [2024-05-26 00:43:01,869: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:43:02.029956929Z [2024-05-26 00:43:02,028: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:43:02.641730588Z [2024-05-26 00:43:02,641: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2ec7375-a428-4b84-8cf5-563526f2460f] succeeded in 1.3758553969992136s: None 2024-05-26T00:43:02.684229564Z [2024-05-26 00:43:02,683: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:43:02.687750655Z [2024-05-26 00:43:02,687: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:43:02.710596851Z [2024-05-26 00:43:02,710: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:43:02.712429237Z [2024-05-26 00:43:02,712: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:43:02.712457546Z [2024-05-26 00:43:02,712: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:43:02.712526271Z [2024-05-26 00:43:02,712: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:43:02.712545306Z [2024-05-26 00:43:02,712: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:43:02.712803232Z [2024-05-26 00:43:02,712: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:43:02.712817863Z [2024-05-26 00:43:02,712: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:43:02.787591383Z [2024-05-26 00:43:02,787: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:43:02.792915817Z [2024-05-26 00:43:02,792: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:43:02.815692910Z [2024-05-26 00:43:02,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:43:02.817725395Z [2024-05-26 00:43:02,817: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:43:02.820266366Z [2024-05-26 00:43:02,820: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:43:02.820923779Z [2024-05-26 00:43:02,820: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:43:02.821135741Z [2024-05-26 00:43:02,820: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:43:02.821596017Z [2024-05-26 00:43:02,821: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:43:02.821935038Z [2024-05-26 00:43:02,821: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:43:02.822339093Z [2024-05-26 00:43:02,822: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:43:02.986004156Z [2024-05-26 00:43:02,985: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:43:04.973947689Z [2024-05-26 00:43:04,973: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31bf6697-cc65-432b-be61-19e36b6df2cb] succeeded in 3.741952336000395s: None 2024-05-26T00:43:06.650100190Z [2024-05-26 00:43:06,649: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[032b14c6-98d9-49cc-9844-615b5bbb41bf] succeeded in 5.408704166999996s: None 2024-05-26T00:44:00.665259755Z [2024-05-26 00:44:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33b8d493-f07b-43c5-ac45-a39d1642575a] received 2024-05-26T00:44:00.670607624Z [2024-05-26 00:44:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1343ec76-7ab1-447a-bbe9-de0244d06e90] received 2024-05-26T00:44:00.673153872Z [2024-05-26 00:44:00,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4700f65a-424c-4051-b3ab-539eadb40ca5] received 2024-05-26T00:44:00.675832392Z [2024-05-26 00:44:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d300e69-3ebc-4c8e-b01c-121ca2fc8c3c] received 2024-05-26T00:44:00.675864025Z [2024-05-26 00:44:00,675: INFO/ForkPoolWorker-15] [33b8d493-f07b-43c5-ac45-a39d1642575a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:44:00.686156701Z [2024-05-26 00:44:00,685: INFO/ForkPoolWorker-1] [4700f65a-424c-4051-b3ab-539eadb40ca5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:44:00.692248268Z [2024-05-26 00:44:00,691: INFO/ForkPoolWorker-16] [1343ec76-7ab1-447a-bbe9-de0244d06e90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:44:00.712585462Z [2024-05-26 00:44:00,712: INFO/ForkPoolWorker-2] [1d300e69-3ebc-4c8e-b01c-121ca2fc8c3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:44:01.091754344Z [2024-05-26 00:44:01,088: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:44:01.132553362Z [2024-05-26 00:44:01,129: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:44:01.168464320Z [2024-05-26 00:44:01,164: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:44:01.192351203Z [2024-05-26 00:44:01,181: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:44:01.504250252Z [2024-05-26 00:44:01,503: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:44:01.512810295Z [2024-05-26 00:44:01,512: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:44:01.540517298Z [2024-05-26 00:44:01,540: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:44:01.543697298Z [2024-05-26 00:44:01,543: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:44:01.543846021Z [2024-05-26 00:44:01,543: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:44:01.543972796Z [2024-05-26 00:44:01,543: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:44:01.544263799Z [2024-05-26 00:44:01,544: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:44:01.546786351Z [2024-05-26 00:44:01,546: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:44:01.644453093Z [2024-05-26 00:44:01,644: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:44:02.157691115Z [2024-05-26 00:44:02,157: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33b8d493-f07b-43c5-ac45-a39d1642575a] succeeded in 1.488891209999565s: None 2024-05-26T00:44:02.377909817Z [2024-05-26 00:44:02,377: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1d300e69-3ebc-4c8e-b01c-121ca2fc8c3c] succeeded in 1.6874585140003546s: None 2024-05-26T00:44:02.382267715Z [2024-05-26 00:44:02,381: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:44:02.385348124Z [2024-05-26 00:44:02,384: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:44:02.403859190Z [2024-05-26 00:44:02,403: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:44:02.405145729Z [2024-05-26 00:44:02,404: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:44:02.405183326Z [2024-05-26 00:44:02,405: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:44:02.405303927Z [2024-05-26 00:44:02,405: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:44:02.405341624Z [2024-05-26 00:44:02,405: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:44:02.405591596Z [2024-05-26 00:44:02,405: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:44:02.405623872Z [2024-05-26 00:44:02,405: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:44:02.493238039Z [2024-05-26 00:44:02,492: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:44:02.517521687Z [2024-05-26 00:44:02,517: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:44:02.521040841Z [2024-05-26 00:44:02,520: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:44:02.537058286Z [2024-05-26 00:44:02,536: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:44:02.538103177Z [2024-05-26 00:44:02,537: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:44:02.538258136Z [2024-05-26 00:44:02,538: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:44:02.538431391Z [2024-05-26 00:44:02,538: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:44:02.538512087Z [2024-05-26 00:44:02,538: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:44:02.538853135Z [2024-05-26 00:44:02,538: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:44:02.538964144Z [2024-05-26 00:44:02,538: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:44:02.634157259Z [2024-05-26 00:44:02,633: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:44:03.963982691Z [2024-05-26 00:44:03,963: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4700f65a-424c-4051-b3ab-539eadb40ca5] succeeded in 3.288031026000681s: None 2024-05-26T00:44:04.827862823Z [2024-05-26 00:44:04,827: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1343ec76-7ab1-447a-bbe9-de0244d06e90] succeeded in 4.15314367999963s: None 2024-05-26T00:45:00.962555610Z [2024-05-26 00:45:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f74a207-f45d-406e-9623-410a524effba] received 2024-05-26T00:45:00.966636772Z [2024-05-26 00:45:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5383205b-1a6f-4fb3-b855-95b0bd746e4e] received 2024-05-26T00:45:00.970720176Z [2024-05-26 00:45:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37a06194-f929-40bc-98a8-fc547d86a835] received 2024-05-26T00:45:00.974698148Z [2024-05-26 00:45:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cc2c572-ebd3-4feb-aa89-f1b09b34a20e] received 2024-05-26T00:45:00.978141686Z [2024-05-26 00:45:00,977: INFO/ForkPoolWorker-15] [4f74a207-f45d-406e-9623-410a524effba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:45:00.986365630Z [2024-05-26 00:45:00,986: INFO/ForkPoolWorker-1] [37a06194-f929-40bc-98a8-fc547d86a835] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:45:00.987097835Z [2024-05-26 00:45:00,986: INFO/ForkPoolWorker-16] [5383205b-1a6f-4fb3-b855-95b0bd746e4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:45:00.987787084Z [2024-05-26 00:45:00,986: INFO/ForkPoolWorker-2] [4cc2c572-ebd3-4feb-aa89-f1b09b34a20e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:45:01.316634439Z [2024-05-26 00:45:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:45:01.345432644Z [2024-05-26 00:45:01,341: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:45:01.351782217Z [2024-05-26 00:45:01,348: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:45:01.355649220Z [2024-05-26 00:45:01,344: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:45:01.538748019Z [2024-05-26 00:45:01,538: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:45:01.543145741Z [2024-05-26 00:45:01,542: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:45:01.592531436Z [2024-05-26 00:45:01,592: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:45:01.596497937Z [2024-05-26 00:45:01,596: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:45:01.596531595Z [2024-05-26 00:45:01,596: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:45:01.596611882Z [2024-05-26 00:45:01,596: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:45:01.596781929Z [2024-05-26 00:45:01,596: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:45:01.709349736Z [2024-05-26 00:45:01,709: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:45:02.389311752Z [2024-05-26 00:45:02,388: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37a06194-f929-40bc-98a8-fc547d86a835] succeeded in 1.4133909850006603s: None 2024-05-26T00:45:02.674689382Z [2024-05-26 00:45:02,674: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:45:02.677838627Z [2024-05-26 00:45:02,677: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:45:02.689846265Z [2024-05-26 00:45:02,689: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:45:02.693212604Z [2024-05-26 00:45:02,692: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:45:02.704952432Z [2024-05-26 00:45:02,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:45:02.706393860Z [2024-05-26 00:45:02,706: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:45:02.706805085Z [2024-05-26 00:45:02,706: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:45:02.706973623Z [2024-05-26 00:45:02,706: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:45:02.707047687Z [2024-05-26 00:45:02,706: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:45:02.707345336Z [2024-05-26 00:45:02,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:45:02.707621160Z [2024-05-26 00:45:02,707: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:45:02.715039046Z [2024-05-26 00:45:02,714: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:45:02.716683972Z [2024-05-26 00:45:02,716: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:45:02.716894120Z [2024-05-26 00:45:02,716: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:45:02.717103022Z [2024-05-26 00:45:02,716: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:45:02.717273889Z [2024-05-26 00:45:02,717: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:45:02.717684009Z [2024-05-26 00:45:02,717: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:45:02.717834807Z [2024-05-26 00:45:02,717: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:45:02.776383904Z [2024-05-26 00:45:02,776: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:45:02.780249323Z [2024-05-26 00:45:02,779: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:45:02.783440650Z [2024-05-26 00:45:02,783: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:45:02.800903691Z [2024-05-26 00:45:02,800: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:45:02.802238651Z [2024-05-26 00:45:02,802: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:45:02.802280832Z [2024-05-26 00:45:02,802: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:45:02.802443200Z [2024-05-26 00:45:02,802: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:45:02.802560163Z [2024-05-26 00:45:02,802: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:45:02.803020861Z [2024-05-26 00:45:02,802: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:45:02.803090717Z [2024-05-26 00:45:02,803: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:45:02.812161302Z [2024-05-26 00:45:02,811: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:45:02.877035162Z [2024-05-26 00:45:02,876: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:45:03.472758924Z [2024-05-26 00:45:03,472: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5383205b-1a6f-4fb3-b855-95b0bd746e4e] succeeded in 2.502850696000678s: None 2024-05-26T00:45:03.844142390Z [2024-05-26 00:45:03,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cae19185-6fab-4452-90a0-f17021c3fb24] received 2024-05-26T00:45:03.857877863Z [2024-05-26 00:45:03,857: INFO/ForkPoolWorker-16] [cae19185-6fab-4452-90a0-f17021c3fb24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:45:04.211364802Z [2024-05-26 00:45:04,205: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:45:04.236492624Z [2024-05-26 00:45:04,236: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f74a207-f45d-406e-9623-410a524effba] succeeded in 3.2713035879996823s: None 2024-05-26T00:45:04.826287900Z [2024-05-26 00:45:04,825: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4cc2c572-ebd3-4feb-aa89-f1b09b34a20e] succeeded in 3.8487052840000615s: None 2024-05-26T00:45:05.513747662Z [2024-05-26 00:45:05,513: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:45:05.517067975Z [2024-05-26 00:45:05,516: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:45:05.542388072Z [2024-05-26 00:45:05,542: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:45:05.543493847Z [2024-05-26 00:45:05,543: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:45:05.543558984Z [2024-05-26 00:45:05,543: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:45:05.544948571Z [2024-05-26 00:45:05,543: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:45:05.544962134Z [2024-05-26 00:45:05,543: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:45:05.544966285Z [2024-05-26 00:45:05,543: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:45:05.544969853Z [2024-05-26 00:45:05,543: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:45:05.615651614Z [2024-05-26 00:45:05,615: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:45:06.268432263Z [2024-05-26 00:45:06,267: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cae19185-6fab-4452-90a0-f17021c3fb24] succeeded in 2.419814957998824s: None 2024-05-26T00:45:07.050780688Z [2024-05-26 00:45:07,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[231fe79a-be9e-4c93-a785-85ccfb780451] received 2024-05-26T00:45:07.059350658Z [2024-05-26 00:45:07,058: INFO/ForkPoolWorker-15] [231fe79a-be9e-4c93-a785-85ccfb780451] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:45:07.371862192Z [2024-05-26 00:45:07,368: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:45:08.547081747Z [2024-05-26 00:45:08,546: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:45:08.551478867Z [2024-05-26 00:45:08,550: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:45:08.572970132Z [2024-05-26 00:45:08,572: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:45:08.576656708Z [2024-05-26 00:45:08,576: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:45:08.576783491Z [2024-05-26 00:45:08,576: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:45:08.577454521Z [2024-05-26 00:45:08,577: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:45:08.577585724Z [2024-05-26 00:45:08,577: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:45:08.578222107Z [2024-05-26 00:45:08,577: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:45:08.578451952Z [2024-05-26 00:45:08,578: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:45:08.663998965Z [2024-05-26 00:45:08,663: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:45:09.136749134Z [2024-05-26 00:45:09,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bc3c438-ab9f-4df4-8570-ad8bf9abbfe9] received 2024-05-26T00:45:09.143707727Z [2024-05-26 00:45:09,143: INFO/ForkPoolWorker-16] [3bc3c438-ab9f-4df4-8570-ad8bf9abbfe9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:45:09.205271424Z [2024-05-26 00:45:09,204: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[231fe79a-be9e-4c93-a785-85ccfb780451] succeeded in 2.1523905119993287s: None 2024-05-26T00:45:09.410292476Z [2024-05-26 00:45:09,407: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:45:10.490519252Z [2024-05-26 00:45:10,490: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:45:10.494287963Z [2024-05-26 00:45:10,493: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:45:10.512782103Z [2024-05-26 00:45:10,512: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:45:10.514135975Z [2024-05-26 00:45:10,513: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:45:10.514323149Z [2024-05-26 00:45:10,514: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:45:10.514557109Z [2024-05-26 00:45:10,514: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:45:10.514724314Z [2024-05-26 00:45:10,514: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:45:10.515063904Z [2024-05-26 00:45:10,514: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:45:10.515207025Z [2024-05-26 00:45:10,515: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:45:10.594853308Z [2024-05-26 00:45:10,594: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:45:11.177340644Z [2024-05-26 00:45:11,176: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3bc3c438-ab9f-4df4-8570-ad8bf9abbfe9] succeeded in 2.0383287540007586s: None 2024-05-26T00:46:00.916849592Z [2024-05-26 00:46:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36b8b2e7-de9c-4b73-8437-4ce3735e2a85] received 2024-05-26T00:46:00.918297907Z [2024-05-26 00:46:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53d890f7-f5f7-425b-9b44-5e5414304ea7] received 2024-05-26T00:46:00.928468403Z [2024-05-26 00:46:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abf01106-f9f4-4f81-9b61-5af09108599f] received 2024-05-26T00:46:00.929951715Z [2024-05-26 00:46:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eca11c44-ec45-47c0-a527-48598b688b70] received 2024-05-26T00:46:00.931195141Z [2024-05-26 00:46:00,930: INFO/ForkPoolWorker-16] [53d890f7-f5f7-425b-9b44-5e5414304ea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:46:00.937477669Z [2024-05-26 00:46:00,937: INFO/ForkPoolWorker-15] [36b8b2e7-de9c-4b73-8437-4ce3735e2a85] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:46:00.940657717Z [2024-05-26 00:46:00,940: INFO/ForkPoolWorker-1] [abf01106-f9f4-4f81-9b61-5af09108599f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:46:00.951112555Z [2024-05-26 00:46:00,950: INFO/ForkPoolWorker-2] [eca11c44-ec45-47c0-a527-48598b688b70] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:46:01.237637178Z [2024-05-26 00:46:01,234: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:46:01.284521330Z [2024-05-26 00:46:01,281: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:46:01.386787474Z [2024-05-26 00:46:01,383: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:46:01.452792001Z [2024-05-26 00:46:01,452: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:46:01.456543305Z [2024-05-26 00:46:01,456: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:46:01.492033625Z [2024-05-26 00:46:01,491: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:46:01.496616451Z [2024-05-26 00:46:01,496: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:46:01.496770516Z [2024-05-26 00:46:01,496: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:46:01.496901959Z [2024-05-26 00:46:01,496: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:46:01.497217330Z [2024-05-26 00:46:01,497: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:46:01.497481060Z [2024-05-26 00:46:01,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:46:01.694723512Z [2024-05-26 00:46:01,694: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:46:01.939551436Z [2024-05-26 00:46:01,939: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:46:02.516736654Z [2024-05-26 00:46:02,516: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eca11c44-ec45-47c0-a527-48598b688b70] succeeded in 1.5831782619989099s: None 2024-05-26T00:46:02.721185544Z [2024-05-26 00:46:02,720: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36b8b2e7-de9c-4b73-8437-4ce3735e2a85] succeeded in 1.8000209829988307s: None 2024-05-26T00:46:02.820266971Z [2024-05-26 00:46:02,819: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:46:02.823608436Z [2024-05-26 00:46:02,823: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:46:02.859326223Z [2024-05-26 00:46:02,859: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:46:02.873176253Z [2024-05-26 00:46:02,870: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:46:02.873195149Z [2024-05-26 00:46:02,870: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:46:02.873200894Z [2024-05-26 00:46:02,870: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:46:02.873206335Z [2024-05-26 00:46:02,870: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:46:02.873211420Z [2024-05-26 00:46:02,871: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:46:02.873216492Z [2024-05-26 00:46:02,871: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:46:02.987210073Z [2024-05-26 00:46:02,986: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:46:03.207746298Z [2024-05-26 00:46:03,204: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:46:03.212673503Z [2024-05-26 00:46:03,208: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:46:03.252633405Z [2024-05-26 00:46:03,252: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:46:03.254321774Z [2024-05-26 00:46:03,254: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:46:03.254334451Z [2024-05-26 00:46:03,254: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:46:03.256690574Z [2024-05-26 00:46:03,254: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:46:03.256858550Z [2024-05-26 00:46:03,256: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:46:03.257192600Z [2024-05-26 00:46:03,257: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:46:03.257307046Z [2024-05-26 00:46:03,257: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:46:03.423625895Z [2024-05-26 00:46:03,418: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:46:05.176309131Z [2024-05-26 00:46:05,175: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abf01106-f9f4-4f81-9b61-5af09108599f] succeeded in 4.244649645001118s: None 2024-05-26T00:46:05.847084664Z [2024-05-26 00:46:05,844: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53d890f7-f5f7-425b-9b44-5e5414304ea7] succeeded in 4.922872175999146s: None 2024-05-26T00:47:00.660703289Z [2024-05-26 00:47:00,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ac18334-416f-4be5-a893-ea4adb19deb6] received 2024-05-26T00:47:00.666010300Z [2024-05-26 00:47:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85a9b7f1-b94c-453a-836c-21d448589099] received 2024-05-26T00:47:00.668678786Z [2024-05-26 00:47:00,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d81db7c-1638-4415-bdcc-bf4ff6b7ac67] received 2024-05-26T00:47:00.676506795Z [2024-05-26 00:47:00,676: INFO/ForkPoolWorker-15] [1ac18334-416f-4be5-a893-ea4adb19deb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:47:00.687284960Z [2024-05-26 00:47:00,686: INFO/ForkPoolWorker-16] [85a9b7f1-b94c-453a-836c-21d448589099] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:47:00.695745882Z [2024-05-26 00:47:00,693: INFO/ForkPoolWorker-1] [4d81db7c-1638-4415-bdcc-bf4ff6b7ac67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:47:00.987677943Z [2024-05-26 00:47:00,984: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:47:01.015605998Z [2024-05-26 00:47:01,011: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:47:01.102443365Z [2024-05-26 00:47:01,099: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:47:01.187045824Z [2024-05-26 00:47:01,186: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:47:01.191248995Z [2024-05-26 00:47:01,190: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:47:01.219201745Z [2024-05-26 00:47:01,218: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:47:01.221150408Z [2024-05-26 00:47:01,220: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:47:01.221306173Z [2024-05-26 00:47:01,221: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:47:01.221392832Z [2024-05-26 00:47:01,221: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:47:01.221684834Z [2024-05-26 00:47:01,221: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:47:01.350992379Z [2024-05-26 00:47:01,350: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:47:01.943155268Z [2024-05-26 00:47:01,942: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d81db7c-1638-4415-bdcc-bf4ff6b7ac67] succeeded in 1.2682049769991863s: None 2024-05-26T00:47:02.191147824Z [2024-05-26 00:47:02,190: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:47:02.194536058Z [2024-05-26 00:47:02,194: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:47:02.217855006Z [2024-05-26 00:47:02,217: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:47:02.219330308Z [2024-05-26 00:47:02,219: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:47:02.219472776Z [2024-05-26 00:47:02,219: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:47:02.219764285Z [2024-05-26 00:47:02,219: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:47:02.219916160Z [2024-05-26 00:47:02,219: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:47:02.220294178Z [2024-05-26 00:47:02,220: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:47:02.220453337Z [2024-05-26 00:47:02,220: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:47:02.222511954Z [2024-05-26 00:47:02,222: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:47:02.225692832Z [2024-05-26 00:47:02,225: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:47:02.251992729Z [2024-05-26 00:47:02,251: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:47:02.255260354Z [2024-05-26 00:47:02,255: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:47:02.255548700Z [2024-05-26 00:47:02,255: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:47:02.255822658Z [2024-05-26 00:47:02,255: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:47:02.256017587Z [2024-05-26 00:47:02,255: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:47:02.256449434Z [2024-05-26 00:47:02,256: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:47:02.256650793Z [2024-05-26 00:47:02,256: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:47:02.326066776Z [2024-05-26 00:47:02,325: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:47:02.352302722Z [2024-05-26 00:47:02,352: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:47:03.867326964Z [2024-05-26 00:47:03,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ac18334-416f-4be5-a893-ea4adb19deb6] succeeded in 3.199749318000613s: None 2024-05-26T00:47:04.117673962Z [2024-05-26 00:47:04,109: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85a9b7f1-b94c-453a-836c-21d448589099] succeeded in 3.4419575369993254s: None 2024-05-26T00:48:00.628045229Z [2024-05-26 00:48:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05638726-5f90-45e7-ac58-8dd9714f2c60] received 2024-05-26T00:48:00.633220029Z [2024-05-26 00:48:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd3ce0c5-82ba-47a5-a782-4f43cfacfb6b] received 2024-05-26T00:48:00.636019175Z [2024-05-26 00:48:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96b271f6-71f1-4760-bbc5-81bc82c8dd59] received 2024-05-26T00:48:00.638377503Z [2024-05-26 00:48:00,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62d7c0f7-80be-4931-b7a4-a226c707d964] received 2024-05-26T00:48:00.647725434Z [2024-05-26 00:48:00,647: INFO/ForkPoolWorker-1] [96b271f6-71f1-4760-bbc5-81bc82c8dd59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:48:00.653255123Z [2024-05-26 00:48:00,652: INFO/ForkPoolWorker-15] [05638726-5f90-45e7-ac58-8dd9714f2c60] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:48:00.653291242Z [2024-05-26 00:48:00,653: INFO/ForkPoolWorker-16] [bd3ce0c5-82ba-47a5-a782-4f43cfacfb6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:48:00.661159991Z [2024-05-26 00:48:00,660: INFO/ForkPoolWorker-2] [62d7c0f7-80be-4931-b7a4-a226c707d964] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:48:00.987513497Z [2024-05-26 00:48:00,983: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:48:00.988847621Z [2024-05-26 00:48:00,983: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:48:00.990644619Z [2024-05-26 00:48:00,987: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:48:01.023851867Z [2024-05-26 00:48:01,015: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:48:01.168433777Z [2024-05-26 00:48:01,168: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:48:01.171984738Z [2024-05-26 00:48:01,171: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:48:01.219023422Z [2024-05-26 00:48:01,218: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:48:01.221147098Z [2024-05-26 00:48:01,220: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:48:01.221199040Z [2024-05-26 00:48:01,221: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:48:01.221243156Z [2024-05-26 00:48:01,221: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:48:01.221456903Z [2024-05-26 00:48:01,221: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:48:01.265910076Z [2024-05-26 00:48:01,265: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:48:01.341246899Z [2024-05-26 00:48:01,341: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:48:01.908606105Z [2024-05-26 00:48:01,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05638726-5f90-45e7-ac58-8dd9714f2c60] succeeded in 1.2780813579993264s: None 2024-05-26T00:48:01.924984068Z [2024-05-26 00:48:01,924: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[62d7c0f7-80be-4931-b7a4-a226c707d964] succeeded in 1.2841333960004704s: None 2024-05-26T00:48:02.294849160Z [2024-05-26 00:48:02,294: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:48:02.298370004Z [2024-05-26 00:48:02,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:48:02.324580413Z [2024-05-26 00:48:02,324: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:48:02.326267716Z [2024-05-26 00:48:02,326: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:48:02.326393879Z [2024-05-26 00:48:02,326: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:48:02.326630044Z [2024-05-26 00:48:02,326: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:48:02.326745519Z [2024-05-26 00:48:02,326: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:48:02.327076511Z [2024-05-26 00:48:02,326: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:48:02.327342016Z [2024-05-26 00:48:02,327: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:48:02.398942546Z [2024-05-26 00:48:02,398: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:48:02.402162702Z [2024-05-26 00:48:02,401: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:48:02.418911164Z [2024-05-26 00:48:02,418: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:48:02.420157317Z [2024-05-26 00:48:02,419: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:48:02.420196880Z [2024-05-26 00:48:02,420: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:48:02.420351444Z [2024-05-26 00:48:02,420: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:48:02.420401002Z [2024-05-26 00:48:02,420: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:48:02.420642838Z [2024-05-26 00:48:02,420: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:48:02.420690141Z [2024-05-26 00:48:02,420: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:48:02.441667983Z [2024-05-26 00:48:02,441: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:48:02.498088203Z [2024-05-26 00:48:02,497: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:48:04.191995018Z [2024-05-26 00:48:04,191: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[96b271f6-71f1-4760-bbc5-81bc82c8dd59] succeeded in 3.5537546969990217s: None 2024-05-26T00:48:04.452170564Z [2024-05-26 00:48:04,448: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd3ce0c5-82ba-47a5-a782-4f43cfacfb6b] succeeded in 3.8125190020000446s: None 2024-05-26T00:49:00.652748619Z [2024-05-26 00:49:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[705727fe-66fa-43de-9366-772e2ac9ec1c] received 2024-05-26T00:49:00.654601610Z [2024-05-26 00:49:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4179a16-3a63-4ce8-9ac7-d59de85df33d] received 2024-05-26T00:49:00.658987745Z [2024-05-26 00:49:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c06d9be1-812b-4405-9fbe-0249383ec703] received 2024-05-26T00:49:00.671407289Z [2024-05-26 00:49:00,671: INFO/ForkPoolWorker-15] [705727fe-66fa-43de-9366-772e2ac9ec1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:49:00.679206558Z [2024-05-26 00:49:00,678: INFO/ForkPoolWorker-1] [c06d9be1-812b-4405-9fbe-0249383ec703] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:49:00.689020374Z [2024-05-26 00:49:00,688: INFO/ForkPoolWorker-16] [f4179a16-3a63-4ce8-9ac7-d59de85df33d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:49:01.034117820Z [2024-05-26 00:49:01,029: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:49:01.065106033Z [2024-05-26 00:49:01,062: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:49:01.077794297Z [2024-05-26 00:49:01,073: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:49:01.207468177Z [2024-05-26 00:49:01,206: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:49:01.211392230Z [2024-05-26 00:49:01,210: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:49:01.236747509Z [2024-05-26 00:49:01,236: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:49:01.238324009Z [2024-05-26 00:49:01,238: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:49:01.238552195Z [2024-05-26 00:49:01,238: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:49:01.238713526Z [2024-05-26 00:49:01,238: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:49:01.238998532Z [2024-05-26 00:49:01,238: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:49:01.366091464Z [2024-05-26 00:49:01,365: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:49:02.014492439Z [2024-05-26 00:49:02,014: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4179a16-3a63-4ce8-9ac7-d59de85df33d] succeeded in 1.357692739000413s: None 2024-05-26T00:49:02.322032583Z [2024-05-26 00:49:02,321: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:49:02.325385096Z [2024-05-26 00:49:02,324: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:49:02.346580276Z [2024-05-26 00:49:02,346: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:49:02.350283027Z [2024-05-26 00:49:02,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:49:02.358923806Z [2024-05-26 00:49:02,358: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:49:02.360763841Z [2024-05-26 00:49:02,360: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:49:02.360925988Z [2024-05-26 00:49:02,360: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:49:02.361177110Z [2024-05-26 00:49:02,360: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:49:02.361548638Z [2024-05-26 00:49:02,361: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:49:02.361798624Z [2024-05-26 00:49:02,361: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:49:02.361874139Z [2024-05-26 00:49:02,361: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:49:02.387595941Z [2024-05-26 00:49:02,387: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:49:02.389560868Z [2024-05-26 00:49:02,389: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:49:02.389745293Z [2024-05-26 00:49:02,389: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:49:02.390002252Z [2024-05-26 00:49:02,389: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:49:02.390120762Z [2024-05-26 00:49:02,389: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:49:02.390515922Z [2024-05-26 00:49:02,390: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:49:02.390695604Z [2024-05-26 00:49:02,390: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:49:02.467550860Z [2024-05-26 00:49:02,467: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:49:02.505638067Z [2024-05-26 00:49:02,505: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:49:04.201571731Z [2024-05-26 00:49:04,200: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[705727fe-66fa-43de-9366-772e2ac9ec1c] succeeded in 3.5450132280002435s: None 2024-05-26T00:49:04.717488352Z [2024-05-26 00:49:04,717: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c06d9be1-812b-4405-9fbe-0249383ec703] succeeded in 4.0564618009993865s: None 2024-05-26T00:50:00.739695768Z [2024-05-26 00:50:00,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b5cc026-1608-4605-8007-694238bcd479] received 2024-05-26T00:50:00.740828991Z [2024-05-26 00:50:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33fa622b-9be9-4780-88a9-91d9b4394a50] received 2024-05-26T00:50:00.756291825Z [2024-05-26 00:50:00,755: INFO/ForkPoolWorker-15] [7b5cc026-1608-4605-8007-694238bcd479] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:50:00.756802393Z [2024-05-26 00:50:00,756: INFO/ForkPoolWorker-16] [33fa622b-9be9-4780-88a9-91d9b4394a50] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:50:00.764832135Z [2024-05-26 00:50:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a4deb2d-2d70-4786-8f4c-c322e147e1a4] received 2024-05-26T00:50:00.766231060Z [2024-05-26 00:50:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dde1d774-d477-489e-a838-0fff855a4f68] received 2024-05-26T00:50:00.774015967Z [2024-05-26 00:50:00,772: INFO/ForkPoolWorker-1] [8a4deb2d-2d70-4786-8f4c-c322e147e1a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:50:00.777371462Z [2024-05-26 00:50:00,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00d7bf3c-ac42-4dd7-b692-603b11fb88b6] received 2024-05-26T00:50:00.779629943Z [2024-05-26 00:50:00,777: INFO/ForkPoolWorker-2] [dde1d774-d477-489e-a838-0fff855a4f68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:50:00.802462134Z [2024-05-26 00:50:00,801: INFO/ForkPoolWorker-3] [00d7bf3c-ac42-4dd7-b692-603b11fb88b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:50:01.216303254Z [2024-05-26 00:50:01,212: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:50:01.239474207Z [2024-05-26 00:50:01,236: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:50:01.249803684Z [2024-05-26 00:50:01,245: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:50:01.256826697Z [2024-05-26 00:50:01,252: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:50:01.352352476Z [2024-05-26 00:50:01,317: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:50:01.638518526Z [2024-05-26 00:50:01,638: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:50:01.727038918Z [2024-05-26 00:50:01,726: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:50:01.733825771Z [2024-05-26 00:50:01,733: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:50:01.765343739Z [2024-05-26 00:50:01,764: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:50:01.768040434Z [2024-05-26 00:50:01,767: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:50:01.768134435Z [2024-05-26 00:50:01,767: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:50:01.768166720Z [2024-05-26 00:50:01,768: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:50:01.768380586Z [2024-05-26 00:50:01,768: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:50:01.898951176Z [2024-05-26 00:50:01,898: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:50:02.305519555Z [2024-05-26 00:50:02,305: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33fa622b-9be9-4780-88a9-91d9b4394a50] succeeded in 1.5628645409997262s: None 2024-05-26T00:50:02.496349043Z [2024-05-26 00:50:02,495: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a4deb2d-2d70-4786-8f4c-c322e147e1a4] succeeded in 1.7298019509998994s: None 2024-05-26T00:50:02.559562940Z [2024-05-26 00:50:02,559: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:50:02.568108906Z [2024-05-26 00:50:02,567: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:50:02.593385750Z [2024-05-26 00:50:02,593: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:50:02.596343893Z [2024-05-26 00:50:02,595: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:50:02.608652401Z [2024-05-26 00:50:02,608: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:50:02.610373150Z [2024-05-26 00:50:02,610: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:50:02.610549762Z [2024-05-26 00:50:02,610: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:50:02.610746745Z [2024-05-26 00:50:02,610: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:50:02.610864517Z [2024-05-26 00:50:02,610: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:50:02.611247776Z [2024-05-26 00:50:02,611: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:50:02.611404930Z [2024-05-26 00:50:02,611: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:50:02.615591429Z [2024-05-26 00:50:02,615: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:50:02.616682441Z [2024-05-26 00:50:02,616: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:50:02.616699416Z [2024-05-26 00:50:02,616: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:50:02.616805314Z [2024-05-26 00:50:02,616: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:50:02.616828997Z [2024-05-26 00:50:02,616: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:50:02.617038325Z [2024-05-26 00:50:02,616: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:50:02.617096566Z [2024-05-26 00:50:02,617: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:50:02.692506438Z [2024-05-26 00:50:02,692: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:50:02.709685189Z [2024-05-26 00:50:02,709: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:50:02.879555172Z [2024-05-26 00:50:02,879: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T00:50:02.882690697Z [2024-05-26 00:50:02,882: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:50:02.908769103Z [2024-05-26 00:50:02,908: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T00:50:02.909840599Z [2024-05-26 00:50:02,909: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:50:02.909863999Z [2024-05-26 00:50:02,909: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:50:02.909964945Z [2024-05-26 00:50:02,909: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:50:02.910001469Z [2024-05-26 00:50:02,909: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T00:50:02.910213404Z [2024-05-26 00:50:02,910: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:50:02.910236731Z [2024-05-26 00:50:02,910: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:50:03.018192530Z [2024-05-26 00:50:03,017: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:50:03.275181819Z [2024-05-26 00:50:03,274: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b5cc026-1608-4605-8007-694238bcd479] succeeded in 2.5329883249996783s: None 2024-05-26T00:50:03.810676932Z [2024-05-26 00:50:03,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63f880c4-ff95-49ac-84ea-5d14e84ddc7e] received 2024-05-26T00:50:03.829311404Z [2024-05-26 00:50:03,829: INFO/ForkPoolWorker-15] [63f880c4-ff95-49ac-84ea-5d14e84ddc7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:50:04.121033959Z [2024-05-26 00:50:04,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:50:04.631565719Z [2024-05-26 00:50:04,631: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dde1d774-d477-489e-a838-0fff855a4f68] succeeded in 3.863073958998939s: None 2024-05-26T00:50:04.696085588Z [2024-05-26 00:50:04,695: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[00d7bf3c-ac42-4dd7-b692-603b11fb88b6] succeeded in 3.911914215001161s: None 2024-05-26T00:50:05.569613591Z [2024-05-26 00:50:05,569: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:50:05.572740923Z [2024-05-26 00:50:05,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:50:05.619148781Z [2024-05-26 00:50:05,616: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:50:05.627645100Z [2024-05-26 00:50:05,620: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:50:05.627680179Z [2024-05-26 00:50:05,620: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:50:05.627684922Z [2024-05-26 00:50:05,620: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:50:05.627696231Z [2024-05-26 00:50:05,620: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:50:05.627699749Z [2024-05-26 00:50:05,620: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:50:05.627703247Z [2024-05-26 00:50:05,620: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:50:05.761359894Z [2024-05-26 00:50:05,761: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:50:06.444407898Z [2024-05-26 00:50:06,443: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63f880c4-ff95-49ac-84ea-5d14e84ddc7e] succeeded in 2.6299910149991774s: None 2024-05-26T00:50:07.394048591Z [2024-05-26 00:50:07,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b175c0b7-f634-436e-a753-21e222dd4136] received 2024-05-26T00:50:07.405856630Z [2024-05-26 00:50:07,405: INFO/ForkPoolWorker-15] [b175c0b7-f634-436e-a753-21e222dd4136] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:50:07.672218992Z [2024-05-26 00:50:07,668: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:50:08.769298082Z [2024-05-26 00:50:08,768: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:50:08.772438692Z [2024-05-26 00:50:08,771: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:50:08.793051556Z [2024-05-26 00:50:08,792: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:50:08.795837250Z [2024-05-26 00:50:08,795: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:50:08.795920828Z [2024-05-26 00:50:08,795: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:50:08.796082784Z [2024-05-26 00:50:08,795: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:50:08.796232334Z [2024-05-26 00:50:08,796: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:50:08.796517659Z [2024-05-26 00:50:08,796: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:50:08.796573958Z [2024-05-26 00:50:08,796: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:50:08.892743363Z [2024-05-26 00:50:08,892: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:50:09.528256767Z [2024-05-26 00:50:09,527: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b175c0b7-f634-436e-a753-21e222dd4136] succeeded in 2.13667070199881s: None 2024-05-26T00:50:09.707784572Z [2024-05-26 00:50:09,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1678355-ef5e-4ef5-88c8-982b1ba4b2dd] received 2024-05-26T00:50:09.729196781Z [2024-05-26 00:50:09,728: INFO/ForkPoolWorker-15] [b1678355-ef5e-4ef5-88c8-982b1ba4b2dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:50:10.024298602Z [2024-05-26 00:50:10,020: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:50:11.249837886Z [2024-05-26 00:50:11,249: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:50:11.254048851Z [2024-05-26 00:50:11,253: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:50:11.284861719Z [2024-05-26 00:50:11,284: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:50:11.286692623Z [2024-05-26 00:50:11,286: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:50:11.286875570Z [2024-05-26 00:50:11,286: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:50:11.287098313Z [2024-05-26 00:50:11,286: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:50:11.287222274Z [2024-05-26 00:50:11,287: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:50:11.287991422Z [2024-05-26 00:50:11,287: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:50:11.288416302Z [2024-05-26 00:50:11,287: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:50:11.390284968Z [2024-05-26 00:50:11,389: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:50:12.031661493Z [2024-05-26 00:50:12,031: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1678355-ef5e-4ef5-88c8-982b1ba4b2dd] succeeded in 2.318110889000309s: None 2024-05-26T00:51:00.607296990Z [2024-05-26 00:51:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89d0ed97-1761-47ec-b808-a3e7e9858002] received 2024-05-26T00:51:00.614892984Z [2024-05-26 00:51:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a37a0fb1-9012-451b-91ae-b456719ecfdc] received 2024-05-26T00:51:00.616459437Z [2024-05-26 00:51:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36801bb7-a6ae-4be6-9bfc-d4920b632c28] received 2024-05-26T00:51:00.624460287Z [2024-05-26 00:51:00,624: INFO/ForkPoolWorker-15] [89d0ed97-1761-47ec-b808-a3e7e9858002] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:51:00.634769394Z [2024-05-26 00:51:00,634: INFO/ForkPoolWorker-1] [36801bb7-a6ae-4be6-9bfc-d4920b632c28] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:51:00.634794779Z [2024-05-26 00:51:00,634: INFO/ForkPoolWorker-16] [a37a0fb1-9012-451b-91ae-b456719ecfdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:51:00.993540697Z [2024-05-26 00:51:00,989: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:51:01.004333877Z [2024-05-26 00:51:00,980: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:51:01.026715301Z [2024-05-26 00:51:01,022: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:51:01.203663510Z [2024-05-26 00:51:01,203: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:51:01.208095333Z [2024-05-26 00:51:01,207: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:51:01.244748387Z [2024-05-26 00:51:01,244: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:51:01.245856019Z [2024-05-26 00:51:01,245: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:51:01.245887027Z [2024-05-26 00:51:01,245: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:51:01.246010150Z [2024-05-26 00:51:01,245: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:51:01.246184729Z [2024-05-26 00:51:01,246: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:51:01.394948831Z [2024-05-26 00:51:01,394: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:51:02.046685809Z [2024-05-26 00:51:02,046: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[36801bb7-a6ae-4be6-9bfc-d4920b632c28] succeeded in 1.4258897729996534s: None 2024-05-26T00:51:02.145247686Z [2024-05-26 00:51:02,144: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:51:02.148200410Z [2024-05-26 00:51:02,147: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:51:02.175053128Z [2024-05-26 00:51:02,174: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:51:02.177570434Z [2024-05-26 00:51:02,177: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:51:02.177757394Z [2024-05-26 00:51:02,177: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:51:02.177966781Z [2024-05-26 00:51:02,177: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:51:02.178168777Z [2024-05-26 00:51:02,177: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:51:02.178772512Z [2024-05-26 00:51:02,178: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:51:02.178958602Z [2024-05-26 00:51:02,178: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:51:02.264537866Z [2024-05-26 00:51:02,264: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:51:02.268024653Z [2024-05-26 00:51:02,267: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:51:02.274907807Z [2024-05-26 00:51:02,274: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:51:02.298475219Z [2024-05-26 00:51:02,298: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:51:02.300224983Z [2024-05-26 00:51:02,299: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:51:02.300250711Z [2024-05-26 00:51:02,300: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:51:02.300877020Z [2024-05-26 00:51:02,300: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:51:02.301163829Z [2024-05-26 00:51:02,300: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:51:02.302404899Z [2024-05-26 00:51:02,302: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:51:02.302417040Z [2024-05-26 00:51:02,302: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:51:02.399742946Z [2024-05-26 00:51:02,399: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:51:03.968654760Z [2024-05-26 00:51:03,968: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a37a0fb1-9012-451b-91ae-b456719ecfdc] succeeded in 3.347878877999392s: None 2024-05-26T00:51:04.169330152Z [2024-05-26 00:51:04,168: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89d0ed97-1761-47ec-b808-a3e7e9858002] succeeded in 3.5581073529992864s: None 2024-05-26T00:52:00.621594523Z [2024-05-26 00:52:00,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc16e230-a000-42f1-8e82-aede08ae4575] received 2024-05-26T00:52:00.627351392Z [2024-05-26 00:52:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[551d7d6e-84f6-45e0-b669-ce53165d2796] received 2024-05-26T00:52:00.640143430Z [2024-05-26 00:52:00,639: INFO/ForkPoolWorker-15] [bc16e230-a000-42f1-8e82-aede08ae4575] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:52:00.642274442Z [2024-05-26 00:52:00,641: INFO/ForkPoolWorker-16] [551d7d6e-84f6-45e0-b669-ce53165d2796] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:52:00.645509914Z [2024-05-26 00:52:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2acd7f93-80da-41c3-84cc-41894c27cbf1] received 2024-05-26T00:52:00.656079155Z [2024-05-26 00:52:00,655: INFO/ForkPoolWorker-1] [2acd7f93-80da-41c3-84cc-41894c27cbf1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:52:00.665546984Z [2024-05-26 00:52:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5b81f8f-a63c-4ee2-aaad-cc77a79cf432] received 2024-05-26T00:52:00.681734954Z [2024-05-26 00:52:00,681: INFO/ForkPoolWorker-2] [f5b81f8f-a63c-4ee2-aaad-cc77a79cf432] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:52:01.017557939Z [2024-05-26 00:52:01,013: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:52:01.033272712Z [2024-05-26 00:52:01,029: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:52:01.126633545Z [2024-05-26 00:52:01,122: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:52:01.157122604Z [2024-05-26 00:52:01,153: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:52:01.318166143Z [2024-05-26 00:52:01,317: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:52:01.322630413Z [2024-05-26 00:52:01,321: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:52:01.358877966Z [2024-05-26 00:52:01,358: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:52:01.368699417Z [2024-05-26 00:52:01,368: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:52:01.368975739Z [2024-05-26 00:52:01,368: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:52:01.369141044Z [2024-05-26 00:52:01,368: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:52:01.369468408Z [2024-05-26 00:52:01,369: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:52:01.375206403Z [2024-05-26 00:52:01,374: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:52:01.475323836Z [2024-05-26 00:52:01,475: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:52:02.007257845Z [2024-05-26 00:52:02,006: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc16e230-a000-42f1-8e82-aede08ae4575] succeeded in 1.3800166639994131s: None 2024-05-26T00:52:02.142509437Z [2024-05-26 00:52:02,142: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f5b81f8f-a63c-4ee2-aaad-cc77a79cf432] succeeded in 1.4743170860001555s: None 2024-05-26T00:52:02.378844928Z [2024-05-26 00:52:02,378: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:52:02.382324030Z [2024-05-26 00:52:02,381: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:52:02.402523421Z [2024-05-26 00:52:02,402: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:52:02.403895896Z [2024-05-26 00:52:02,403: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:52:02.403920129Z [2024-05-26 00:52:02,403: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:52:02.404016993Z [2024-05-26 00:52:02,403: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:52:02.404038546Z [2024-05-26 00:52:02,403: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:52:02.404266491Z [2024-05-26 00:52:02,404: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:52:02.404278868Z [2024-05-26 00:52:02,404: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:52:02.479114122Z [2024-05-26 00:52:02,478: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:52:02.492618932Z [2024-05-26 00:52:02,492: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:52:02.495993398Z [2024-05-26 00:52:02,495: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:52:02.520479556Z [2024-05-26 00:52:02,520: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:52:02.521722521Z [2024-05-26 00:52:02,521: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:52:02.521793511Z [2024-05-26 00:52:02,521: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:52:02.521950362Z [2024-05-26 00:52:02,521: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:52:02.522010003Z [2024-05-26 00:52:02,521: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:52:02.522309355Z [2024-05-26 00:52:02,522: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:52:02.522374880Z [2024-05-26 00:52:02,522: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:52:02.638594261Z [2024-05-26 00:52:02,638: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:52:04.356386188Z [2024-05-26 00:52:04,355: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2acd7f93-80da-41c3-84cc-41894c27cbf1] succeeded in 3.707973247999689s: None 2024-05-26T00:52:04.675048157Z [2024-05-26 00:52:04,674: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[551d7d6e-84f6-45e0-b669-ce53165d2796] succeeded in 4.043625267999232s: None 2024-05-26T00:53:00.603854736Z [2024-05-26 00:53:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d6bd0a6-2d52-4464-b2ba-cb9301cceb5c] received 2024-05-26T00:53:00.609977943Z [2024-05-26 00:53:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b49ca88-88b7-47ad-be49-4c6d88e9f3bb] received 2024-05-26T00:53:00.611977133Z [2024-05-26 00:53:00,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cdcec2e-c621-4295-bdf4-2b2a67ad4ae0] received 2024-05-26T00:53:00.614899152Z [2024-05-26 00:53:00,614: INFO/ForkPoolWorker-15] [3d6bd0a6-2d52-4464-b2ba-cb9301cceb5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:53:00.627392859Z [2024-05-26 00:53:00,627: INFO/ForkPoolWorker-16] [5b49ca88-88b7-47ad-be49-4c6d88e9f3bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:53:00.628795125Z [2024-05-26 00:53:00,628: INFO/ForkPoolWorker-1] [2cdcec2e-c621-4295-bdf4-2b2a67ad4ae0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:53:00.934486321Z [2024-05-26 00:53:00,926: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:53:00.986070966Z [2024-05-26 00:53:00,983: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:53:00.995053733Z [2024-05-26 00:53:00,991: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:53:01.086919410Z [2024-05-26 00:53:01,086: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:53:01.091231759Z [2024-05-26 00:53:01,090: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:53:01.137247430Z [2024-05-26 00:53:01,137: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:53:01.140505489Z [2024-05-26 00:53:01,140: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:53:01.140596639Z [2024-05-26 00:53:01,140: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:53:01.140638838Z [2024-05-26 00:53:01,140: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:53:01.140851848Z [2024-05-26 00:53:01,140: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:53:01.246872461Z [2024-05-26 00:53:01,246: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:53:01.790940876Z [2024-05-26 00:53:01,790: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2cdcec2e-c621-4295-bdf4-2b2a67ad4ae0] succeeded in 1.1755175950002013s: None 2024-05-26T00:53:02.087352125Z [2024-05-26 00:53:02,087: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:53:02.090609948Z [2024-05-26 00:53:02,090: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:53:02.116287598Z [2024-05-26 00:53:02,116: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:53:02.117736046Z [2024-05-26 00:53:02,117: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:53:02.117847546Z [2024-05-26 00:53:02,117: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:53:02.118029620Z [2024-05-26 00:53:02,117: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:53:02.118127020Z [2024-05-26 00:53:02,118: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:53:02.118424004Z [2024-05-26 00:53:02,118: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:53:02.118524147Z [2024-05-26 00:53:02,118: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:53:02.216263203Z [2024-05-26 00:53:02,215: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:53:02.244744303Z [2024-05-26 00:53:02,244: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:53:02.247884967Z [2024-05-26 00:53:02,247: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:53:02.269509831Z [2024-05-26 00:53:02,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:53:02.270695670Z [2024-05-26 00:53:02,270: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:53:02.270710910Z [2024-05-26 00:53:02,270: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:53:02.270871032Z [2024-05-26 00:53:02,270: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:53:02.270906294Z [2024-05-26 00:53:02,270: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:53:02.271178206Z [2024-05-26 00:53:02,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:53:02.271217981Z [2024-05-26 00:53:02,271: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:53:02.375511323Z [2024-05-26 00:53:02,375: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:53:03.849916498Z [2024-05-26 00:53:03,849: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b49ca88-88b7-47ad-be49-4c6d88e9f3bb] succeeded in 3.236785148999843s: None 2024-05-26T00:53:05.494199776Z [2024-05-26 00:53:05,493: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d6bd0a6-2d52-4464-b2ba-cb9301cceb5c] succeeded in 4.888224012000137s: None 2024-05-26T00:54:00.556845710Z [2024-05-26 00:54:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed90e433-b34f-41a6-9efb-fa22c5928f32] received 2024-05-26T00:54:00.568387109Z [2024-05-26 00:54:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb8461fc-c254-413e-8279-2c4fd5674bb5] received 2024-05-26T00:54:00.573777852Z [2024-05-26 00:54:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b786ef3-4a97-4018-a1aa-91dfe333519a] received 2024-05-26T00:54:00.578413169Z [2024-05-26 00:54:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71c629ef-21d7-4f8e-ab30-d15b25808906] received 2024-05-26T00:54:00.581709913Z [2024-05-26 00:54:00,581: INFO/ForkPoolWorker-15] [ed90e433-b34f-41a6-9efb-fa22c5928f32] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:54:00.594588324Z [2024-05-26 00:54:00,594: INFO/ForkPoolWorker-16] [bb8461fc-c254-413e-8279-2c4fd5674bb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:54:00.599016283Z [2024-05-26 00:54:00,598: INFO/ForkPoolWorker-1] [3b786ef3-4a97-4018-a1aa-91dfe333519a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:54:00.604908956Z [2024-05-26 00:54:00,604: INFO/ForkPoolWorker-2] [71c629ef-21d7-4f8e-ab30-d15b25808906] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:54:01.010656079Z [2024-05-26 00:54:01,007: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:54:01.016568001Z [2024-05-26 00:54:01,012: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:54:01.167219752Z [2024-05-26 00:54:01,163: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:54:01.257021404Z [2024-05-26 00:54:01,252: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:54:01.305573622Z [2024-05-26 00:54:01,305: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:54:01.313339727Z [2024-05-26 00:54:01,312: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:54:01.355854708Z [2024-05-26 00:54:01,355: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:54:01.357691788Z [2024-05-26 00:54:01,357: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:54:01.357825222Z [2024-05-26 00:54:01,357: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:54:01.357929303Z [2024-05-26 00:54:01,357: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:54:01.358173298Z [2024-05-26 00:54:01,358: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:54:01.452426002Z [2024-05-26 00:54:01,452: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:54:01.584121820Z [2024-05-26 00:54:01,583: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:54:02.501642953Z [2024-05-26 00:54:02,501: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[71c629ef-21d7-4f8e-ab30-d15b25808906] succeeded in 1.9199987269985286s: None 2024-05-26T00:54:02.549823607Z [2024-05-26 00:54:02,549: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed90e433-b34f-41a6-9efb-fa22c5928f32] succeeded in 1.9779873309998948s: None 2024-05-26T00:54:02.849095038Z [2024-05-26 00:54:02,848: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:54:02.852213833Z [2024-05-26 00:54:02,851: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:54:02.888057786Z [2024-05-26 00:54:02,887: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:54:02.889450460Z [2024-05-26 00:54:02,889: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:54:02.889571631Z [2024-05-26 00:54:02,889: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:54:02.889742995Z [2024-05-26 00:54:02,889: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:54:02.889850792Z [2024-05-26 00:54:02,889: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:54:02.890142540Z [2024-05-26 00:54:02,890: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:54:02.890251872Z [2024-05-26 00:54:02,890: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:54:02.973948763Z [2024-05-26 00:54:02,973: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:54:03.025268534Z [2024-05-26 00:54:03,024: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:54:03.029260832Z [2024-05-26 00:54:03,028: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:54:03.077076143Z [2024-05-26 00:54:03,076: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:54:03.081292943Z [2024-05-26 00:54:03,080: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:54:03.081527765Z [2024-05-26 00:54:03,081: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:54:03.081746909Z [2024-05-26 00:54:03,081: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:54:03.081880845Z [2024-05-26 00:54:03,081: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:54:03.082202650Z [2024-05-26 00:54:03,082: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:54:03.082390570Z [2024-05-26 00:54:03,082: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:54:03.274796803Z [2024-05-26 00:54:03,274: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:54:04.730682599Z [2024-05-26 00:54:04,730: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3b786ef3-4a97-4018-a1aa-91dfe333519a] succeeded in 4.154408307000267s: None 2024-05-26T00:54:05.401117637Z [2024-05-26 00:54:05,400: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bb8461fc-c254-413e-8279-2c4fd5674bb5] succeeded in 4.828424904000713s: None 2024-05-26T00:55:00.269907793Z [2024-05-26 00:55:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0fbeb22-144f-4f46-a10d-ef64c1128fe1] received 2024-05-26T00:55:00.274330494Z [2024-05-26 00:55:00,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ad5a026-acea-46db-8700-e51b83e30f2c] received 2024-05-26T00:55:00.279447411Z [2024-05-26 00:55:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b818e279-0584-4fef-8beb-689a53d8ebb4] received 2024-05-26T00:55:00.282022584Z [2024-05-26 00:55:00,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e646a19-0cc5-47f3-8ef0-c316eda40db6] received 2024-05-26T00:55:00.289399325Z [2024-05-26 00:55:00,289: INFO/ForkPoolWorker-2] [7e646a19-0cc5-47f3-8ef0-c316eda40db6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:55:00.291356471Z [2024-05-26 00:55:00,291: INFO/ForkPoolWorker-15] [e0fbeb22-144f-4f46-a10d-ef64c1128fe1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:55:00.300587161Z [2024-05-26 00:55:00,300: INFO/ForkPoolWorker-1] [b818e279-0584-4fef-8beb-689a53d8ebb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:55:00.305245013Z [2024-05-26 00:55:00,304: INFO/ForkPoolWorker-16] [1ad5a026-acea-46db-8700-e51b83e30f2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:55:00.584461578Z [2024-05-26 00:55:00,581: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:55:00.642439360Z [2024-05-26 00:55:00,639: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:55:00.644641371Z [2024-05-26 00:55:00,641: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:55:00.670263621Z [2024-05-26 00:55:00,666: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:55:00.836073660Z [2024-05-26 00:55:00,828: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:55:00.847178129Z [2024-05-26 00:55:00,845: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:55:00.888906838Z [2024-05-26 00:55:00,888: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:55:00.890391629Z [2024-05-26 00:55:00,890: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:55:00.890535546Z [2024-05-26 00:55:00,890: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:55:00.890623861Z [2024-05-26 00:55:00,890: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:55:00.890892836Z [2024-05-26 00:55:00,890: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:55:00.974345906Z [2024-05-26 00:55:00,974: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:55:01.575040648Z [2024-05-26 00:55:01,574: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7e646a19-0cc5-47f3-8ef0-c316eda40db6] succeeded in 1.2912392229991383s: None 2024-05-26T00:55:01.855387614Z [2024-05-26 00:55:01,855: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:55:01.858745239Z [2024-05-26 00:55:01,858: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:55:01.880508303Z [2024-05-26 00:55:01,880: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:55:01.884583034Z [2024-05-26 00:55:01,884: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:55:01.884598877Z [2024-05-26 00:55:01,884: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:55:01.884722838Z [2024-05-26 00:55:01,884: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:55:01.884733637Z [2024-05-26 00:55:01,884: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:55:01.885000637Z [2024-05-26 00:55:01,884: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:55:01.885067744Z [2024-05-26 00:55:01,884: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:55:01.969284044Z [2024-05-26 00:55:01,968: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:55:02.019128643Z [2024-05-26 00:55:02,018: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:55:02.022721867Z [2024-05-26 00:55:02,022: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:55:02.044844178Z [2024-05-26 00:55:02,044: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:55:02.046217560Z [2024-05-26 00:55:02,046: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:55:02.046353124Z [2024-05-26 00:55:02,046: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:55:02.046540096Z [2024-05-26 00:55:02,046: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:55:02.046750763Z [2024-05-26 00:55:02,046: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:55:02.047115641Z [2024-05-26 00:55:02,046: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:55:02.047255656Z [2024-05-26 00:55:02,047: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:55:02.061447995Z [2024-05-26 00:55:02,061: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:55:02.064404994Z [2024-05-26 00:55:02,064: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:55:02.086673801Z [2024-05-26 00:55:02,086: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:55:02.088561339Z [2024-05-26 00:55:02,088: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:55:02.088735073Z [2024-05-26 00:55:02,088: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:55:02.088965005Z [2024-05-26 00:55:02,088: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:55:02.089437357Z [2024-05-26 00:55:02,089: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:55:02.090361482Z [2024-05-26 00:55:02,090: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:55:02.090487708Z [2024-05-26 00:55:02,090: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:55:02.122347211Z [2024-05-26 00:55:02,122: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:55:02.190950961Z [2024-05-26 00:55:02,190: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:55:02.647450712Z [2024-05-26 00:55:02,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0fbeb22-144f-4f46-a10d-ef64c1128fe1] succeeded in 2.3709168959994713s: None 2024-05-26T00:55:03.057801660Z [2024-05-26 00:55:03,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2e8c41b-561a-4742-9ab9-9e50ed98e2e6] received 2024-05-26T00:55:03.070292071Z [2024-05-26 00:55:03,069: INFO/ForkPoolWorker-15] [c2e8c41b-561a-4742-9ab9-9e50ed98e2e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:55:03.389728266Z [2024-05-26 00:55:03,386: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:55:03.792414890Z [2024-05-26 00:55:03,791: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b818e279-0584-4fef-8beb-689a53d8ebb4] succeeded in 3.5095302800000354s: None 2024-05-26T00:55:04.109189410Z [2024-05-26 00:55:04,108: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ad5a026-acea-46db-8700-e51b83e30f2c] succeeded in 3.8332773330002965s: None 2024-05-26T00:55:05.011213733Z [2024-05-26 00:55:05,010: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:55:05.015811819Z [2024-05-26 00:55:05,015: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:55:05.064656702Z [2024-05-26 00:55:05,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:55:05.066677687Z [2024-05-26 00:55:05,066: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:55:05.066699772Z [2024-05-26 00:55:05,066: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:55:05.066812229Z [2024-05-26 00:55:05,066: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:55:05.066823582Z [2024-05-26 00:55:05,066: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:55:05.067064314Z [2024-05-26 00:55:05,066: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:55:05.067078629Z [2024-05-26 00:55:05,067: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:55:05.255262516Z [2024-05-26 00:55:05,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:55:06.207933931Z [2024-05-26 00:55:06,207: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2e8c41b-561a-4742-9ab9-9e50ed98e2e6] succeeded in 3.147092076998888s: None 2024-05-26T00:55:06.513169490Z [2024-05-26 00:55:06,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc7765d4-8195-4a40-b093-5d0e90a58faa] received 2024-05-26T00:55:06.528133638Z [2024-05-26 00:55:06,527: INFO/ForkPoolWorker-15] [bc7765d4-8195-4a40-b093-5d0e90a58faa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:55:06.829053387Z [2024-05-26 00:55:06,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:55:07.975798986Z [2024-05-26 00:55:07,975: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:55:07.978784193Z [2024-05-26 00:55:07,978: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:55:08.000429505Z [2024-05-26 00:55:08,000: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:55:08.004944751Z [2024-05-26 00:55:08,004: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:55:08.005017112Z [2024-05-26 00:55:08,004: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:55:08.005082646Z [2024-05-26 00:55:08,004: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:55:08.005093984Z [2024-05-26 00:55:08,004: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:55:08.005426833Z [2024-05-26 00:55:08,005: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:55:08.005594052Z [2024-05-26 00:55:08,005: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:55:08.091311161Z [2024-05-26 00:55:08,090: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:55:08.726093468Z [2024-05-26 00:55:08,725: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc7765d4-8195-4a40-b093-5d0e90a58faa] succeeded in 2.2067548989998613s: None 2024-05-26T00:55:09.203210677Z [2024-05-26 00:55:09,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cff1ad4-a6d9-40c1-899b-950cc2676984] received 2024-05-26T00:55:09.210396615Z [2024-05-26 00:55:09,210: INFO/ForkPoolWorker-15] [4cff1ad4-a6d9-40c1-899b-950cc2676984] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:55:09.486343841Z [2024-05-26 00:55:09,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T00:55:10.552334008Z [2024-05-26 00:55:10,551: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:55:10.555448973Z [2024-05-26 00:55:10,555: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:55:10.576343821Z [2024-05-26 00:55:10,576: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:55:10.577864247Z [2024-05-26 00:55:10,577: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:55:10.577898348Z [2024-05-26 00:55:10,577: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:55:10.578110973Z [2024-05-26 00:55:10,577: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:55:10.578125078Z [2024-05-26 00:55:10,577: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:55:10.578489146Z [2024-05-26 00:55:10,578: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T00:55:10.578502013Z [2024-05-26 00:55:10,578: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:55:10.679871892Z [2024-05-26 00:55:10,679: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:55:11.281278380Z [2024-05-26 00:55:11,280: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cff1ad4-a6d9-40c1-899b-950cc2676984] succeeded in 2.074983959999372s: None 2024-05-26T00:56:01.300169926Z [2024-05-26 00:56:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19e1ba9a-670c-4986-afb2-7a8847242b22] received 2024-05-26T00:56:01.303592454Z [2024-05-26 00:56:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1d3b0d1-3567-4300-b89e-73c29e4c30aa] received 2024-05-26T00:56:01.305235490Z [2024-05-26 00:56:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d3b7ea8-5029-49da-9b4c-f5f35c590de9] received 2024-05-26T00:56:01.312383819Z [2024-05-26 00:56:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbdc1c31-5de4-4d3a-b8ed-7689c86663f0] received 2024-05-26T00:56:01.318669875Z [2024-05-26 00:56:01,318: INFO/ForkPoolWorker-1] [3d3b7ea8-5029-49da-9b4c-f5f35c590de9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:56:01.319593690Z [2024-05-26 00:56:01,319: INFO/ForkPoolWorker-15] [19e1ba9a-670c-4986-afb2-7a8847242b22] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:56:01.340344487Z [2024-05-26 00:56:01,340: INFO/ForkPoolWorker-16] [d1d3b0d1-3567-4300-b89e-73c29e4c30aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:56:01.350830867Z [2024-05-26 00:56:01,350: INFO/ForkPoolWorker-2] [fbdc1c31-5de4-4d3a-b8ed-7689c86663f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:56:01.649887202Z [2024-05-26 00:56:01,645: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:56:01.678471995Z [2024-05-26 00:56:01,674: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:56:01.762139662Z [2024-05-26 00:56:01,756: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:56:01.784785329Z [2024-05-26 00:56:01,776: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:56:02.008497180Z [2024-05-26 00:56:02,008: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:56:02.044916070Z [2024-05-26 00:56:02,044: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T00:56:02.049637453Z [2024-05-26 00:56:02,049: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:56:02.077300578Z [2024-05-26 00:56:02,077: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:56:02.081028601Z [2024-05-26 00:56:02,080: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:56:02.081526659Z [2024-05-26 00:56:02,081: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:56:02.081834167Z [2024-05-26 00:56:02,081: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T00:56:02.082354025Z [2024-05-26 00:56:02,082: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:56:02.213745696Z [2024-05-26 00:56:02,213: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:56:02.745378306Z [2024-05-26 00:56:02,744: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19e1ba9a-670c-4986-afb2-7a8847242b22] succeeded in 1.4349751449990436s: None 2024-05-26T00:56:02.964534933Z [2024-05-26 00:56:02,964: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fbdc1c31-5de4-4d3a-b8ed-7689c86663f0] succeeded in 1.6494100960007927s: None 2024-05-26T00:56:03.107288358Z [2024-05-26 00:56:03,106: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:56:03.110572962Z [2024-05-26 00:56:03,110: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:56:03.138710040Z [2024-05-26 00:56:03,138: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:56:03.140495393Z [2024-05-26 00:56:03,140: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:56:03.140665584Z [2024-05-26 00:56:03,140: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:56:03.140892415Z [2024-05-26 00:56:03,140: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:56:03.141058628Z [2024-05-26 00:56:03,140: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:56:03.141443162Z [2024-05-26 00:56:03,141: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:56:03.141988954Z [2024-05-26 00:56:03,141: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:56:03.242956594Z [2024-05-26 00:56:03,242: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:56:03.327258146Z [2024-05-26 00:56:03,326: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T00:56:03.330527325Z [2024-05-26 00:56:03,330: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:56:03.361301220Z [2024-05-26 00:56:03,361: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:56:03.362615768Z [2024-05-26 00:56:03,362: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:56:03.362792553Z [2024-05-26 00:56:03,362: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:56:03.363052472Z [2024-05-26 00:56:03,362: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:56:03.363214112Z [2024-05-26 00:56:03,363: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T00:56:03.363555617Z [2024-05-26 00:56:03,363: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:56:03.363755697Z [2024-05-26 00:56:03,363: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:56:03.467710822Z [2024-05-26 00:56:03,467: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:56:05.252927480Z [2024-05-26 00:56:05,252: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3d3b7ea8-5029-49da-9b4c-f5f35c590de9] succeeded in 3.945347443999708s: None 2024-05-26T00:56:05.623681623Z [2024-05-26 00:56:05,621: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1d3b0d1-3567-4300-b89e-73c29e4c30aa] succeeded in 4.31534698500036s: None 2024-05-26T00:57:01.273729212Z [2024-05-26 00:57:01,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87d93a10-76e6-4846-bd68-13aa06599ba2] received 2024-05-26T00:57:01.277737941Z [2024-05-26 00:57:01,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[656893cc-4801-4049-86e4-094aa4a967d9] received 2024-05-26T00:57:01.286348060Z [2024-05-26 00:57:01,286: INFO/ForkPoolWorker-15] [87d93a10-76e6-4846-bd68-13aa06599ba2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:57:01.292616186Z [2024-05-26 00:57:01,292: INFO/ForkPoolWorker-16] [656893cc-4801-4049-86e4-094aa4a967d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:57:01.296451854Z [2024-05-26 00:57:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4528bbd9-49a8-4b43-9731-95ac9419c07b] received 2024-05-26T00:57:01.307177088Z [2024-05-26 00:57:01,306: INFO/ForkPoolWorker-1] [4528bbd9-49a8-4b43-9731-95ac9419c07b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:57:01.579375549Z [2024-05-26 00:57:01,576: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:57:01.615463641Z [2024-05-26 00:57:01,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:57:01.647221919Z [2024-05-26 00:57:01,643: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:57:01.804271488Z [2024-05-26 00:57:01,803: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:57:01.808312279Z [2024-05-26 00:57:01,807: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:57:01.835088042Z [2024-05-26 00:57:01,834: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:57:01.836526780Z [2024-05-26 00:57:01,836: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:57:01.836693390Z [2024-05-26 00:57:01,836: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:57:01.836773353Z [2024-05-26 00:57:01,836: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:57:01.837141415Z [2024-05-26 00:57:01,836: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:57:01.930617705Z [2024-05-26 00:57:01,930: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:57:02.525056445Z [2024-05-26 00:57:02,524: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4528bbd9-49a8-4b43-9731-95ac9419c07b] succeeded in 1.2267808760007028s: None 2024-05-26T00:57:02.662306291Z [2024-05-26 00:57:02,661: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:57:02.665584911Z [2024-05-26 00:57:02,665: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:57:02.695889001Z [2024-05-26 00:57:02,695: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:57:02.697444656Z [2024-05-26 00:57:02,697: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:57:02.697565738Z [2024-05-26 00:57:02,697: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:57:02.697864497Z [2024-05-26 00:57:02,697: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:57:02.697949944Z [2024-05-26 00:57:02,697: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:57:02.698349451Z [2024-05-26 00:57:02,698: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:57:02.698489120Z [2024-05-26 00:57:02,698: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:57:02.701716449Z [2024-05-26 00:57:02,701: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:57:02.704859514Z [2024-05-26 00:57:02,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:57:02.726103955Z [2024-05-26 00:57:02,725: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:57:02.727599759Z [2024-05-26 00:57:02,727: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:57:02.727844351Z [2024-05-26 00:57:02,727: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:57:02.728089173Z [2024-05-26 00:57:02,727: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:57:02.728271126Z [2024-05-26 00:57:02,728: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:57:02.728640735Z [2024-05-26 00:57:02,728: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:57:02.728839328Z [2024-05-26 00:57:02,728: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:57:02.794308319Z [2024-05-26 00:57:02,794: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:57:02.809619485Z [2024-05-26 00:57:02,809: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:57:04.907741992Z [2024-05-26 00:57:04,907: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[656893cc-4801-4049-86e4-094aa4a967d9] succeeded in 3.6277789050000138s: None 2024-05-26T00:57:05.758874342Z [2024-05-26 00:57:05,758: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87d93a10-76e6-4846-bd68-13aa06599ba2] succeeded in 4.479467528999521s: None 2024-05-26T00:58:01.232511116Z [2024-05-26 00:58:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2479b26-5430-4251-8e28-6e6e60902ff4] received 2024-05-26T00:58:01.239252821Z [2024-05-26 00:58:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ee480e4-bb46-4de4-bc91-9e27d8fc9724] received 2024-05-26T00:58:01.241938527Z [2024-05-26 00:58:01,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2943b147-c91b-46bf-921a-9097d6ad83e6] received 2024-05-26T00:58:01.247207587Z [2024-05-26 00:58:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dc45d31-854a-4f15-bb35-efee4c26d17b] received 2024-05-26T00:58:01.256996838Z [2024-05-26 00:58:01,255: INFO/ForkPoolWorker-15] [a2479b26-5430-4251-8e28-6e6e60902ff4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:58:01.258768839Z [2024-05-26 00:58:01,257: INFO/ForkPoolWorker-1] [2943b147-c91b-46bf-921a-9097d6ad83e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:58:01.259271591Z [2024-05-26 00:58:01,258: INFO/ForkPoolWorker-16] [1ee480e4-bb46-4de4-bc91-9e27d8fc9724] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:58:01.265294777Z [2024-05-26 00:58:01,264: INFO/ForkPoolWorker-2] [1dc45d31-854a-4f15-bb35-efee4c26d17b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:58:01.656027927Z [2024-05-26 00:58:01,651: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:58:01.697926942Z [2024-05-26 00:58:01,691: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:58:01.754541730Z [2024-05-26 00:58:01,750: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:58:01.784505456Z [2024-05-26 00:58:01,780: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T00:58:01.881918318Z [2024-05-26 00:58:01,881: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T00:58:01.886277772Z [2024-05-26 00:58:01,885: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:58:01.928824762Z [2024-05-26 00:58:01,928: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:58:01.930046748Z [2024-05-26 00:58:01,929: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:58:01.930093600Z [2024-05-26 00:58:01,929: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:58:01.930228542Z [2024-05-26 00:58:01,930: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T00:58:01.930480247Z [2024-05-26 00:58:01,930: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:58:02.028247225Z [2024-05-26 00:58:02,028: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:58:02.089126896Z [2024-05-26 00:58:02,088: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:58:02.671001067Z [2024-05-26 00:58:02,670: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2943b147-c91b-46bf-921a-9097d6ad83e6] succeeded in 1.424567828000363s: None 2024-05-26T00:58:02.682332195Z [2024-05-26 00:58:02,681: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ee480e4-bb46-4de4-bc91-9e27d8fc9724] succeeded in 1.4412709520001954s: None 2024-05-26T00:58:03.033551785Z [2024-05-26 00:58:03,033: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:58:03.036879940Z [2024-05-26 00:58:03,036: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:58:03.057589780Z [2024-05-26 00:58:03,057: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T00:58:03.058166877Z [2024-05-26 00:58:03,057: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:58:03.059306665Z [2024-05-26 00:58:03,059: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:58:03.059425871Z [2024-05-26 00:58:03,059: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:58:03.059646409Z [2024-05-26 00:58:03,059: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:58:03.059772006Z [2024-05-26 00:58:03,059: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:58:03.060043470Z [2024-05-26 00:58:03,059: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:58:03.060164417Z [2024-05-26 00:58:03,060: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:58:03.061065543Z [2024-05-26 00:58:03,060: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:58:03.084181702Z [2024-05-26 00:58:03,083: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T00:58:03.086774408Z [2024-05-26 00:58:03,086: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:58:03.086816708Z [2024-05-26 00:58:03,086: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:58:03.087102922Z [2024-05-26 00:58:03,086: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:58:03.087165189Z [2024-05-26 00:58:03,087: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T00:58:03.087635586Z [2024-05-26 00:58:03,087: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:58:03.087804979Z [2024-05-26 00:58:03,087: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:58:03.140489216Z [2024-05-26 00:58:03,140: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:58:03.213282809Z [2024-05-26 00:58:03,213: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:58:05.113870446Z [2024-05-26 00:58:05,113: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2479b26-5430-4251-8e28-6e6e60902ff4] succeeded in 3.8723376449997886s: None 2024-05-26T00:58:05.164383307Z [2024-05-26 00:58:05,163: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1dc45d31-854a-4f15-bb35-efee4c26d17b] succeeded in 3.9107585990004736s: None 2024-05-26T00:59:00.612880837Z [2024-05-26 00:59:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28ead5ae-bc9c-4148-9a16-26da611ea467] received 2024-05-26T00:59:00.614606298Z [2024-05-26 00:59:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4811d4c7-439b-44e5-87d1-90f92e4d1b62] received 2024-05-26T00:59:00.619222331Z [2024-05-26 00:59:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d5c90d3-0e06-4641-90f8-dc3ee74177dc] received 2024-05-26T00:59:00.621677880Z [2024-05-26 00:59:00,621: INFO/ForkPoolWorker-15] [28ead5ae-bc9c-4148-9a16-26da611ea467] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:59:00.628408373Z [2024-05-26 00:59:00,628: INFO/ForkPoolWorker-1] [3d5c90d3-0e06-4641-90f8-dc3ee74177dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:59:00.633106462Z [2024-05-26 00:59:00,632: INFO/ForkPoolWorker-16] [4811d4c7-439b-44e5-87d1-90f92e4d1b62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:59:00.931105648Z [2024-05-26 00:59:00,928: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T00:59:00.940784713Z [2024-05-26 00:59:00,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T00:59:00.957108150Z [2024-05-26 00:59:00,954: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T00:59:01.116796077Z [2024-05-26 00:59:01,116: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T00:59:01.120927346Z [2024-05-26 00:59:01,120: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:59:01.149363715Z [2024-05-26 00:59:01,149: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T00:59:01.150712211Z [2024-05-26 00:59:01,150: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T00:59:01.150764735Z [2024-05-26 00:59:01,150: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T00:59:01.150773757Z [2024-05-26 00:59:01,150: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T00:59:01.151027106Z [2024-05-26 00:59:01,150: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T00:59:01.253987452Z [2024-05-26 00:59:01,253: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:59:01.812680954Z [2024-05-26 00:59:01,812: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3d5c90d3-0e06-4641-90f8-dc3ee74177dc] succeeded in 1.1917937199996231s: None 2024-05-26T00:59:02.066383830Z [2024-05-26 00:59:02,066: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T00:59:02.067168084Z [2024-05-26 00:59:02,066: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T00:59:02.069630982Z [2024-05-26 00:59:02,069: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:59:02.070562145Z [2024-05-26 00:59:02,070: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T00:59:02.087009251Z [2024-05-26 00:59:02,086: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T00:59:02.088789614Z [2024-05-26 00:59:02,088: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:59:02.088806939Z [2024-05-26 00:59:02,088: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:59:02.088904101Z [2024-05-26 00:59:02,088: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:59:02.088910502Z [2024-05-26 00:59:02,088: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T00:59:02.089190454Z [2024-05-26 00:59:02,089: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T00:59:02.089213248Z [2024-05-26 00:59:02,089: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:59:02.090706333Z [2024-05-26 00:59:02,090: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T00:59:02.092571815Z [2024-05-26 00:59:02,092: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T00:59:02.092604885Z [2024-05-26 00:59:02,092: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T00:59:02.093280349Z [2024-05-26 00:59:02,092: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T00:59:02.093293893Z [2024-05-26 00:59:02,093: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T00:59:02.093632846Z [2024-05-26 00:59:02,093: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T00:59:02.093908331Z [2024-05-26 00:59:02,093: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T00:59:02.171185961Z [2024-05-26 00:59:02,170: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:59:02.192019356Z [2024-05-26 00:59:02,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T00:59:03.828385409Z [2024-05-26 00:59:03,827: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28ead5ae-bc9c-4148-9a16-26da611ea467] succeeded in 3.2136556890000065s: None 2024-05-26T00:59:04.320829812Z [2024-05-26 00:59:04,320: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4811d4c7-439b-44e5-87d1-90f92e4d1b62] succeeded in 3.704082149999522s: None 2024-05-26T01:00:01.101419884Z [2024-05-26 01:00:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4da38f29-e5aa-43dd-a51f-2ed53c29d34a] received 2024-05-26T01:00:01.104755295Z [2024-05-26 01:00:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95bb563d-d63d-4289-91af-1a62dd422442] received 2024-05-26T01:00:01.108377409Z [2024-05-26 01:00:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50d52876-c7a1-4d82-be38-74e64d755d26] received 2024-05-26T01:00:01.109874600Z [2024-05-26 01:00:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f79d02a-4f26-4ef6-8747-ab0b2a5e2433] received 2024-05-26T01:00:01.118767493Z [2024-05-26 01:00:01,118: INFO/ForkPoolWorker-15] [4da38f29-e5aa-43dd-a51f-2ed53c29d34a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:00:01.121115195Z [2024-05-26 01:00:01,119: INFO/ForkPoolWorker-1] [50d52876-c7a1-4d82-be38-74e64d755d26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:00:01.126417047Z [2024-05-26 01:00:01,126: INFO/ForkPoolWorker-16] [95bb563d-d63d-4289-91af-1a62dd422442] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:00:01.126455769Z [2024-05-26 01:00:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4adb5c93-da6e-49d8-9dde-9f16cb8a27f7] received 2024-05-26T01:00:01.149176817Z [2024-05-26 01:00:01,147: INFO/ForkPoolWorker-2] [3f79d02a-4f26-4ef6-8747-ab0b2a5e2433] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:00:01.151069058Z [2024-05-26 01:00:01,150: INFO/ForkPoolWorker-3] [4adb5c93-da6e-49d8-9dde-9f16cb8a27f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:00:01.457768554Z [2024-05-26 01:00:01,452: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:00:01.481114552Z [2024-05-26 01:00:01,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:00:01.562938598Z [2024-05-26 01:00:01,554: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:00:01.597091773Z [2024-05-26 01:00:01,593: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:00:01.625226947Z [2024-05-26 01:00:01,624: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-26T01:00:01.629604118Z [2024-05-26 01:00:01,629: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:00:01.666845636Z [2024-05-26 01:00:01,658: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:00:01.696186590Z [2024-05-26 01:00:01,695: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T01:00:01.699703087Z [2024-05-26 01:00:01,699: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:00:01.700336868Z [2024-05-26 01:00:01,699: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:00:01.700554968Z [2024-05-26 01:00:01,700: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-26T01:00:01.700865201Z [2024-05-26 01:00:01,700: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:00:01.873728823Z [2024-05-26 01:00:01,873: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:00:02.047372730Z [2024-05-26 01:00:02,047: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:00:02.652409171Z [2024-05-26 01:00:02,651: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4adb5c93-da6e-49d8-9dde-9f16cb8a27f7] succeeded in 1.5228832630000397s: None 2024-05-26T01:00:02.729855522Z [2024-05-26 01:00:02,729: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3f79d02a-4f26-4ef6-8747-ab0b2a5e2433] succeeded in 1.6179424170004495s: None 2024-05-26T01:00:03.061465249Z [2024-05-26 01:00:03,061: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:00:03.064813375Z [2024-05-26 01:00:03,064: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:00:03.106216617Z [2024-05-26 01:00:03,105: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:00:03.108248720Z [2024-05-26 01:00:03,108: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:00:03.108262477Z [2024-05-26 01:00:03,108: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:00:03.108449181Z [2024-05-26 01:00:03,108: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:00:03.108510320Z [2024-05-26 01:00:03,108: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:00:03.108788057Z [2024-05-26 01:00:03,108: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:00:03.108807934Z [2024-05-26 01:00:03,108: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:00:03.278538369Z [2024-05-26 01:00:03,278: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:00:03.317170191Z [2024-05-26 01:00:03,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:00:03.322260553Z [2024-05-26 01:00:03,321: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:00:03.352457609Z [2024-05-26 01:00:03,352: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:00:03.356001812Z [2024-05-26 01:00:03,355: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:00:03.356076075Z [2024-05-26 01:00:03,355: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:00:03.356216317Z [2024-05-26 01:00:03,356: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:00:03.356288651Z [2024-05-26 01:00:03,356: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:00:03.356560048Z [2024-05-26 01:00:03,356: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:00:03.356639510Z [2024-05-26 01:00:03,356: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:00:03.371221288Z [2024-05-26 01:00:03,370: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:00:03.374621361Z [2024-05-26 01:00:03,374: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:00:03.395608385Z [2024-05-26 01:00:03,395: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:00:03.396910435Z [2024-05-26 01:00:03,396: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:00:03.396926566Z [2024-05-26 01:00:03,396: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:00:03.397244172Z [2024-05-26 01:00:03,396: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:00:03.397287814Z [2024-05-26 01:00:03,397: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:00:03.399584577Z [2024-05-26 01:00:03,397: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:00:03.399602596Z [2024-05-26 01:00:03,397: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:00:03.471386420Z [2024-05-26 01:00:03,471: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:00:03.515014213Z [2024-05-26 01:00:03,514: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:00:03.997183420Z [2024-05-26 01:00:03,996: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[95bb563d-d63d-4289-91af-1a62dd422442] succeeded in 2.8902876829997695s: None 2024-05-26T01:00:04.356984054Z [2024-05-26 01:00:04,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9e11b0a-fe0e-48cc-909e-260616b5fd33] received 2024-05-26T01:00:04.368579402Z [2024-05-26 01:00:04,368: INFO/ForkPoolWorker-16] [c9e11b0a-fe0e-48cc-909e-260616b5fd33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:00:04.715429776Z [2024-05-26 01:00:04,711: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:00:05.280965740Z [2024-05-26 01:00:05,280: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[50d52876-c7a1-4d82-be38-74e64d755d26] succeeded in 4.17020604299978s: None 2024-05-26T01:00:06.170375608Z [2024-05-26 01:00:06,169: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:00:06.174061874Z [2024-05-26 01:00:06,173: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:00:06.191363369Z [2024-05-26 01:00:06,191: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:00:06.193769042Z [2024-05-26 01:00:06,192: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:00:06.195665788Z [2024-05-26 01:00:06,193: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:00:06.195929520Z [2024-05-26 01:00:06,195: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:00:06.196146004Z [2024-05-26 01:00:06,195: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:00:06.196626556Z [2024-05-26 01:00:06,196: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:00:06.196819774Z [2024-05-26 01:00:06,196: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:00:06.277603326Z [2024-05-26 01:00:06,277: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:00:06.872028872Z [2024-05-26 01:00:06,871: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4da38f29-e5aa-43dd-a51f-2ed53c29d34a] succeeded in 5.767144140001619s: None 2024-05-26T01:00:06.902931327Z [2024-05-26 01:00:06,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[165a2594-5173-4643-9968-cc51faeeda55] received 2024-05-26T01:00:06.919605716Z [2024-05-26 01:00:06,919: INFO/ForkPoolWorker-15] [165a2594-5173-4643-9968-cc51faeeda55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:00:06.965366163Z [2024-05-26 01:00:06,964: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9e11b0a-fe0e-48cc-909e-260616b5fd33] succeeded in 2.6057229429989093s: None 2024-05-26T01:00:07.184497023Z [2024-05-26 01:00:07,181: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:00:08.357416563Z [2024-05-26 01:00:08,357: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:00:08.360779054Z [2024-05-26 01:00:08,360: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:00:08.429836322Z [2024-05-26 01:00:08,429: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:00:08.433429903Z [2024-05-26 01:00:08,431: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:00:08.433453428Z [2024-05-26 01:00:08,432: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:00:08.433457813Z [2024-05-26 01:00:08,432: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:00:08.433461444Z [2024-05-26 01:00:08,432: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:00:08.433464792Z [2024-05-26 01:00:08,432: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:00:08.433467838Z [2024-05-26 01:00:08,432: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:00:08.521796313Z [2024-05-26 01:00:08,521: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:00:09.150984551Z [2024-05-26 01:00:09,150: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[165a2594-5173-4643-9968-cc51faeeda55] succeeded in 2.245871581000756s: None 2024-05-26T01:00:09.931716131Z [2024-05-26 01:00:09,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0db0f9b-ea8b-49d4-a100-c485fa1dbb0e] received 2024-05-26T01:00:09.940758739Z [2024-05-26 01:00:09,940: INFO/ForkPoolWorker-15] [a0db0f9b-ea8b-49d4-a100-c485fa1dbb0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:00:10.268052809Z [2024-05-26 01:00:10,263: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:00:11.327989206Z [2024-05-26 01:00:11,327: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:00:11.331145188Z [2024-05-26 01:00:11,330: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:00:11.347663862Z [2024-05-26 01:00:11,347: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:00:11.348931336Z [2024-05-26 01:00:11,348: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:00:11.349061383Z [2024-05-26 01:00:11,348: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:00:11.349209718Z [2024-05-26 01:00:11,349: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:00:11.349292301Z [2024-05-26 01:00:11,349: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:00:11.349549218Z [2024-05-26 01:00:11,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:00:11.349638352Z [2024-05-26 01:00:11,349: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:00:11.440988124Z [2024-05-26 01:00:11,440: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:00:12.049455745Z [2024-05-26 01:00:12,048: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a0db0f9b-ea8b-49d4-a100-c485fa1dbb0e] succeeded in 2.113611254000716s: None 2024-05-26T01:01:00.416785252Z [2024-05-26 01:01:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c86978a8-bdb2-4839-900d-c4f65b7fbf2a] received 2024-05-26T01:01:00.427230632Z [2024-05-26 01:01:00,426: INFO/ForkPoolWorker-15] [c86978a8-bdb2-4839-900d-c4f65b7fbf2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:01:00.427448460Z [2024-05-26 01:01:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[489fe20c-dbf7-4db6-9947-ee97c711e79a] received 2024-05-26T01:01:00.430520426Z [2024-05-26 01:01:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f84d2005-160f-4fc6-97f4-253cac590f90] received 2024-05-26T01:01:00.444076784Z [2024-05-26 01:01:00,443: INFO/ForkPoolWorker-1] [f84d2005-160f-4fc6-97f4-253cac590f90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:01:00.447362647Z [2024-05-26 01:01:00,447: INFO/ForkPoolWorker-16] [489fe20c-dbf7-4db6-9947-ee97c711e79a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:01:00.742195245Z [2024-05-26 01:01:00,737: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:01:00.806475692Z [2024-05-26 01:01:00,802: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:01:00.851148482Z [2024-05-26 01:01:00,847: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:01:01.036437659Z [2024-05-26 01:01:01,036: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:01:01.040272983Z [2024-05-26 01:01:01,039: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:01:01.059284922Z [2024-05-26 01:01:01,059: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:01:01.060271479Z [2024-05-26 01:01:01,060: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:01:01.060399788Z [2024-05-26 01:01:01,060: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:01:01.060446668Z [2024-05-26 01:01:01,060: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:01:01.060646958Z [2024-05-26 01:01:01,060: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:01:01.142736545Z [2024-05-26 01:01:01,142: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:01:01.713580896Z [2024-05-26 01:01:01,713: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[489fe20c-dbf7-4db6-9947-ee97c711e79a] succeeded in 1.2836624690007739s: None 2024-05-26T01:01:01.905758881Z [2024-05-26 01:01:01,905: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:01:01.909910818Z [2024-05-26 01:01:01,909: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:01:01.936125242Z [2024-05-26 01:01:01,935: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:01:01.937529457Z [2024-05-26 01:01:01,937: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:01:01.937691844Z [2024-05-26 01:01:01,937: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:01:01.937954315Z [2024-05-26 01:01:01,937: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:01:01.938143486Z [2024-05-26 01:01:01,937: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:01:01.938609438Z [2024-05-26 01:01:01,938: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:01:01.938732694Z [2024-05-26 01:01:01,938: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:01:02.025631490Z [2024-05-26 01:01:02,025: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:01:02.028806144Z [2024-05-26 01:01:02,028: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:01:02.032063544Z [2024-05-26 01:01:02,031: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:01:02.059956757Z [2024-05-26 01:01:02,059: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:01:02.064996776Z [2024-05-26 01:01:02,064: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:01:02.065039961Z [2024-05-26 01:01:02,064: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:01:02.065275151Z [2024-05-26 01:01:02,065: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:01:02.065395015Z [2024-05-26 01:01:02,065: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:01:02.065785069Z [2024-05-26 01:01:02,065: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:01:02.065867685Z [2024-05-26 01:01:02,065: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:01:02.154748015Z [2024-05-26 01:01:02,154: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:01:03.593539903Z [2024-05-26 01:01:03,592: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f84d2005-160f-4fc6-97f4-253cac590f90] succeeded in 3.156686427999375s: None 2024-05-26T01:01:03.837847407Z [2024-05-26 01:01:03,837: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c86978a8-bdb2-4839-900d-c4f65b7fbf2a] succeeded in 3.418679541000529s: None 2024-05-26T01:02:01.010871716Z [2024-05-26 01:02:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9e046f5-ca9f-495d-9424-24b99b0e288a] received 2024-05-26T01:02:01.015566519Z [2024-05-26 01:02:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f67f3cb-d63e-4645-a89e-f1c4dcde0d6b] received 2024-05-26T01:02:01.019895286Z [2024-05-26 01:02:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f375213a-5686-423e-93cc-b26481b7354a] received 2024-05-26T01:02:01.022639581Z [2024-05-26 01:02:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bb3b3ba-29bd-4cae-b9d0-abfe2b5dbc33] received 2024-05-26T01:02:01.030775971Z [2024-05-26 01:02:01,030: INFO/ForkPoolWorker-15] [c9e046f5-ca9f-495d-9424-24b99b0e288a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:02:01.034507740Z [2024-05-26 01:02:01,034: INFO/ForkPoolWorker-1] [f375213a-5686-423e-93cc-b26481b7354a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:02:01.038833677Z [2024-05-26 01:02:01,038: INFO/ForkPoolWorker-16] [5f67f3cb-d63e-4645-a89e-f1c4dcde0d6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:02:01.043775212Z [2024-05-26 01:02:01,043: INFO/ForkPoolWorker-2] [9bb3b3ba-29bd-4cae-b9d0-abfe2b5dbc33] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:02:01.406633665Z [2024-05-26 01:02:01,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:02:01.439573685Z [2024-05-26 01:02:01,436: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:02:01.458742964Z [2024-05-26 01:02:01,455: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:02:01.484847222Z [2024-05-26 01:02:01,481: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:02:01.611240926Z [2024-05-26 01:02:01,610: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:02:01.618297235Z [2024-05-26 01:02:01,617: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:02:01.663570803Z [2024-05-26 01:02:01,663: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:02:01.664413265Z [2024-05-26 01:02:01,664: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:02:01.664465820Z [2024-05-26 01:02:01,664: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:02:01.664521057Z [2024-05-26 01:02:01,664: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:02:01.664703915Z [2024-05-26 01:02:01,664: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:02:01.691767993Z [2024-05-26 01:02:01,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:02:01.753591336Z [2024-05-26 01:02:01,753: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:02:02.360992535Z [2024-05-26 01:02:02,360: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9e046f5-ca9f-495d-9424-24b99b0e288a] succeeded in 1.343166509999719s: None 2024-05-26T01:02:02.402944594Z [2024-05-26 01:02:02,402: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9bb3b3ba-29bd-4cae-b9d0-abfe2b5dbc33] succeeded in 1.3775172599998768s: None 2024-05-26T01:02:02.680039285Z [2024-05-26 01:02:02,679: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:02:02.683442627Z [2024-05-26 01:02:02,683: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:02:02.699255385Z [2024-05-26 01:02:02,698: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:02:02.702451720Z [2024-05-26 01:02:02,702: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:02:02.713324624Z [2024-05-26 01:02:02,713: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:02:02.714543752Z [2024-05-26 01:02:02,714: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:02:02.714577197Z [2024-05-26 01:02:02,714: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:02:02.714695679Z [2024-05-26 01:02:02,714: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:02:02.714787537Z [2024-05-26 01:02:02,714: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:02:02.715040253Z [2024-05-26 01:02:02,714: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:02:02.715054576Z [2024-05-26 01:02:02,714: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:02:02.722798267Z [2024-05-26 01:02:02,722: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:02:02.724008032Z [2024-05-26 01:02:02,723: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:02:02.724058633Z [2024-05-26 01:02:02,723: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:02:02.724229787Z [2024-05-26 01:02:02,724: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:02:02.724278421Z [2024-05-26 01:02:02,724: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:02:02.724574670Z [2024-05-26 01:02:02,724: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:02:02.724634043Z [2024-05-26 01:02:02,724: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:02:02.834056724Z [2024-05-26 01:02:02,833: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:02:02.845042298Z [2024-05-26 01:02:02,844: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:02:04.396254675Z [2024-05-26 01:02:04,395: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f375213a-5686-423e-93cc-b26481b7354a] succeeded in 3.3728858939994097s: None 2024-05-26T01:02:04.802943178Z [2024-05-26 01:02:04,802: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5f67f3cb-d63e-4645-a89e-f1c4dcde0d6b] succeeded in 3.7835837659986282s: None 2024-05-26T01:03:00.206796018Z [2024-05-26 01:03:00,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87317501-9351-4a1a-bece-03159ea5a3e7] received 2024-05-26T01:03:00.214948334Z [2024-05-26 01:03:00,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad58995f-bc26-4aad-a776-cf4cdc9c3f2d] received 2024-05-26T01:03:00.225362228Z [2024-05-26 01:03:00,225: INFO/ForkPoolWorker-16] [ad58995f-bc26-4aad-a776-cf4cdc9c3f2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:03:00.225716118Z [2024-05-26 01:03:00,225: INFO/ForkPoolWorker-15] [87317501-9351-4a1a-bece-03159ea5a3e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:03:00.228660899Z [2024-05-26 01:03:00,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bc48a4b-cbea-4e78-9946-3fa1251ff0cd] received 2024-05-26T01:03:00.235019884Z [2024-05-26 01:03:00,234: INFO/ForkPoolWorker-1] [8bc48a4b-cbea-4e78-9946-3fa1251ff0cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:03:00.567092117Z [2024-05-26 01:03:00,564: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:03:00.588083472Z [2024-05-26 01:03:00,584: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:03:00.624743413Z [2024-05-26 01:03:00,621: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:03:00.722679348Z [2024-05-26 01:03:00,722: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:03:00.726671077Z [2024-05-26 01:03:00,726: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:03:00.777938827Z [2024-05-26 01:03:00,777: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:03:00.780020493Z [2024-05-26 01:03:00,779: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:03:00.780031414Z [2024-05-26 01:03:00,779: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:03:00.780035350Z [2024-05-26 01:03:00,779: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:03:00.780472265Z [2024-05-26 01:03:00,780: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:03:00.892198036Z [2024-05-26 01:03:00,891: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:03:01.677387813Z [2024-05-26 01:03:01,676: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8bc48a4b-cbea-4e78-9946-3fa1251ff0cd] succeeded in 1.4470793300006335s: None 2024-05-26T01:03:02.069890279Z [2024-05-26 01:03:02,069: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:03:02.073382017Z [2024-05-26 01:03:02,072: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:03:02.116903138Z [2024-05-26 01:03:02,116: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:03:02.120967443Z [2024-05-26 01:03:02,120: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:03:02.121552957Z [2024-05-26 01:03:02,120: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:03:02.121831080Z [2024-05-26 01:03:02,121: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:03:02.121979915Z [2024-05-26 01:03:02,121: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:03:02.123862060Z [2024-05-26 01:03:02,123: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:03:02.124035540Z [2024-05-26 01:03:02,123: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:03:02.210784161Z [2024-05-26 01:03:02,210: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:03:02.259092487Z [2024-05-26 01:03:02,258: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:03:02.264531648Z [2024-05-26 01:03:02,262: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:03:02.288864701Z [2024-05-26 01:03:02,288: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:03:02.292315142Z [2024-05-26 01:03:02,292: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:03:02.292440272Z [2024-05-26 01:03:02,292: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:03:02.292661595Z [2024-05-26 01:03:02,292: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:03:02.292782763Z [2024-05-26 01:03:02,292: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:03:02.293116898Z [2024-05-26 01:03:02,292: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:03:02.293237646Z [2024-05-26 01:03:02,293: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:03:02.378297560Z [2024-05-26 01:03:02,378: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:03:03.883590685Z [2024-05-26 01:03:03,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad58995f-bc26-4aad-a776-cf4cdc9c3f2d] succeeded in 3.6659892080006102s: None 2024-05-26T01:03:04.301575793Z [2024-05-26 01:03:04,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87317501-9351-4a1a-bece-03159ea5a3e7] succeeded in 4.090616826000769s: None 2024-05-26T01:04:00.495504576Z [2024-05-26 01:04:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05dcf86c-769e-4d3b-8794-351653122b98] received 2024-05-26T01:04:00.499984186Z [2024-05-26 01:04:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c6bda61-cd72-4cbb-862a-c85214586f98] received 2024-05-26T01:04:00.503009835Z [2024-05-26 01:04:00,502: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[895df7a8-0dc4-4b7c-9c0a-0ea9ff080135] received 2024-05-26T01:04:00.508779219Z [2024-05-26 01:04:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e17f32bf-e607-45e2-b976-07ca69cc4a6e] received 2024-05-26T01:04:00.520680773Z [2024-05-26 01:04:00,520: INFO/ForkPoolWorker-15] [05dcf86c-769e-4d3b-8794-351653122b98] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:04:00.521093741Z [2024-05-26 01:04:00,520: INFO/ForkPoolWorker-16] [8c6bda61-cd72-4cbb-862a-c85214586f98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:04:00.523243708Z [2024-05-26 01:04:00,522: INFO/ForkPoolWorker-2] [e17f32bf-e607-45e2-b976-07ca69cc4a6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:04:00.523571249Z [2024-05-26 01:04:00,523: INFO/ForkPoolWorker-1] [895df7a8-0dc4-4b7c-9c0a-0ea9ff080135] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:04:00.842735876Z [2024-05-26 01:04:00,839: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:04:00.845288273Z [2024-05-26 01:04:00,841: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:04:00.852004175Z [2024-05-26 01:04:00,849: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:04:00.907633597Z [2024-05-26 01:04:00,904: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:04:01.156583880Z [2024-05-26 01:04:01,156: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:04:01.475362107Z [2024-05-26 01:04:01,474: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:04:01.483338629Z [2024-05-26 01:04:01,482: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:04:01.553844029Z [2024-05-26 01:04:01,553: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:04:01.555256107Z [2024-05-26 01:04:01,555: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:04:01.555445234Z [2024-05-26 01:04:01,555: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:04:01.555736898Z [2024-05-26 01:04:01,555: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:04:01.555953505Z [2024-05-26 01:04:01,555: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:04:01.676803702Z [2024-05-26 01:04:01,676: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:04:02.176975188Z [2024-05-26 01:04:02,176: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05dcf86c-769e-4d3b-8794-351653122b98] succeeded in 1.6780575339998904s: None 2024-05-26T01:04:02.532539008Z [2024-05-26 01:04:02,532: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e17f32bf-e607-45e2-b976-07ca69cc4a6e] succeeded in 2.0190459719997307s: None 2024-05-26T01:04:02.540790278Z [2024-05-26 01:04:02,540: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:04:02.544045094Z [2024-05-26 01:04:02,543: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:04:02.560696263Z [2024-05-26 01:04:02,560: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:04:02.561866428Z [2024-05-26 01:04:02,561: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:04:02.561882233Z [2024-05-26 01:04:02,561: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:04:02.561980575Z [2024-05-26 01:04:02,561: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:04:02.561992636Z [2024-05-26 01:04:02,561: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:04:02.562193632Z [2024-05-26 01:04:02,562: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:04:02.562203438Z [2024-05-26 01:04:02,562: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:04:02.663871392Z [2024-05-26 01:04:02,663: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:04:02.780656460Z [2024-05-26 01:04:02,780: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:04:02.783993133Z [2024-05-26 01:04:02,783: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:04:02.808904400Z [2024-05-26 01:04:02,808: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:04:02.811016501Z [2024-05-26 01:04:02,810: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:04:02.811122652Z [2024-05-26 01:04:02,810: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:04:02.811283359Z [2024-05-26 01:04:02,811: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:04:02.811386611Z [2024-05-26 01:04:02,811: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:04:02.820258000Z [2024-05-26 01:04:02,819: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:04:02.820487848Z [2024-05-26 01:04:02,820: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:04:02.949556830Z [2024-05-26 01:04:02,949: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:04:05.091980377Z [2024-05-26 01:04:05,091: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[895df7a8-0dc4-4b7c-9c0a-0ea9ff080135] succeeded in 4.584410814000876s: None 2024-05-26T01:04:05.188839754Z [2024-05-26 01:04:05,188: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c6bda61-cd72-4cbb-862a-c85214586f98] succeeded in 4.682391067000935s: None 2024-05-26T01:05:00.809473854Z [2024-05-26 01:05:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2226af59-12ae-4280-a760-2b9391b404f9] received 2024-05-26T01:05:00.813589813Z [2024-05-26 01:05:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2d7339d-acf2-497e-9389-4f5b6c18709e] received 2024-05-26T01:05:00.818963585Z [2024-05-26 01:05:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9072ec50-23ce-48bb-9105-f88368314a92] received 2024-05-26T01:05:00.821583629Z [2024-05-26 01:05:00,821: INFO/ForkPoolWorker-15] [2226af59-12ae-4280-a760-2b9391b404f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:05:00.823975069Z [2024-05-26 01:05:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07548a7a-5f37-470d-a2d6-033b4da30473] received 2024-05-26T01:05:00.824105807Z [2024-05-26 01:05:00,823: INFO/ForkPoolWorker-16] [b2d7339d-acf2-497e-9389-4f5b6c18709e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:05:00.829507055Z [2024-05-26 01:05:00,829: INFO/ForkPoolWorker-1] [9072ec50-23ce-48bb-9105-f88368314a92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:05:00.834549971Z [2024-05-26 01:05:00,834: INFO/ForkPoolWorker-2] [07548a7a-5f37-470d-a2d6-033b4da30473] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:05:01.133211351Z [2024-05-26 01:05:01,129: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:05:01.135563083Z [2024-05-26 01:05:01,132: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:05:01.153321617Z [2024-05-26 01:05:01,150: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:05:01.215237715Z [2024-05-26 01:05:01,212: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:05:01.454115338Z [2024-05-26 01:05:01,453: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:05:01.467392544Z [2024-05-26 01:05:01,466: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:05:01.560599412Z [2024-05-26 01:05:01,560: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:05:01.564513009Z [2024-05-26 01:05:01,564: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:05:01.564622460Z [2024-05-26 01:05:01,564: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:05:01.564696171Z [2024-05-26 01:05:01,564: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:05:01.564976652Z [2024-05-26 01:05:01,564: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:05:01.662927085Z [2024-05-26 01:05:01,662: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:05:02.236187487Z [2024-05-26 01:05:02,235: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[07548a7a-5f37-470d-a2d6-033b4da30473] succeeded in 1.4101777729993046s: None 2024-05-26T01:05:02.406983465Z [2024-05-26 01:05:02,406: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:05:02.410144121Z [2024-05-26 01:05:02,409: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:05:02.435474452Z [2024-05-26 01:05:02,435: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:05:02.437177194Z [2024-05-26 01:05:02,436: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:05:02.437403445Z [2024-05-26 01:05:02,437: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:05:02.437930336Z [2024-05-26 01:05:02,437: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:05:02.438134017Z [2024-05-26 01:05:02,437: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:05:02.438889480Z [2024-05-26 01:05:02,438: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:05:02.439064505Z [2024-05-26 01:05:02,438: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:05:02.511539065Z [2024-05-26 01:05:02,511: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:05:02.546245421Z [2024-05-26 01:05:02,545: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:05:02.549667841Z [2024-05-26 01:05:02,549: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:05:02.571886144Z [2024-05-26 01:05:02,571: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:05:02.573031474Z [2024-05-26 01:05:02,572: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:05:02.573099372Z [2024-05-26 01:05:02,572: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:05:02.573246316Z [2024-05-26 01:05:02,573: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:05:02.573289996Z [2024-05-26 01:05:02,573: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:05:02.573546205Z [2024-05-26 01:05:02,573: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:05:02.573684239Z [2024-05-26 01:05:02,573: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:05:02.594276287Z [2024-05-26 01:05:02,593: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:05:02.597549935Z [2024-05-26 01:05:02,597: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:05:02.622058861Z [2024-05-26 01:05:02,621: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:05:02.623441677Z [2024-05-26 01:05:02,623: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:05:02.623565474Z [2024-05-26 01:05:02,623: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:05:02.623794722Z [2024-05-26 01:05:02,623: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:05:02.623859301Z [2024-05-26 01:05:02,623: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:05:02.624115575Z [2024-05-26 01:05:02,624: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:05:02.624190986Z [2024-05-26 01:05:02,624: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:05:02.670163579Z [2024-05-26 01:05:02,669: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:05:02.720534011Z [2024-05-26 01:05:02,720: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:05:03.538050685Z [2024-05-26 01:05:03,537: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2226af59-12ae-4280-a760-2b9391b404f9] succeeded in 2.725001987999349s: None 2024-05-26T01:05:04.208993480Z [2024-05-26 01:05:04,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ed0151f-6167-4c1c-be61-91529e0e793f] received 2024-05-26T01:05:04.216292133Z [2024-05-26 01:05:04,216: INFO/ForkPoolWorker-15] [3ed0151f-6167-4c1c-be61-91529e0e793f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:05:04.272246952Z [2024-05-26 01:05:04,271: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9072ec50-23ce-48bb-9105-f88368314a92] succeeded in 3.450134317999982s: None 2024-05-26T01:05:04.619033446Z [2024-05-26 01:05:04,615: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:05:04.988557556Z [2024-05-26 01:05:04,988: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2d7339d-acf2-497e-9389-4f5b6c18709e] succeeded in 4.171720204998564s: None 2024-05-26T01:05:06.161995374Z [2024-05-26 01:05:06,161: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:05:06.165194782Z [2024-05-26 01:05:06,164: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:05:06.195735130Z [2024-05-26 01:05:06,195: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:05:06.204100068Z [2024-05-26 01:05:06,203: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:05:06.204126757Z [2024-05-26 01:05:06,204: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:05:06.204278161Z [2024-05-26 01:05:06,204: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:05:06.204332510Z [2024-05-26 01:05:06,204: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:05:06.204630842Z [2024-05-26 01:05:06,204: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:05:06.204680349Z [2024-05-26 01:05:06,204: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:05:06.278855848Z [2024-05-26 01:05:06,278: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:05:06.940702061Z [2024-05-26 01:05:06,940: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ed0151f-6167-4c1c-be61-91529e0e793f] succeeded in 2.729957823999939s: None 2024-05-26T01:05:06.961606667Z [2024-05-26 01:05:06,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60a4e19d-b3b6-4400-b8f6-66d40e11796f] received 2024-05-26T01:05:06.973425177Z [2024-05-26 01:05:06,973: INFO/ForkPoolWorker-15] [60a4e19d-b3b6-4400-b8f6-66d40e11796f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:05:07.321883801Z [2024-05-26 01:05:07,318: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:05:08.415705336Z [2024-05-26 01:05:08,411: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:05:08.415747782Z [2024-05-26 01:05:08,414: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:05:08.494271022Z [2024-05-26 01:05:08,494: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:05:08.495935378Z [2024-05-26 01:05:08,495: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:05:08.495977749Z [2024-05-26 01:05:08,495: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:05:08.496059190Z [2024-05-26 01:05:08,495: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:05:08.496106839Z [2024-05-26 01:05:08,496: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:05:08.496287402Z [2024-05-26 01:05:08,496: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:05:08.496323718Z [2024-05-26 01:05:08,496: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:05:08.591913378Z [2024-05-26 01:05:08,591: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:05:09.224030224Z [2024-05-26 01:05:09,223: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60a4e19d-b3b6-4400-b8f6-66d40e11796f] succeeded in 2.2590581700005714s: None 2024-05-26T01:05:09.311962194Z [2024-05-26 01:05:09,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ac722d2-1060-45c5-90f5-5fd593a49e2f] received 2024-05-26T01:05:09.320279820Z [2024-05-26 01:05:09,320: INFO/ForkPoolWorker-15] [0ac722d2-1060-45c5-90f5-5fd593a49e2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:05:09.561899947Z [2024-05-26 01:05:09,559: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:05:10.622850110Z [2024-05-26 01:05:10,622: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:05:10.625723405Z [2024-05-26 01:05:10,625: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:05:10.648345717Z [2024-05-26 01:05:10,648: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:05:10.649518031Z [2024-05-26 01:05:10,649: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:05:10.649536761Z [2024-05-26 01:05:10,649: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:05:10.649620734Z [2024-05-26 01:05:10,649: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:05:10.649638059Z [2024-05-26 01:05:10,649: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:05:10.649892558Z [2024-05-26 01:05:10,649: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:05:10.649965949Z [2024-05-26 01:05:10,649: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:05:10.735026492Z [2024-05-26 01:05:10,732: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:05:11.448544377Z [2024-05-26 01:05:11,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ac722d2-1060-45c5-90f5-5fd593a49e2f] succeeded in 2.1342108779990667s: None 2024-05-26T01:06:01.054687032Z [2024-05-26 01:06:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b10af921-9466-41e0-923e-63c6a69744f3] received 2024-05-26T01:06:01.059564209Z [2024-05-26 01:06:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ae05ebe-901d-410d-bce7-60cff2b8f0c2] received 2024-05-26T01:06:01.073055877Z [2024-05-26 01:06:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16bf2eda-1030-45d2-9154-908ad22544dc] received 2024-05-26T01:06:01.076482225Z [2024-05-26 01:06:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65d40108-2716-416d-8749-7045a59ed7bc] received 2024-05-26T01:06:01.085422158Z [2024-05-26 01:06:01,085: INFO/ForkPoolWorker-1] [16bf2eda-1030-45d2-9154-908ad22544dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:06:01.086226810Z [2024-05-26 01:06:01,085: INFO/ForkPoolWorker-15] [b10af921-9466-41e0-923e-63c6a69744f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:06:01.089380845Z [2024-05-26 01:06:01,089: INFO/ForkPoolWorker-2] [65d40108-2716-416d-8749-7045a59ed7bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:06:01.092575936Z [2024-05-26 01:06:01,092: INFO/ForkPoolWorker-16] [8ae05ebe-901d-410d-bce7-60cff2b8f0c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:06:01.411144489Z [2024-05-26 01:06:01,406: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:06:01.428559799Z [2024-05-26 01:06:01,422: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:06:01.472864544Z [2024-05-26 01:06:01,469: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:06:01.524190946Z [2024-05-26 01:06:01,520: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:06:01.657900142Z [2024-05-26 01:06:01,657: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:06:01.661820559Z [2024-05-26 01:06:01,661: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:06:01.680784731Z [2024-05-26 01:06:01,680: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:06:01.682311236Z [2024-05-26 01:06:01,682: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:06:01.682458547Z [2024-05-26 01:06:01,682: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:06:01.682515989Z [2024-05-26 01:06:01,682: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:06:01.682749186Z [2024-05-26 01:06:01,682: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:06:01.781831922Z [2024-05-26 01:06:01,781: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:06:01.839658050Z [2024-05-26 01:06:01,839: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:06:02.397146812Z [2024-05-26 01:06:02,396: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[16bf2eda-1030-45d2-9154-908ad22544dc] succeeded in 1.3198529250003048s: None 2024-05-26T01:06:02.442366535Z [2024-05-26 01:06:02,441: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ae05ebe-901d-410d-bce7-60cff2b8f0c2] succeeded in 1.3664186819987663s: None 2024-05-26T01:06:02.675007287Z [2024-05-26 01:06:02,674: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:06:02.679761857Z [2024-05-26 01:06:02,679: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:06:02.710081563Z [2024-05-26 01:06:02,709: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:06:02.711836177Z [2024-05-26 01:06:02,711: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:06:02.711986558Z [2024-05-26 01:06:02,711: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:06:02.712243491Z [2024-05-26 01:06:02,712: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:06:02.712465885Z [2024-05-26 01:06:02,712: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:06:02.713017077Z [2024-05-26 01:06:02,712: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:06:02.713234116Z [2024-05-26 01:06:02,713: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:06:02.755142257Z [2024-05-26 01:06:02,754: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:06:02.758544262Z [2024-05-26 01:06:02,758: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:06:02.784436815Z [2024-05-26 01:06:02,784: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:06:02.788002787Z [2024-05-26 01:06:02,787: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:06:02.788057412Z [2024-05-26 01:06:02,787: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:06:02.788236283Z [2024-05-26 01:06:02,788: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:06:02.788310216Z [2024-05-26 01:06:02,788: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:06:02.788612505Z [2024-05-26 01:06:02,788: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:06:02.788665584Z [2024-05-26 01:06:02,788: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:06:02.796849887Z [2024-05-26 01:06:02,796: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:06:02.858269536Z [2024-05-26 01:06:02,857: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:06:04.386441867Z [2024-05-26 01:06:04,385: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b10af921-9466-41e0-923e-63c6a69744f3] succeeded in 3.3277537979993213s: None 2024-05-26T01:06:04.924209068Z [2024-05-26 01:06:04,923: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[65d40108-2716-416d-8749-7045a59ed7bc] succeeded in 3.8424883899988345s: None 2024-05-26T01:07:00.204756987Z [2024-05-26 01:07:00,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a9be30e-8e1a-45ff-b27c-b1d3540bbaa8] received 2024-05-26T01:07:00.206796374Z [2024-05-26 01:07:00,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6ac536f-831f-4bb6-a98c-e7c9defea0be] received 2024-05-26T01:07:00.213787957Z [2024-05-26 01:07:00,213: INFO/ForkPoolWorker-15] [5a9be30e-8e1a-45ff-b27c-b1d3540bbaa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:07:00.216210605Z [2024-05-26 01:07:00,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[746732bd-8e07-4af2-b72d-b78d797c5496] received 2024-05-26T01:07:00.220231458Z [2024-05-26 01:07:00,219: INFO/ForkPoolWorker-16] [e6ac536f-831f-4bb6-a98c-e7c9defea0be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:07:00.226456015Z [2024-05-26 01:07:00,226: INFO/ForkPoolWorker-1] [746732bd-8e07-4af2-b72d-b78d797c5496] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:07:00.508005431Z [2024-05-26 01:07:00,504: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:07:00.530983656Z [2024-05-26 01:07:00,527: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:07:00.549324268Z [2024-05-26 01:07:00,542: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:07:00.714826410Z [2024-05-26 01:07:00,714: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:07:00.719460701Z [2024-05-26 01:07:00,719: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:07:00.741105564Z [2024-05-26 01:07:00,740: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:07:00.743561265Z [2024-05-26 01:07:00,741: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:07:00.743590824Z [2024-05-26 01:07:00,742: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:07:00.743595252Z [2024-05-26 01:07:00,742: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:07:00.743598297Z [2024-05-26 01:07:00,742: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:07:00.866965557Z [2024-05-26 01:07:00,866: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:07:01.563987385Z [2024-05-26 01:07:01,563: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[746732bd-8e07-4af2-b72d-b78d797c5496] succeeded in 1.345200470999771s: None 2024-05-26T01:07:01.682419480Z [2024-05-26 01:07:01,682: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:07:01.685713203Z [2024-05-26 01:07:01,685: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:07:01.714790246Z [2024-05-26 01:07:01,714: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:07:01.715080351Z [2024-05-26 01:07:01,714: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:07:01.716494505Z [2024-05-26 01:07:01,716: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:07:01.716666509Z [2024-05-26 01:07:01,716: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:07:01.716861137Z [2024-05-26 01:07:01,716: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:07:01.717012259Z [2024-05-26 01:07:01,716: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:07:01.717364975Z [2024-05-26 01:07:01,717: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:07:01.717415668Z [2024-05-26 01:07:01,717: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:07:01.718311285Z [2024-05-26 01:07:01,717: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:07:01.742521905Z [2024-05-26 01:07:01,742: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:07:01.743925442Z [2024-05-26 01:07:01,743: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:07:01.744134600Z [2024-05-26 01:07:01,743: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:07:01.744331432Z [2024-05-26 01:07:01,744: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:07:01.744445702Z [2024-05-26 01:07:01,744: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:07:01.744772122Z [2024-05-26 01:07:01,744: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:07:01.744841464Z [2024-05-26 01:07:01,744: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:07:01.831045160Z [2024-05-26 01:07:01,830: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:07:01.832837738Z [2024-05-26 01:07:01,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:07:03.366962663Z [2024-05-26 01:07:03,366: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6ac536f-831f-4bb6-a98c-e7c9defea0be] succeeded in 3.1539412710008037s: None 2024-05-26T01:07:03.774756126Z [2024-05-26 01:07:03,773: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a9be30e-8e1a-45ff-b27c-b1d3540bbaa8] succeeded in 3.5659774699997797s: None 2024-05-26T01:08:00.733165240Z [2024-05-26 01:08:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b63706de-bcef-4c39-a32f-4ae1cb17e4ec] received 2024-05-26T01:08:00.733188689Z [2024-05-26 01:08:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c4b30bd-5e4d-4e73-89a8-c479cb126f13] received 2024-05-26T01:08:00.734693299Z [2024-05-26 01:08:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4194257c-db21-4721-b397-9c41dca4229f] received 2024-05-26T01:08:00.739624253Z [2024-05-26 01:08:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[488b13fb-8100-4f73-941b-1b43766fc516] received 2024-05-26T01:08:00.751510645Z [2024-05-26 01:08:00,746: INFO/ForkPoolWorker-2] [488b13fb-8100-4f73-941b-1b43766fc516] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:08:00.754925625Z [2024-05-26 01:08:00,754: INFO/ForkPoolWorker-1] [4194257c-db21-4721-b397-9c41dca4229f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:08:00.771632147Z [2024-05-26 01:08:00,769: INFO/ForkPoolWorker-15] [b63706de-bcef-4c39-a32f-4ae1cb17e4ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:08:00.771653587Z [2024-05-26 01:08:00,769: INFO/ForkPoolWorker-16] [2c4b30bd-5e4d-4e73-89a8-c479cb126f13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:08:01.109826226Z [2024-05-26 01:08:01,106: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:08:01.150580275Z [2024-05-26 01:08:01,147: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:08:01.166750061Z [2024-05-26 01:08:01,163: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:08:01.192775897Z [2024-05-26 01:08:01,189: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:08:01.352248734Z [2024-05-26 01:08:01,351: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:08:01.357955726Z [2024-05-26 01:08:01,357: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:08:01.399937185Z [2024-05-26 01:08:01,399: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:08:01.402180934Z [2024-05-26 01:08:01,401: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:08:01.402700698Z [2024-05-26 01:08:01,402: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:08:01.402941496Z [2024-05-26 01:08:01,402: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:08:01.403284696Z [2024-05-26 01:08:01,403: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:08:01.506969593Z [2024-05-26 01:08:01,506: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:08:01.522097104Z [2024-05-26 01:08:01,521: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:08:02.110992532Z [2024-05-26 01:08:02,109: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[488b13fb-8100-4f73-941b-1b43766fc516] succeeded in 1.3707275390006544s: None 2024-05-26T01:08:02.119159461Z [2024-05-26 01:08:02,118: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b63706de-bcef-4c39-a32f-4ae1cb17e4ec] succeeded in 1.3866619649998029s: None 2024-05-26T01:08:02.396733413Z [2024-05-26 01:08:02,395: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:08:02.399882913Z [2024-05-26 01:08:02,399: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:08:02.407072578Z [2024-05-26 01:08:02,406: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:08:02.410440304Z [2024-05-26 01:08:02,410: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:08:02.426648418Z [2024-05-26 01:08:02,426: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:08:02.429096198Z [2024-05-26 01:08:02,428: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:08:02.429293855Z [2024-05-26 01:08:02,429: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:08:02.429517505Z [2024-05-26 01:08:02,429: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:08:02.429647766Z [2024-05-26 01:08:02,429: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:08:02.429950052Z [2024-05-26 01:08:02,429: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:08:02.430107279Z [2024-05-26 01:08:02,429: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:08:02.439047700Z [2024-05-26 01:08:02,438: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:08:02.440280773Z [2024-05-26 01:08:02,440: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:08:02.440297858Z [2024-05-26 01:08:02,440: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:08:02.440515347Z [2024-05-26 01:08:02,440: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:08:02.440526392Z [2024-05-26 01:08:02,440: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:08:02.441066499Z [2024-05-26 01:08:02,440: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:08:02.441095197Z [2024-05-26 01:08:02,440: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:08:02.511901417Z [2024-05-26 01:08:02,511: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:08:02.522221147Z [2024-05-26 01:08:02,521: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:08:04.045347992Z [2024-05-26 01:08:04,044: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2c4b30bd-5e4d-4e73-89a8-c479cb126f13] succeeded in 3.3089412190001894s: None 2024-05-26T01:08:04.895217551Z [2024-05-26 01:08:04,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4194257c-db21-4721-b397-9c41dca4229f] succeeded in 4.159457644000213s: None 2024-05-26T01:09:00.921059510Z [2024-05-26 01:09:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d18de8c-56db-48ee-aeec-403c23f8089e] received 2024-05-26T01:09:00.932322184Z [2024-05-26 01:09:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59ed27a8-3434-4421-9f2a-59d0e06c59f5] received 2024-05-26T01:09:00.936635189Z [2024-05-26 01:09:00,935: INFO/ForkPoolWorker-15] [0d18de8c-56db-48ee-aeec-403c23f8089e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:09:00.937294902Z [2024-05-26 01:09:00,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8dd00d5d-ad6e-4f69-8016-58436051185c] received 2024-05-26T01:09:00.942493729Z [2024-05-26 01:09:00,942: INFO/ForkPoolWorker-16] [59ed27a8-3434-4421-9f2a-59d0e06c59f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:09:00.949048404Z [2024-05-26 01:09:00,947: INFO/ForkPoolWorker-1] [8dd00d5d-ad6e-4f69-8016-58436051185c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:09:01.296332570Z [2024-05-26 01:09:01,288: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:09:01.360541201Z [2024-05-26 01:09:01,357: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:09:01.416478901Z [2024-05-26 01:09:01,413: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:09:01.551019224Z [2024-05-26 01:09:01,550: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:09:01.554938546Z [2024-05-26 01:09:01,554: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:09:01.588727600Z [2024-05-26 01:09:01,588: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:09:01.592504592Z [2024-05-26 01:09:01,592: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:09:01.594051027Z [2024-05-26 01:09:01,592: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:09:01.594073778Z [2024-05-26 01:09:01,593: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:09:01.594382497Z [2024-05-26 01:09:01,594: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:09:01.686564758Z [2024-05-26 01:09:01,685: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:09:02.246419333Z [2024-05-26 01:09:02,246: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8dd00d5d-ad6e-4f69-8016-58436051185c] succeeded in 1.305892465999932s: None 2024-05-26T01:09:02.513100440Z [2024-05-26 01:09:02,512: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:09:02.516393965Z [2024-05-26 01:09:02,515: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:09:02.532197006Z [2024-05-26 01:09:02,532: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:09:02.533501176Z [2024-05-26 01:09:02,533: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:09:02.533590991Z [2024-05-26 01:09:02,533: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:09:02.533723630Z [2024-05-26 01:09:02,533: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:09:02.533876411Z [2024-05-26 01:09:02,533: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:09:02.534457781Z [2024-05-26 01:09:02,534: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:09:02.534594306Z [2024-05-26 01:09:02,534: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:09:02.633822102Z [2024-05-26 01:09:02,633: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:09:02.693897418Z [2024-05-26 01:09:02,693: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:09:02.697160600Z [2024-05-26 01:09:02,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:09:02.725593296Z [2024-05-26 01:09:02,725: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:09:02.727277291Z [2024-05-26 01:09:02,727: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:09:02.727442419Z [2024-05-26 01:09:02,727: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:09:02.727800026Z [2024-05-26 01:09:02,727: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:09:02.727950624Z [2024-05-26 01:09:02,727: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:09:02.728481497Z [2024-05-26 01:09:02,728: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:09:02.728697466Z [2024-05-26 01:09:02,728: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:09:02.824936342Z [2024-05-26 01:09:02,824: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:09:04.286998543Z [2024-05-26 01:09:04,286: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d18de8c-56db-48ee-aeec-403c23f8089e] succeeded in 3.3624835000009625s: None 2024-05-26T01:09:04.616084189Z [2024-05-26 01:09:04,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59ed27a8-3434-4421-9f2a-59d0e06c59f5] succeeded in 3.680475301000115s: None 2024-05-26T01:10:00.537862635Z [2024-05-26 01:10:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[868f7d16-b228-4473-9adc-fa8c38a79492] received 2024-05-26T01:10:00.541691574Z [2024-05-26 01:10:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bf5db21-c176-4511-b177-28eb4baf222e] received 2024-05-26T01:10:00.544286716Z [2024-05-26 01:10:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7831adb9-6bae-43c3-bd94-c0f90c5ef72c] received 2024-05-26T01:10:00.547312162Z [2024-05-26 01:10:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39cf6e76-c31c-42a7-a95c-88421c858f0d] received 2024-05-26T01:10:00.549313511Z [2024-05-26 01:10:00,548: INFO/ForkPoolWorker-15] [868f7d16-b228-4473-9adc-fa8c38a79492] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:10:00.555118543Z [2024-05-26 01:10:00,554: INFO/ForkPoolWorker-1] [7831adb9-6bae-43c3-bd94-c0f90c5ef72c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:10:00.555784665Z [2024-05-26 01:10:00,555: INFO/ForkPoolWorker-16] [3bf5db21-c176-4511-b177-28eb4baf222e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:10:00.558648151Z [2024-05-26 01:10:00,558: INFO/ForkPoolWorker-2] [39cf6e76-c31c-42a7-a95c-88421c858f0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:10:00.568800461Z [2024-05-26 01:10:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d00de4c-f6d1-46be-95cc-4167f010a738] received 2024-05-26T01:10:00.589165935Z [2024-05-26 01:10:00,588: INFO/ForkPoolWorker-3] [7d00de4c-f6d1-46be-95cc-4167f010a738] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:10:00.915304179Z [2024-05-26 01:10:00,910: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:10:00.923089674Z [2024-05-26 01:10:00,919: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:10:00.959046770Z [2024-05-26 01:10:00,952: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:10:00.989289923Z [2024-05-26 01:10:00,986: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:10:01.232182986Z [2024-05-26 01:10:01,231: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:10:01.355577331Z [2024-05-26 01:10:01,351: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:10:01.545594353Z [2024-05-26 01:10:01,545: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-26T01:10:01.549765493Z [2024-05-26 01:10:01,549: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:10:01.613932467Z [2024-05-26 01:10:01,613: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T01:10:01.615735256Z [2024-05-26 01:10:01,615: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:10:01.615946089Z [2024-05-26 01:10:01,615: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:10:01.616087455Z [2024-05-26 01:10:01,615: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-26T01:10:01.616355620Z [2024-05-26 01:10:01,616: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:10:01.756717124Z [2024-05-26 01:10:01,756: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:10:01.820868090Z [2024-05-26 01:10:01,820: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3bf5db21-c176-4511-b177-28eb4baf222e] succeeded in 1.2774617140003102s: None 2024-05-26T01:10:02.351971009Z [2024-05-26 01:10:02,351: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:10:02.355223856Z [2024-05-26 01:10:02,354: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:10:02.358304014Z [2024-05-26 01:10:02,357: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:10:02.367754741Z [2024-05-26 01:10:02,367: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:10:02.378338368Z [2024-05-26 01:10:02,378: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:10:02.379933351Z [2024-05-26 01:10:02,379: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:10:02.380065865Z [2024-05-26 01:10:02,379: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:10:02.380362149Z [2024-05-26 01:10:02,380: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:10:02.380528790Z [2024-05-26 01:10:02,380: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:10:02.380871935Z [2024-05-26 01:10:02,380: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:10:02.381055754Z [2024-05-26 01:10:02,380: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:10:02.390293335Z [2024-05-26 01:10:02,389: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7d00de4c-f6d1-46be-95cc-4167f010a738] succeeded in 1.8149955049993878s: None 2024-05-26T01:10:02.409491698Z [2024-05-26 01:10:02,409: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:10:02.411017971Z [2024-05-26 01:10:02,410: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:10:02.411057272Z [2024-05-26 01:10:02,410: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:10:02.411275041Z [2024-05-26 01:10:02,411: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:10:02.411371802Z [2024-05-26 01:10:02,411: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:10:02.411834436Z [2024-05-26 01:10:02,411: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:10:02.411929839Z [2024-05-26 01:10:02,411: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:10:02.472978502Z [2024-05-26 01:10:02,472: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:10:02.493738323Z [2024-05-26 01:10:02,493: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:10:02.777317350Z [2024-05-26 01:10:02,776: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:10:02.780660805Z [2024-05-26 01:10:02,780: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:10:02.821393132Z [2024-05-26 01:10:02,821: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:10:02.823471157Z [2024-05-26 01:10:02,823: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:10:02.823682835Z [2024-05-26 01:10:02,823: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:10:02.823932320Z [2024-05-26 01:10:02,823: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:10:02.824083096Z [2024-05-26 01:10:02,823: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:10:02.824394767Z [2024-05-26 01:10:02,824: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:10:02.824650453Z [2024-05-26 01:10:02,824: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:10:02.946677379Z [2024-05-26 01:10:02,946: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:10:03.084751278Z [2024-05-26 01:10:03,084: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[868f7d16-b228-4473-9adc-fa8c38a79492] succeeded in 2.542462383999009s: None 2024-05-26T01:10:03.380122943Z [2024-05-26 01:10:03,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1330d6e8-7030-4300-8b82-f0024b132292] received 2024-05-26T01:10:03.430457136Z [2024-05-26 01:10:03,420: INFO/ForkPoolWorker-15] [1330d6e8-7030-4300-8b82-f0024b132292] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:10:03.714332461Z [2024-05-26 01:10:03,711: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:10:03.990307999Z [2024-05-26 01:10:03,989: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[39cf6e76-c31c-42a7-a95c-88421c858f0d] succeeded in 3.440057079998951s: None 2024-05-26T01:10:04.948729338Z [2024-05-26 01:10:04,948: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:10:04.952148680Z [2024-05-26 01:10:04,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:10:04.985420674Z [2024-05-26 01:10:04,985: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:10:04.990446038Z [2024-05-26 01:10:04,990: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:10:04.990473137Z [2024-05-26 01:10:04,990: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:10:04.990489295Z [2024-05-26 01:10:04,990: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:10:04.990531030Z [2024-05-26 01:10:04,990: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:10:04.990853928Z [2024-05-26 01:10:04,990: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:10:04.990891518Z [2024-05-26 01:10:04,990: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:10:05.090665284Z [2024-05-26 01:10:05,090: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:10:05.195455359Z [2024-05-26 01:10:05,195: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7831adb9-6bae-43c3-bd94-c0f90c5ef72c] succeeded in 4.648869025000749s: None 2024-05-26T01:10:05.781685336Z [2024-05-26 01:10:05,781: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1330d6e8-7030-4300-8b82-f0024b132292] succeeded in 2.39569833799942s: None 2024-05-26T01:10:06.410430412Z [2024-05-26 01:10:06,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18079d3e-784b-4e28-b8e6-82503d59a274] received 2024-05-26T01:10:06.426430616Z [2024-05-26 01:10:06,426: INFO/ForkPoolWorker-15] [18079d3e-784b-4e28-b8e6-82503d59a274] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:10:06.707582832Z [2024-05-26 01:10:06,704: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:10:07.731265567Z [2024-05-26 01:10:07,730: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:10:07.734731388Z [2024-05-26 01:10:07,734: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:10:07.768434457Z [2024-05-26 01:10:07,768: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:10:07.770030877Z [2024-05-26 01:10:07,769: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:10:07.770041469Z [2024-05-26 01:10:07,769: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:10:07.770250155Z [2024-05-26 01:10:07,770: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:10:07.770311170Z [2024-05-26 01:10:07,770: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:10:07.770634580Z [2024-05-26 01:10:07,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:10:07.770640452Z [2024-05-26 01:10:07,770: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:10:07.869340784Z [2024-05-26 01:10:07,868: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:10:08.470339649Z [2024-05-26 01:10:08,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[381c2737-e288-4193-943e-e16c0854ee85] received 2024-05-26T01:10:08.492294600Z [2024-05-26 01:10:08,492: INFO/ForkPoolWorker-16] [381c2737-e288-4193-943e-e16c0854ee85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:10:08.538561698Z [2024-05-26 01:10:08,538: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[18079d3e-784b-4e28-b8e6-82503d59a274] succeeded in 2.1228993219992844s: None 2024-05-26T01:10:08.754170897Z [2024-05-26 01:10:08,751: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:10:09.796748764Z [2024-05-26 01:10:09,796: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:10:09.800033663Z [2024-05-26 01:10:09,799: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:10:09.825999074Z [2024-05-26 01:10:09,825: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:10:09.828863212Z [2024-05-26 01:10:09,828: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:10:09.829033935Z [2024-05-26 01:10:09,828: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:10:09.829404264Z [2024-05-26 01:10:09,828: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:10:09.829603028Z [2024-05-26 01:10:09,829: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:10:09.830255138Z [2024-05-26 01:10:09,829: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:10:09.830458966Z [2024-05-26 01:10:09,830: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:10:09.944601597Z [2024-05-26 01:10:09,944: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:10:10.565775944Z [2024-05-26 01:10:10,565: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[381c2737-e288-4193-943e-e16c0854ee85] succeeded in 2.092890242000067s: None 2024-05-26T01:11:00.404246312Z [2024-05-26 01:11:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cbc1104-8ed8-48dd-8d23-bee58e1b7e0e] received 2024-05-26T01:11:00.405444024Z [2024-05-26 01:11:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79586f51-0846-41b0-ac19-ff7cbc1088e0] received 2024-05-26T01:11:00.413989416Z [2024-05-26 01:11:00,413: INFO/ForkPoolWorker-15] [1cbc1104-8ed8-48dd-8d23-bee58e1b7e0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:11:00.415634065Z [2024-05-26 01:11:00,415: INFO/ForkPoolWorker-16] [79586f51-0846-41b0-ac19-ff7cbc1088e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:11:00.420131222Z [2024-05-26 01:11:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0076f3c1-1494-466b-9395-0cb94bab989b] received 2024-05-26T01:11:00.448468474Z [2024-05-26 01:11:00,448: INFO/ForkPoolWorker-1] [0076f3c1-1494-466b-9395-0cb94bab989b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:11:00.690834338Z [2024-05-26 01:11:00,687: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:11:00.701909393Z [2024-05-26 01:11:00,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:11:00.772882598Z [2024-05-26 01:11:00,769: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:11:00.975811463Z [2024-05-26 01:11:00,975: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:11:00.980016676Z [2024-05-26 01:11:00,979: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:11:01.013389963Z [2024-05-26 01:11:01,013: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:11:01.020892883Z [2024-05-26 01:11:01,020: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:11:01.020974495Z [2024-05-26 01:11:01,020: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:11:01.021031386Z [2024-05-26 01:11:01,020: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:11:01.021214403Z [2024-05-26 01:11:01,021: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:11:01.108100844Z [2024-05-26 01:11:01,107: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:11:01.675010921Z [2024-05-26 01:11:01,674: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0076f3c1-1494-466b-9395-0cb94bab989b] succeeded in 1.2497612919996754s: None 2024-05-26T01:11:01.901051568Z [2024-05-26 01:11:01,900: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:11:01.904058767Z [2024-05-26 01:11:01,903: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:11:01.907884724Z [2024-05-26 01:11:01,907: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:11:01.911060733Z [2024-05-26 01:11:01,910: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:11:01.927507311Z [2024-05-26 01:11:01,927: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:11:01.928982851Z [2024-05-26 01:11:01,928: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:11:01.929000027Z [2024-05-26 01:11:01,928: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:11:01.929181409Z [2024-05-26 01:11:01,928: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:11:01.929190131Z [2024-05-26 01:11:01,929: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:11:01.929501585Z [2024-05-26 01:11:01,929: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:11:01.929519434Z [2024-05-26 01:11:01,929: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:11:01.932293110Z [2024-05-26 01:11:01,932: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:11:01.933587050Z [2024-05-26 01:11:01,933: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:11:01.933598438Z [2024-05-26 01:11:01,933: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:11:01.933770107Z [2024-05-26 01:11:01,933: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:11:01.933882091Z [2024-05-26 01:11:01,933: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:11:01.934163115Z [2024-05-26 01:11:01,933: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:11:01.934171801Z [2024-05-26 01:11:01,934: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:11:02.016925681Z [2024-05-26 01:11:02,016: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:11:02.017836332Z [2024-05-26 01:11:02,017: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:11:03.530247722Z [2024-05-26 01:11:03,529: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[79586f51-0846-41b0-ac19-ff7cbc1088e0] succeeded in 3.1235957980006788s: None 2024-05-26T01:11:03.834031016Z [2024-05-26 01:11:03,833: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cbc1104-8ed8-48dd-8d23-bee58e1b7e0e] succeeded in 3.427124563999314s: None 2024-05-26T01:12:00.361793097Z [2024-05-26 01:12:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40979926-31a1-4b6c-9e8e-3e8fef88c275] received 2024-05-26T01:12:00.365478706Z [2024-05-26 01:12:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f2b5b11-0efb-4723-b751-1672e2fce246] received 2024-05-26T01:12:00.371450965Z [2024-05-26 01:12:00,371: INFO/ForkPoolWorker-15] [40979926-31a1-4b6c-9e8e-3e8fef88c275] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:12:00.375044833Z [2024-05-26 01:12:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a96ba326-8bf3-4ba4-bb38-a26603185b41] received 2024-05-26T01:12:00.375234357Z [2024-05-26 01:12:00,375: INFO/ForkPoolWorker-16] [5f2b5b11-0efb-4723-b751-1672e2fce246] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:12:00.381341290Z [2024-05-26 01:12:00,381: INFO/ForkPoolWorker-1] [a96ba326-8bf3-4ba4-bb38-a26603185b41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:12:00.383918681Z [2024-05-26 01:12:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21232bda-fe85-447c-a2f4-2f74be5593eb] received 2024-05-26T01:12:00.401175984Z [2024-05-26 01:12:00,400: INFO/ForkPoolWorker-2] [21232bda-fe85-447c-a2f4-2f74be5593eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:12:00.717324789Z [2024-05-26 01:12:00,711: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:12:00.749378065Z [2024-05-26 01:12:00,746: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:12:01.006989855Z [2024-05-26 01:12:00,993: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:12:01.043379170Z [2024-05-26 01:12:01,039: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:12:01.210974063Z [2024-05-26 01:12:01,210: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:12:01.215022661Z [2024-05-26 01:12:01,214: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:12:01.232007569Z [2024-05-26 01:12:01,231: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:12:01.233014141Z [2024-05-26 01:12:01,232: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:12:01.233202818Z [2024-05-26 01:12:01,232: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:12:01.233341078Z [2024-05-26 01:12:01,233: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:12:01.233620208Z [2024-05-26 01:12:01,233: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:12:01.290697981Z [2024-05-26 01:12:01,290: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:12:01.371679838Z [2024-05-26 01:12:01,371: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:12:01.935780920Z [2024-05-26 01:12:01,935: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[40979926-31a1-4b6c-9e8e-3e8fef88c275] succeeded in 1.5718627559999732s: None 2024-05-26T01:12:02.023272227Z [2024-05-26 01:12:02,022: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[21232bda-fe85-447c-a2f4-2f74be5593eb] succeeded in 1.6352532930013695s: None 2024-05-26T01:12:02.319235611Z [2024-05-26 01:12:02,318: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:12:02.322534558Z [2024-05-26 01:12:02,322: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:12:02.346402851Z [2024-05-26 01:12:02,346: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:12:02.347790788Z [2024-05-26 01:12:02,347: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:12:02.347860535Z [2024-05-26 01:12:02,347: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:12:02.348001351Z [2024-05-26 01:12:02,347: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:12:02.348072532Z [2024-05-26 01:12:02,348: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:12:02.348308311Z [2024-05-26 01:12:02,348: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:12:02.348696951Z [2024-05-26 01:12:02,348: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:12:02.412506199Z [2024-05-26 01:12:02,412: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:12:02.415862341Z [2024-05-26 01:12:02,415: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:12:02.441187721Z [2024-05-26 01:12:02,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:12:02.443085740Z [2024-05-26 01:12:02,442: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:12:02.443104165Z [2024-05-26 01:12:02,443: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:12:02.443307976Z [2024-05-26 01:12:02,443: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:12:02.443338649Z [2024-05-26 01:12:02,443: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:12:02.444210789Z [2024-05-26 01:12:02,443: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:12:02.444319883Z [2024-05-26 01:12:02,444: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:12:02.445612916Z [2024-05-26 01:12:02,445: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:12:02.518169269Z [2024-05-26 01:12:02,517: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:12:03.954239548Z [2024-05-26 01:12:03,953: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a96ba326-8bf3-4ba4-bb38-a26603185b41] succeeded in 3.5771955290001642s: None 2024-05-26T01:12:05.692238623Z [2024-05-26 01:12:05,691: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5f2b5b11-0efb-4723-b751-1672e2fce246] succeeded in 5.324497134999547s: None 2024-05-26T01:13:00.269031337Z [2024-05-26 01:13:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9993880d-067b-4f5a-a780-abad2827f337] received 2024-05-26T01:13:00.273176818Z [2024-05-26 01:13:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15433650-655a-431e-8508-b25369ba5b8e] received 2024-05-26T01:13:00.285067999Z [2024-05-26 01:13:00,284: INFO/ForkPoolWorker-15] [9993880d-067b-4f5a-a780-abad2827f337] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:13:00.287337123Z [2024-05-26 01:13:00,286: INFO/ForkPoolWorker-16] [15433650-655a-431e-8508-b25369ba5b8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:13:00.289438663Z [2024-05-26 01:13:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3cc2301-fc9b-415e-9da6-195703a4bc29] received 2024-05-26T01:13:00.302116373Z [2024-05-26 01:13:00,301: INFO/ForkPoolWorker-1] [c3cc2301-fc9b-415e-9da6-195703a4bc29] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:13:00.623881249Z [2024-05-26 01:13:00,620: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:13:00.639727938Z [2024-05-26 01:13:00,636: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:13:00.675200273Z [2024-05-26 01:13:00,671: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:13:00.819675727Z [2024-05-26 01:13:00,815: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:13:00.820523307Z [2024-05-26 01:13:00,820: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:13:00.840553735Z [2024-05-26 01:13:00,840: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:13:00.841686988Z [2024-05-26 01:13:00,841: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:13:00.841741415Z [2024-05-26 01:13:00,841: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:13:00.841865173Z [2024-05-26 01:13:00,841: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:13:00.842414984Z [2024-05-26 01:13:00,842: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:13:00.957374826Z [2024-05-26 01:13:00,955: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:13:01.666632031Z [2024-05-26 01:13:01,666: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c3cc2301-fc9b-415e-9da6-195703a4bc29] succeeded in 1.3753323780001665s: None 2024-05-26T01:13:01.918813275Z [2024-05-26 01:13:01,918: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:13:01.922216840Z [2024-05-26 01:13:01,921: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:13:01.945459825Z [2024-05-26 01:13:01,945: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:13:01.947326090Z [2024-05-26 01:13:01,946: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:13:01.947357608Z [2024-05-26 01:13:01,947: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:13:01.947816057Z [2024-05-26 01:13:01,947: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:13:01.947829777Z [2024-05-26 01:13:01,947: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:13:01.948396019Z [2024-05-26 01:13:01,948: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:13:01.948430395Z [2024-05-26 01:13:01,948: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:13:01.999496455Z [2024-05-26 01:13:01,999: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:13:02.006739974Z [2024-05-26 01:13:02,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:13:02.033387423Z [2024-05-26 01:13:02,033: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:13:02.042779973Z [2024-05-26 01:13:02,042: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:13:02.045258331Z [2024-05-26 01:13:02,044: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:13:02.045486028Z [2024-05-26 01:13:02,045: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:13:02.045705476Z [2024-05-26 01:13:02,045: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:13:02.045720227Z [2024-05-26 01:13:02,045: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:13:02.046323289Z [2024-05-26 01:13:02,046: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:13:02.046393530Z [2024-05-26 01:13:02,046: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:13:02.147798823Z [2024-05-26 01:13:02,147: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:13:03.516485287Z [2024-05-26 01:13:03,516: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15433650-655a-431e-8508-b25369ba5b8e] succeeded in 3.2410633259987662s: None 2024-05-26T01:13:04.481014867Z [2024-05-26 01:13:04,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9993880d-067b-4f5a-a780-abad2827f337] succeeded in 4.210019731999637s: None 2024-05-26T01:14:00.904781622Z [2024-05-26 01:14:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41b9cbef-5b59-4aa9-a17a-9c9ef5461d5a] received 2024-05-26T01:14:00.916448708Z [2024-05-26 01:14:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea7f962c-e9fe-4c6e-801a-ee263105928a] received 2024-05-26T01:14:00.917514312Z [2024-05-26 01:14:00,917: INFO/ForkPoolWorker-15] [41b9cbef-5b59-4aa9-a17a-9c9ef5461d5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:14:00.926659858Z [2024-05-26 01:14:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c7f773c-6dd8-4946-95da-61cf896568ee] received 2024-05-26T01:14:00.931166218Z [2024-05-26 01:14:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a297e0a9-61dc-45ea-86ba-dc2086539cf9] received 2024-05-26T01:14:00.936200221Z [2024-05-26 01:14:00,935: INFO/ForkPoolWorker-16] [ea7f962c-e9fe-4c6e-801a-ee263105928a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:14:00.943366708Z [2024-05-26 01:14:00,943: INFO/ForkPoolWorker-1] [3c7f773c-6dd8-4946-95da-61cf896568ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:14:00.944169661Z [2024-05-26 01:14:00,943: INFO/ForkPoolWorker-2] [a297e0a9-61dc-45ea-86ba-dc2086539cf9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:14:01.241085724Z [2024-05-26 01:14:01,237: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:14:01.257443664Z [2024-05-26 01:14:01,253: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:14:01.288804590Z [2024-05-26 01:14:01,285: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:14:01.437727324Z [2024-05-26 01:14:01,433: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:14:01.467434601Z [2024-05-26 01:14:01,466: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:14:01.471241587Z [2024-05-26 01:14:01,470: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:14:01.492636303Z [2024-05-26 01:14:01,492: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:14:01.524484823Z [2024-05-26 01:14:01,524: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:14:01.528522030Z [2024-05-26 01:14:01,528: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:14:01.528614005Z [2024-05-26 01:14:01,528: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:14:01.528678646Z [2024-05-26 01:14:01,528: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:14:01.528890102Z [2024-05-26 01:14:01,528: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:14:01.613037983Z [2024-05-26 01:14:01,612: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:14:02.070945857Z [2024-05-26 01:14:02,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41b9cbef-5b59-4aa9-a17a-9c9ef5461d5a] succeeded in 1.1630276560008497s: None 2024-05-26T01:14:02.176222599Z [2024-05-26 01:14:02,175: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a297e0a9-61dc-45ea-86ba-dc2086539cf9] succeeded in 1.2422577969991835s: None 2024-05-26T01:14:02.541146446Z [2024-05-26 01:14:02,540: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:14:02.544335303Z [2024-05-26 01:14:02,543: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:14:02.565125502Z [2024-05-26 01:14:02,564: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:14:02.566306055Z [2024-05-26 01:14:02,566: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:14:02.566365255Z [2024-05-26 01:14:02,566: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:14:02.566525873Z [2024-05-26 01:14:02,566: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:14:02.566590910Z [2024-05-26 01:14:02,566: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:14:02.566816171Z [2024-05-26 01:14:02,566: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:14:02.566875847Z [2024-05-26 01:14:02,566: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:14:02.639422948Z [2024-05-26 01:14:02,639: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:14:02.752966092Z [2024-05-26 01:14:02,752: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:14:02.756355568Z [2024-05-26 01:14:02,755: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:14:02.778045515Z [2024-05-26 01:14:02,777: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:14:02.779411890Z [2024-05-26 01:14:02,779: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:14:02.779568576Z [2024-05-26 01:14:02,779: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:14:02.779810333Z [2024-05-26 01:14:02,779: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:14:02.779905208Z [2024-05-26 01:14:02,779: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:14:02.780218923Z [2024-05-26 01:14:02,780: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:14:02.780261566Z [2024-05-26 01:14:02,780: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:14:02.872188559Z [2024-05-26 01:14:02,870: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:14:04.567670171Z [2024-05-26 01:14:04,561: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c7f773c-6dd8-4946-95da-61cf896568ee] succeeded in 3.6303501700003835s: None 2024-05-26T01:14:04.837759417Z [2024-05-26 01:14:04,837: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ea7f962c-e9fe-4c6e-801a-ee263105928a] succeeded in 3.909280375999515s: None 2024-05-26T01:15:00.726865199Z [2024-05-26 01:15:00,726: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a688820-25fe-4614-b32f-3e95bfade6b8] received 2024-05-26T01:15:00.728629848Z [2024-05-26 01:15:00,728: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5322114e-8e8a-4f14-8ab7-7855296e1382] received 2024-05-26T01:15:00.731635549Z [2024-05-26 01:15:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ee9dad2-93f4-4e56-b93b-8fd9ac42ac0d] received 2024-05-26T01:15:00.732460635Z [2024-05-26 01:15:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb494de1-d1b5-44ee-bee8-dbace3281744] received 2024-05-26T01:15:00.754949524Z [2024-05-26 01:15:00,746: INFO/ForkPoolWorker-1] [1ee9dad2-93f4-4e56-b93b-8fd9ac42ac0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:15:00.754977987Z [2024-05-26 01:15:00,747: INFO/ForkPoolWorker-2] [fb494de1-d1b5-44ee-bee8-dbace3281744] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:15:00.759757734Z [2024-05-26 01:15:00,757: INFO/ForkPoolWorker-16] [5322114e-8e8a-4f14-8ab7-7855296e1382] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:15:00.763639854Z [2024-05-26 01:15:00,759: INFO/ForkPoolWorker-15] [5a688820-25fe-4614-b32f-3e95bfade6b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:15:01.073577426Z [2024-05-26 01:15:01,070: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:15:01.133800942Z [2024-05-26 01:15:01,130: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:15:01.210530674Z [2024-05-26 01:15:01,207: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:15:01.213810696Z [2024-05-26 01:15:01,210: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:15:01.392022303Z [2024-05-26 01:15:01,391: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:15:01.395971705Z [2024-05-26 01:15:01,395: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:15:01.429679542Z [2024-05-26 01:15:01,429: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:15:01.432323524Z [2024-05-26 01:15:01,432: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:15:01.432374935Z [2024-05-26 01:15:01,432: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:15:01.432451648Z [2024-05-26 01:15:01,432: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:15:01.432719006Z [2024-05-26 01:15:01,432: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:15:01.564568405Z [2024-05-26 01:15:01,564: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:15:02.222582087Z [2024-05-26 01:15:02,220: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5322114e-8e8a-4f14-8ab7-7855296e1382] succeeded in 1.4905431579991273s: None 2024-05-26T01:15:02.394914435Z [2024-05-26 01:15:02,394: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:15:02.395858207Z [2024-05-26 01:15:02,395: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:15:02.398234538Z [2024-05-26 01:15:02,397: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:15:02.399486722Z [2024-05-26 01:15:02,399: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:15:02.424214748Z [2024-05-26 01:15:02,424: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:15:02.425435735Z [2024-05-26 01:15:02,425: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:15:02.425507447Z [2024-05-26 01:15:02,425: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:15:02.425616713Z [2024-05-26 01:15:02,425: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:15:02.425694062Z [2024-05-26 01:15:02,425: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:15:02.425767683Z [2024-05-26 01:15:02,425: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:15:02.425941818Z [2024-05-26 01:15:02,425: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:15:02.425977503Z [2024-05-26 01:15:02,425: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:15:02.427270852Z [2024-05-26 01:15:02,427: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:15:02.427486311Z [2024-05-26 01:15:02,427: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:15:02.427754120Z [2024-05-26 01:15:02,427: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:15:02.427912713Z [2024-05-26 01:15:02,427: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:15:02.428226607Z [2024-05-26 01:15:02,428: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:15:02.428472532Z [2024-05-26 01:15:02,428: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:15:02.494618803Z [2024-05-26 01:15:02,494: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:15:02.502533270Z [2024-05-26 01:15:02,502: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:15:02.542104488Z [2024-05-26 01:15:02,541: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:15:02.545231065Z [2024-05-26 01:15:02,544: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:15:02.564884314Z [2024-05-26 01:15:02,564: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:15:02.566029339Z [2024-05-26 01:15:02,565: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:15:02.566074378Z [2024-05-26 01:15:02,565: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:15:02.566169564Z [2024-05-26 01:15:02,565: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:15:02.566195314Z [2024-05-26 01:15:02,566: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:15:02.566383995Z [2024-05-26 01:15:02,566: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:15:02.566419978Z [2024-05-26 01:15:02,566: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:15:02.642230072Z [2024-05-26 01:15:02,641: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:15:03.283346129Z [2024-05-26 01:15:03,282: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1ee9dad2-93f4-4e56-b93b-8fd9ac42ac0d] succeeded in 2.550728173000607s: None 2024-05-26T01:15:04.052003671Z [2024-05-26 01:15:04,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a688820-25fe-4614-b32f-3e95bfade6b8] succeeded in 3.3201947920006205s: None 2024-05-26T01:15:04.138289425Z [2024-05-26 01:15:04,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a57d5f81-3460-4b50-9a36-f2263c7be96b] received 2024-05-26T01:15:04.168306867Z [2024-05-26 01:15:04,167: INFO/ForkPoolWorker-15] [a57d5f81-3460-4b50-9a36-f2263c7be96b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:15:04.479820166Z [2024-05-26 01:15:04,477: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fb494de1-d1b5-44ee-bee8-dbace3281744] succeeded in 3.7438821169998846s: None 2024-05-26T01:15:04.543291961Z [2024-05-26 01:15:04,525: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:15:05.792244859Z [2024-05-26 01:15:05,791: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:15:05.795386175Z [2024-05-26 01:15:05,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:15:05.816554569Z [2024-05-26 01:15:05,816: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:15:05.817801953Z [2024-05-26 01:15:05,817: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:15:05.817937969Z [2024-05-26 01:15:05,817: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:15:05.818107091Z [2024-05-26 01:15:05,817: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:15:05.818202303Z [2024-05-26 01:15:05,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:15:05.818437743Z [2024-05-26 01:15:05,818: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:15:05.818540166Z [2024-05-26 01:15:05,818: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:15:05.905621975Z [2024-05-26 01:15:05,905: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:15:06.631200920Z [2024-05-26 01:15:06,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a57d5f81-3460-4b50-9a36-f2263c7be96b] succeeded in 2.4897884689999046s: None 2024-05-26T01:15:07.421675733Z [2024-05-26 01:15:07,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c04a18a-574a-4197-9d01-c80aed9e1f8c] received 2024-05-26T01:15:07.436683203Z [2024-05-26 01:15:07,436: INFO/ForkPoolWorker-15] [6c04a18a-574a-4197-9d01-c80aed9e1f8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:15:07.745477630Z [2024-05-26 01:15:07,742: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:15:08.831916655Z [2024-05-26 01:15:08,831: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:15:08.835581957Z [2024-05-26 01:15:08,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:15:08.862832176Z [2024-05-26 01:15:08,856: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:15:08.862866254Z [2024-05-26 01:15:08,857: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:15:08.862895718Z [2024-05-26 01:15:08,857: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:15:08.862908162Z [2024-05-26 01:15:08,857: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:15:08.862918286Z [2024-05-26 01:15:08,857: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:15:08.862927215Z [2024-05-26 01:15:08,857: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:15:08.862935952Z [2024-05-26 01:15:08,857: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:15:08.942196597Z [2024-05-26 01:15:08,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:15:09.490573312Z [2024-05-26 01:15:09,490: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c04a18a-574a-4197-9d01-c80aed9e1f8c] succeeded in 2.064104221000889s: None 2024-05-26T01:15:09.838548496Z [2024-05-26 01:15:09,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1686d7c-eb81-488c-b202-d86911572dd2] received 2024-05-26T01:15:09.853801591Z [2024-05-26 01:15:09,853: INFO/ForkPoolWorker-15] [a1686d7c-eb81-488c-b202-d86911572dd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:15:10.123140278Z [2024-05-26 01:15:10,120: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:15:11.238379095Z [2024-05-26 01:15:11,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:15:11.241802183Z [2024-05-26 01:15:11,241: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:15:11.259029728Z [2024-05-26 01:15:11,258: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:15:11.260179174Z [2024-05-26 01:15:11,259: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:15:11.260197258Z [2024-05-26 01:15:11,260: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:15:11.260272790Z [2024-05-26 01:15:11,260: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:15:11.260308173Z [2024-05-26 01:15:11,260: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:15:11.260535219Z [2024-05-26 01:15:11,260: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:15:11.260544108Z [2024-05-26 01:15:11,260: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:15:11.381560565Z [2024-05-26 01:15:11,381: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:15:12.009483437Z [2024-05-26 01:15:12,008: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1686d7c-eb81-488c-b202-d86911572dd2] succeeded in 2.1674194959996385s: None 2024-05-26T01:16:00.595032382Z [2024-05-26 01:16:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22420852-d299-41fa-8e1e-953001db0eec] received 2024-05-26T01:16:00.601864919Z [2024-05-26 01:16:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43a7fac3-7213-4609-9e14-ad6f53452955] received 2024-05-26T01:16:00.607146027Z [2024-05-26 01:16:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b81dd66-86cf-4d78-8cd2-0c9b01008347] received 2024-05-26T01:16:00.607813639Z [2024-05-26 01:16:00,607: INFO/ForkPoolWorker-15] [22420852-d299-41fa-8e1e-953001db0eec] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:16:00.611425945Z [2024-05-26 01:16:00,611: INFO/ForkPoolWorker-16] [43a7fac3-7213-4609-9e14-ad6f53452955] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:16:00.621087844Z [2024-05-26 01:16:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[141a9d21-2463-41c9-9488-40f8511a2d9e] received 2024-05-26T01:16:00.636489393Z [2024-05-26 01:16:00,636: INFO/ForkPoolWorker-2] [141a9d21-2463-41c9-9488-40f8511a2d9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:16:00.641958488Z [2024-05-26 01:16:00,638: INFO/ForkPoolWorker-1] [7b81dd66-86cf-4d78-8cd2-0c9b01008347] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:16:01.031392784Z [2024-05-26 01:16:01,027: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:16:01.086843385Z [2024-05-26 01:16:01,082: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:16:01.230672449Z [2024-05-26 01:16:01,222: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:16:01.233351509Z [2024-05-26 01:16:01,226: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:16:01.247623055Z [2024-05-26 01:16:01,247: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:16:01.251565765Z [2024-05-26 01:16:01,251: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:16:01.276636470Z [2024-05-26 01:16:01,276: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:16:01.280334406Z [2024-05-26 01:16:01,280: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:16:01.280444648Z [2024-05-26 01:16:01,280: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:16:01.280504517Z [2024-05-26 01:16:01,280: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:16:01.280695039Z [2024-05-26 01:16:01,280: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:16:01.558022336Z [2024-05-26 01:16:01,557: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:16:01.693575112Z [2024-05-26 01:16:01,693: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:16:02.269711702Z [2024-05-26 01:16:02,269: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[141a9d21-2463-41c9-9488-40f8511a2d9e] succeeded in 1.6441506459996162s: None 2024-05-26T01:16:02.390918388Z [2024-05-26 01:16:02,390: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22420852-d299-41fa-8e1e-953001db0eec] succeeded in 1.7910736839985475s: None 2024-05-26T01:16:02.538594723Z [2024-05-26 01:16:02,538: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:16:02.542284319Z [2024-05-26 01:16:02,541: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:16:02.564678164Z [2024-05-26 01:16:02,564: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:16:02.566067651Z [2024-05-26 01:16:02,565: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:16:02.566244167Z [2024-05-26 01:16:02,566: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:16:02.566438706Z [2024-05-26 01:16:02,566: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:16:02.566562248Z [2024-05-26 01:16:02,566: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:16:02.566841537Z [2024-05-26 01:16:02,566: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:16:02.567221204Z [2024-05-26 01:16:02,567: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:16:02.605918803Z [2024-05-26 01:16:02,605: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:16:02.609178156Z [2024-05-26 01:16:02,608: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:16:02.634324770Z [2024-05-26 01:16:02,634: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:16:02.636707345Z [2024-05-26 01:16:02,636: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:16:02.637003525Z [2024-05-26 01:16:02,636: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:16:02.637291672Z [2024-05-26 01:16:02,637: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:16:02.637454516Z [2024-05-26 01:16:02,637: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:16:02.637785086Z [2024-05-26 01:16:02,637: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:16:02.637941142Z [2024-05-26 01:16:02,637: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:16:02.667886672Z [2024-05-26 01:16:02,667: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:16:02.734066598Z [2024-05-26 01:16:02,733: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:16:04.298901528Z [2024-05-26 01:16:04,298: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7b81dd66-86cf-4d78-8cd2-0c9b01008347] succeeded in 3.685332646000461s: None 2024-05-26T01:16:04.589154713Z [2024-05-26 01:16:04,588: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[43a7fac3-7213-4609-9e14-ad6f53452955] succeeded in 3.985101650998331s: None 2024-05-26T01:17:00.384417956Z [2024-05-26 01:17:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4fcb374-2a86-42d4-b62b-641ed98c52a7] received 2024-05-26T01:17:00.390443012Z [2024-05-26 01:17:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbbf7473-0b93-422b-a1ea-789e1226e3c2] received 2024-05-26T01:17:00.392096389Z [2024-05-26 01:17:00,391: INFO/ForkPoolWorker-15] [a4fcb374-2a86-42d4-b62b-641ed98c52a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:17:00.396621647Z [2024-05-26 01:17:00,396: INFO/ForkPoolWorker-16] [bbbf7473-0b93-422b-a1ea-789e1226e3c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:17:00.407223313Z [2024-05-26 01:17:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[139c6215-13cc-4bd1-ac66-bdc1269a834b] received 2024-05-26T01:17:00.419009714Z [2024-05-26 01:17:00,418: INFO/ForkPoolWorker-1] [139c6215-13cc-4bd1-ac66-bdc1269a834b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:17:00.694369088Z [2024-05-26 01:17:00,690: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:17:00.731680545Z [2024-05-26 01:17:00,727: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:17:00.836739728Z [2024-05-26 01:17:00,833: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:17:00.903007380Z [2024-05-26 01:17:00,902: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:17:00.907215432Z [2024-05-26 01:17:00,906: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:17:00.925513302Z [2024-05-26 01:17:00,925: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:17:00.926994572Z [2024-05-26 01:17:00,926: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:17:00.927187415Z [2024-05-26 01:17:00,926: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:17:00.927215888Z [2024-05-26 01:17:00,927: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:17:00.927318392Z [2024-05-26 01:17:00,927: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:17:01.020460490Z [2024-05-26 01:17:01,020: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:17:01.665766150Z [2024-05-26 01:17:01,665: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bbbf7473-0b93-422b-a1ea-789e1226e3c2] succeeded in 1.2737953129999369s: None 2024-05-26T01:17:01.969082610Z [2024-05-26 01:17:01,968: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:17:01.972178789Z [2024-05-26 01:17:01,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:17:01.973293473Z [2024-05-26 01:17:01,973: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:17:01.976444015Z [2024-05-26 01:17:01,976: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:17:01.996085822Z [2024-05-26 01:17:01,995: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:17:01.997994208Z [2024-05-26 01:17:01,997: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:17:01.998021810Z [2024-05-26 01:17:01,997: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:17:01.998181301Z [2024-05-26 01:17:01,998: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:17:01.998240229Z [2024-05-26 01:17:01,998: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:17:01.998470503Z [2024-05-26 01:17:01,998: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:17:01.998588177Z [2024-05-26 01:17:01,998: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:17:02.000336476Z [2024-05-26 01:17:02,000: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:17:02.001602547Z [2024-05-26 01:17:02,001: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:17:02.001802823Z [2024-05-26 01:17:02,001: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:17:02.002022872Z [2024-05-26 01:17:02,001: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:17:02.002152756Z [2024-05-26 01:17:02,002: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:17:02.002452066Z [2024-05-26 01:17:02,002: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:17:02.002612398Z [2024-05-26 01:17:02,002: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:17:02.071473773Z [2024-05-26 01:17:02,071: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:17:02.086656117Z [2024-05-26 01:17:02,086: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:17:03.643588612Z [2024-05-26 01:17:03,642: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4fcb374-2a86-42d4-b62b-641ed98c52a7] succeeded in 3.256870749000882s: None 2024-05-26T01:17:03.994371959Z [2024-05-26 01:17:03,993: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[139c6215-13cc-4bd1-ac66-bdc1269a834b] succeeded in 3.5843887840001116s: None 2024-05-26T01:18:00.425467124Z [2024-05-26 01:18:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[171ae3c6-0ff6-47ed-afe3-415a1891e9ad] received 2024-05-26T01:18:00.430285336Z [2024-05-26 01:18:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[301a25c6-e18c-414f-815e-ec8b8adc68c8] received 2024-05-26T01:18:00.432417646Z [2024-05-26 01:18:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acebd79e-ddf8-44b0-9569-7b24367589f9] received 2024-05-26T01:18:00.434438856Z [2024-05-26 01:18:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e2617f6-0af8-4bcf-989e-10f47b936b92] received 2024-05-26T01:18:00.437929129Z [2024-05-26 01:18:00,437: INFO/ForkPoolWorker-15] [171ae3c6-0ff6-47ed-afe3-415a1891e9ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:18:00.449752583Z [2024-05-26 01:18:00,449: INFO/ForkPoolWorker-16] [301a25c6-e18c-414f-815e-ec8b8adc68c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:18:00.456621140Z [2024-05-26 01:18:00,456: INFO/ForkPoolWorker-1] [acebd79e-ddf8-44b0-9569-7b24367589f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:18:00.464985356Z [2024-05-26 01:18:00,464: INFO/ForkPoolWorker-2] [4e2617f6-0af8-4bcf-989e-10f47b936b92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:18:00.793367616Z [2024-05-26 01:18:00,789: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:18:00.856783843Z [2024-05-26 01:18:00,852: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:18:00.866471075Z [2024-05-26 01:18:00,862: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:18:00.946854557Z [2024-05-26 01:18:00,943: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:18:00.953938896Z [2024-05-26 01:18:00,953: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:18:00.958006105Z [2024-05-26 01:18:00,957: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:18:01.011766584Z [2024-05-26 01:18:01,008: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:18:01.013125186Z [2024-05-26 01:18:01,012: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:18:01.013256960Z [2024-05-26 01:18:01,013: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:18:01.013426128Z [2024-05-26 01:18:01,013: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:18:01.013747855Z [2024-05-26 01:18:01,013: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:18:01.152833070Z [2024-05-26 01:18:01,152: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:18:01.159382816Z [2024-05-26 01:18:01,159: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:18:01.744144276Z [2024-05-26 01:18:01,743: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[acebd79e-ddf8-44b0-9569-7b24367589f9] succeeded in 1.3065219620002608s: None 2024-05-26T01:18:01.791236899Z [2024-05-26 01:18:01,790: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[301a25c6-e18c-414f-815e-ec8b8adc68c8] succeeded in 1.3567584899992653s: None 2024-05-26T01:18:02.137944967Z [2024-05-26 01:18:02,137: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:18:02.141175130Z [2024-05-26 01:18:02,140: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:18:02.158433381Z [2024-05-26 01:18:02,158: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:18:02.160207359Z [2024-05-26 01:18:02,160: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:18:02.160392664Z [2024-05-26 01:18:02,160: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:18:02.160601115Z [2024-05-26 01:18:02,160: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:18:02.160745112Z [2024-05-26 01:18:02,160: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:18:02.161104700Z [2024-05-26 01:18:02,160: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:18:02.161317184Z [2024-05-26 01:18:02,161: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:18:02.204652072Z [2024-05-26 01:18:02,204: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:18:02.207810762Z [2024-05-26 01:18:02,207: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:18:02.226706083Z [2024-05-26 01:18:02,226: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:18:02.228195039Z [2024-05-26 01:18:02,228: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:18:02.228260007Z [2024-05-26 01:18:02,228: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:18:02.228415631Z [2024-05-26 01:18:02,228: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:18:02.228493187Z [2024-05-26 01:18:02,228: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:18:02.231574158Z [2024-05-26 01:18:02,231: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:18:02.231688292Z [2024-05-26 01:18:02,231: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:18:02.236737562Z [2024-05-26 01:18:02,236: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:18:02.303920232Z [2024-05-26 01:18:02,303: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:18:03.921353412Z [2024-05-26 01:18:03,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[171ae3c6-0ff6-47ed-afe3-415a1891e9ad] succeeded in 3.4911426329999813s: None 2024-05-26T01:18:04.106132638Z [2024-05-26 01:18:04,105: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4e2617f6-0af8-4bcf-989e-10f47b936b92] succeeded in 3.668776414999229s: None 2024-05-26T01:19:01.199779382Z [2024-05-26 01:19:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f61f927e-caa7-4ffc-97fe-907805d9b77d] received 2024-05-26T01:19:01.207199883Z [2024-05-26 01:19:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d95892b-24ba-4c1a-900c-089f56d80ba5] received 2024-05-26T01:19:01.207585051Z [2024-05-26 01:19:01,207: INFO/ForkPoolWorker-15] [f61f927e-caa7-4ffc-97fe-907805d9b77d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:19:01.212030944Z [2024-05-26 01:19:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f67f940-2bdf-422d-920a-beea6b35e218] received 2024-05-26T01:19:01.214533597Z [2024-05-26 01:19:01,214: INFO/ForkPoolWorker-16] [3d95892b-24ba-4c1a-900c-089f56d80ba5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:19:01.223666816Z [2024-05-26 01:19:01,223: INFO/ForkPoolWorker-1] [6f67f940-2bdf-422d-920a-beea6b35e218] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:19:01.542198875Z [2024-05-26 01:19:01,538: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:19:01.565857839Z [2024-05-26 01:19:01,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:19:01.636959217Z [2024-05-26 01:19:01,634: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:19:01.719285819Z [2024-05-26 01:19:01,718: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T01:19:01.723012680Z [2024-05-26 01:19:01,722: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:19:01.745164308Z [2024-05-26 01:19:01,744: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:19:01.748617092Z [2024-05-26 01:19:01,748: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:19:01.748739095Z [2024-05-26 01:19:01,748: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:19:01.748891603Z [2024-05-26 01:19:01,748: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T01:19:01.749113158Z [2024-05-26 01:19:01,748: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:19:01.845373742Z [2024-05-26 01:19:01,845: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:19:02.372319489Z [2024-05-26 01:19:02,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f61f927e-caa7-4ffc-97fe-907805d9b77d] succeeded in 1.1700214730008156s: None 2024-05-26T01:19:02.712324028Z [2024-05-26 01:19:02,711: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:19:02.715582764Z [2024-05-26 01:19:02,715: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:19:02.743398392Z [2024-05-26 01:19:02,743: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:19:02.746956101Z [2024-05-26 01:19:02,746: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:19:02.747698804Z [2024-05-26 01:19:02,747: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:19:02.747924509Z [2024-05-26 01:19:02,747: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:19:02.748223055Z [2024-05-26 01:19:02,747: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:19:02.748320842Z [2024-05-26 01:19:02,748: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:19:02.748464549Z [2024-05-26 01:19:02,748: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:19:02.834443829Z [2024-05-26 01:19:02,834: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:19:02.915311718Z [2024-05-26 01:19:02,914: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:19:02.918797608Z [2024-05-26 01:19:02,918: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:19:02.940184985Z [2024-05-26 01:19:02,939: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:19:02.941702543Z [2024-05-26 01:19:02,941: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:19:02.941724553Z [2024-05-26 01:19:02,941: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:19:02.941986483Z [2024-05-26 01:19:02,941: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:19:02.942153860Z [2024-05-26 01:19:02,941: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:19:02.942471748Z [2024-05-26 01:19:02,942: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:19:02.943038401Z [2024-05-26 01:19:02,942: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:19:03.024803980Z [2024-05-26 01:19:03,024: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:19:04.815400868Z [2024-05-26 01:19:04,814: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d95892b-24ba-4c1a-900c-089f56d80ba5] succeeded in 3.6062246929996036s: None 2024-05-26T01:19:06.002297400Z [2024-05-26 01:19:06,001: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f67f940-2bdf-422d-920a-beea6b35e218] succeeded in 4.7883133640007145s: None 2024-05-26T01:20:00.745986946Z [2024-05-26 01:20:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d67ac418-b2a1-4c91-aa03-98e8935e781b] received 2024-05-26T01:20:00.750005942Z [2024-05-26 01:20:00,748: INFO/ForkPoolWorker-15] [d67ac418-b2a1-4c91-aa03-98e8935e781b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:20:00.756164361Z [2024-05-26 01:20:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69170c5f-3d6a-46f4-9cce-3c5a3fe0f3af] received 2024-05-26T01:20:00.765418174Z [2024-05-26 01:20:00,763: INFO/ForkPoolWorker-16] [69170c5f-3d6a-46f4-9cce-3c5a3fe0f3af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:20:00.772705166Z [2024-05-26 01:20:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7035b2a-7744-434c-b4c9-b841e7146bea] received 2024-05-26T01:20:00.787986259Z [2024-05-26 01:20:00,787: INFO/ForkPoolWorker-1] [e7035b2a-7744-434c-b4c9-b841e7146bea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:20:00.792763387Z [2024-05-26 01:20:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[538b9826-22aa-4c33-9a1d-ea0e5fafc0e3] received 2024-05-26T01:20:00.802838025Z [2024-05-26 01:20:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e5f5fed-8de9-4a6f-92e6-f15e45ddad46] received 2024-05-26T01:20:00.803997442Z [2024-05-26 01:20:00,803: INFO/ForkPoolWorker-2] [538b9826-22aa-4c33-9a1d-ea0e5fafc0e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:20:00.826566925Z [2024-05-26 01:20:00,826: INFO/ForkPoolWorker-3] [2e5f5fed-8de9-4a6f-92e6-f15e45ddad46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:20:01.057659428Z [2024-05-26 01:20:01,051: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:20:01.128243800Z [2024-05-26 01:20:01,124: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:20:01.198175951Z [2024-05-26 01:20:01,194: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:20:01.244778335Z [2024-05-26 01:20:01,244: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T01:20:01.248843524Z [2024-05-26 01:20:01,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:20:01.324465389Z [2024-05-26 01:20:01,324: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:20:01.328593700Z [2024-05-26 01:20:01,328: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:20:01.328625784Z [2024-05-26 01:20:01,328: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:20:01.328643577Z [2024-05-26 01:20:01,328: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T01:20:01.328856268Z [2024-05-26 01:20:01,328: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:20:01.374820429Z [2024-05-26 01:20:01,374: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:20:01.404363872Z [2024-05-26 01:20:01,398: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:20:01.460436506Z [2024-05-26 01:20:01,454: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:20:01.503290743Z [2024-05-26 01:20:01,503: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:20:02.076624214Z [2024-05-26 01:20:02,076: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e7035b2a-7744-434c-b4c9-b841e7146bea] succeeded in 1.2964721110001847s: None 2024-05-26T01:20:02.234933411Z [2024-05-26 01:20:02,234: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d67ac418-b2a1-4c91-aa03-98e8935e781b] succeeded in 1.49271631999909s: None 2024-05-26T01:20:02.704166788Z [2024-05-26 01:20:02,702: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T01:20:02.708261637Z [2024-05-26 01:20:02,707: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:20:02.730849490Z [2024-05-26 01:20:02,730: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T01:20:02.732396702Z [2024-05-26 01:20:02,732: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:20:02.732533043Z [2024-05-26 01:20:02,732: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:20:02.732753529Z [2024-05-26 01:20:02,732: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:20:02.732879704Z [2024-05-26 01:20:02,732: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T01:20:02.733187145Z [2024-05-26 01:20:02,733: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:20:02.733318236Z [2024-05-26 01:20:02,733: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:20:02.754605732Z [2024-05-26 01:20:02,754: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:20:02.758090206Z [2024-05-26 01:20:02,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:20:02.800652091Z [2024-05-26 01:20:02,800: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:20:02.804375224Z [2024-05-26 01:20:02,804: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:20:02.804501713Z [2024-05-26 01:20:02,804: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:20:02.804672742Z [2024-05-26 01:20:02,804: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:20:02.804800369Z [2024-05-26 01:20:02,804: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:20:02.805152491Z [2024-05-26 01:20:02,804: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:20:02.805301139Z [2024-05-26 01:20:02,805: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:20:02.833096583Z [2024-05-26 01:20:02,832: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:20:02.904106779Z [2024-05-26 01:20:02,903: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:20:02.937322544Z [2024-05-26 01:20:02,936: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:20:02.941600879Z [2024-05-26 01:20:02,941: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:20:02.966215239Z [2024-05-26 01:20:02,965: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:20:02.968011048Z [2024-05-26 01:20:02,967: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:20:02.969974304Z [2024-05-26 01:20:02,969: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:20:02.970111881Z [2024-05-26 01:20:02,969: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:20:02.970195402Z [2024-05-26 01:20:02,970: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:20:02.970519163Z [2024-05-26 01:20:02,970: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:20:02.970527893Z [2024-05-26 01:20:02,970: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:20:03.056682124Z [2024-05-26 01:20:03,056: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:20:03.627360105Z [2024-05-26 01:20:03,627: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69170c5f-3d6a-46f4-9cce-3c5a3fe0f3af] succeeded in 2.873281236001276s: None 2024-05-26T01:20:04.044170488Z [2024-05-26 01:20:04,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a63e7b6-2c39-4de4-b300-781eac78ddc0] received 2024-05-26T01:20:04.077979033Z [2024-05-26 01:20:04,077: INFO/ForkPoolWorker-15] [7a63e7b6-2c39-4de4-b300-781eac78ddc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:20:04.277271124Z [2024-05-26 01:20:04,276: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2e5f5fed-8de9-4a6f-92e6-f15e45ddad46] succeeded in 3.4601723619998666s: None 2024-05-26T01:20:04.417725954Z [2024-05-26 01:20:04,414: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:20:04.977487457Z [2024-05-26 01:20:04,977: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[538b9826-22aa-4c33-9a1d-ea0e5fafc0e3] succeeded in 4.181770962999508s: None 2024-05-26T01:20:05.616124388Z [2024-05-26 01:20:05,615: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:20:05.619162303Z [2024-05-26 01:20:05,618: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:20:05.643910625Z [2024-05-26 01:20:05,643: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:20:05.645124308Z [2024-05-26 01:20:05,644: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:20:05.645207850Z [2024-05-26 01:20:05,645: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:20:05.645359614Z [2024-05-26 01:20:05,645: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:20:05.645436743Z [2024-05-26 01:20:05,645: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:20:05.645678260Z [2024-05-26 01:20:05,645: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:20:05.645775822Z [2024-05-26 01:20:05,645: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:20:05.727633685Z [2024-05-26 01:20:05,725: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:20:06.353228470Z [2024-05-26 01:20:06,352: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a63e7b6-2c39-4de4-b300-781eac78ddc0] succeeded in 2.3058728899995913s: None 2024-05-26T01:20:06.882991392Z [2024-05-26 01:20:06,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43283f12-c9fa-412e-b074-ac5803b14255] received 2024-05-26T01:20:06.888927338Z [2024-05-26 01:20:06,888: INFO/ForkPoolWorker-15] [43283f12-c9fa-412e-b074-ac5803b14255] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:20:07.212961938Z [2024-05-26 01:20:07,209: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:20:08.244633651Z [2024-05-26 01:20:08,244: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:20:08.247689023Z [2024-05-26 01:20:08,247: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:20:08.275136084Z [2024-05-26 01:20:08,274: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:20:08.276825156Z [2024-05-26 01:20:08,276: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:20:08.276923643Z [2024-05-26 01:20:08,276: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:20:08.277117697Z [2024-05-26 01:20:08,276: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:20:08.277253405Z [2024-05-26 01:20:08,277: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:20:08.277554928Z [2024-05-26 01:20:08,277: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:20:08.277653821Z [2024-05-26 01:20:08,277: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:20:08.387821689Z [2024-05-26 01:20:08,387: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:20:08.982763050Z [2024-05-26 01:20:08,980: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43283f12-c9fa-412e-b074-ac5803b14255] succeeded in 2.0966736629998195s: None 2024-05-26T01:20:09.563698326Z [2024-05-26 01:20:09,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5eb10bb2-ec80-48ab-9ffb-5870abe7e46b] received 2024-05-26T01:20:09.575225692Z [2024-05-26 01:20:09,574: INFO/ForkPoolWorker-15] [5eb10bb2-ec80-48ab-9ffb-5870abe7e46b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:20:09.854507913Z [2024-05-26 01:20:09,851: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:20:10.871697762Z [2024-05-26 01:20:10,871: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:20:10.875927898Z [2024-05-26 01:20:10,874: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:20:10.898257910Z [2024-05-26 01:20:10,898: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:20:10.899930762Z [2024-05-26 01:20:10,899: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:20:10.900174697Z [2024-05-26 01:20:10,899: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:20:10.900311398Z [2024-05-26 01:20:10,900: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:20:10.900334306Z [2024-05-26 01:20:10,900: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:20:10.900902236Z [2024-05-26 01:20:10,900: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:20:10.900925212Z [2024-05-26 01:20:10,900: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:20:11.002022144Z [2024-05-26 01:20:11,001: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:20:11.661288492Z [2024-05-26 01:20:11,660: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5eb10bb2-ec80-48ab-9ffb-5870abe7e46b] succeeded in 2.0949342860003526s: None 2024-05-26T01:21:01.248266741Z [2024-05-26 01:21:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b756e70a-5176-4cf7-92e2-38292f3de141] received 2024-05-26T01:21:01.257327395Z [2024-05-26 01:21:01,257: INFO/ForkPoolWorker-15] [b756e70a-5176-4cf7-92e2-38292f3de141] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:21:01.288702121Z [2024-05-26 01:21:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5cd8778-9c2c-4623-bfc5-6c47daaf73af] received 2024-05-26T01:21:01.304263073Z [2024-05-26 01:21:01,303: INFO/ForkPoolWorker-16] [e5cd8778-9c2c-4623-bfc5-6c47daaf73af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:21:01.312203506Z [2024-05-26 01:21:01,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28e86074-a32d-4a07-83c9-b03f7299e001] received 2024-05-26T01:21:01.328131910Z [2024-05-26 01:21:01,327: INFO/ForkPoolWorker-1] [28e86074-a32d-4a07-83c9-b03f7299e001] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:21:01.605420768Z [2024-05-26 01:21:01,602: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:21:01.628490919Z [2024-05-26 01:21:01,624: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:21:01.774610808Z [2024-05-26 01:21:01,774: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:21:01.777270586Z [2024-05-26 01:21:01,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:21:01.778446651Z [2024-05-26 01:21:01,778: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:21:01.812247649Z [2024-05-26 01:21:01,812: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:21:01.815940470Z [2024-05-26 01:21:01,815: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:21:01.815981492Z [2024-05-26 01:21:01,815: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:21:01.816054049Z [2024-05-26 01:21:01,815: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:21:01.816297676Z [2024-05-26 01:21:01,816: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:21:02.040139479Z [2024-05-26 01:21:02,039: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:21:02.809656531Z [2024-05-26 01:21:02,809: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5cd8778-9c2c-4623-bfc5-6c47daaf73af] succeeded in 1.5193450650003797s: None 2024-05-26T01:21:03.022334121Z [2024-05-26 01:21:03,022: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:21:03.025519843Z [2024-05-26 01:21:03,025: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:21:03.052643560Z [2024-05-26 01:21:03,052: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:21:03.053868333Z [2024-05-26 01:21:03,053: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:21:03.054257378Z [2024-05-26 01:21:03,053: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:21:03.054298603Z [2024-05-26 01:21:03,053: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:21:03.054309349Z [2024-05-26 01:21:03,054: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:21:03.054544678Z [2024-05-26 01:21:03,054: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:21:03.054701655Z [2024-05-26 01:21:03,054: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:21:03.135961840Z [2024-05-26 01:21:03,135: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:21:03.251946917Z [2024-05-26 01:21:03,251: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:21:03.259040722Z [2024-05-26 01:21:03,258: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:21:03.288784932Z [2024-05-26 01:21:03,288: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:21:03.292311967Z [2024-05-26 01:21:03,292: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:21:03.292493646Z [2024-05-26 01:21:03,292: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:21:03.292722188Z [2024-05-26 01:21:03,292: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:21:03.292880577Z [2024-05-26 01:21:03,292: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:21:03.293218699Z [2024-05-26 01:21:03,293: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:21:03.293428341Z [2024-05-26 01:21:03,293: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:21:03.384124768Z [2024-05-26 01:21:03,383: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:21:05.286014377Z [2024-05-26 01:21:05,285: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[28e86074-a32d-4a07-83c9-b03f7299e001] succeeded in 3.9688339170006657s: None 2024-05-26T01:21:05.557961656Z [2024-05-26 01:21:05,557: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b756e70a-5176-4cf7-92e2-38292f3de141] succeeded in 4.306197472998974s: None 2024-05-26T01:22:01.304539219Z [2024-05-26 01:22:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc26f443-af18-4f92-8b50-f693541f679f] received 2024-05-26T01:22:01.306232870Z [2024-05-26 01:22:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3e0ee1b-a5dc-4e93-9e33-e6cf468e70e9] received 2024-05-26T01:22:01.307893274Z [2024-05-26 01:22:01,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbd325fc-ce12-4f43-b780-d3f3a268367c] received 2024-05-26T01:22:01.313155119Z [2024-05-26 01:22:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db787ad7-fc13-4d83-a930-8da691a42148] received 2024-05-26T01:22:01.325609406Z [2024-05-26 01:22:01,325: INFO/ForkPoolWorker-15] [fc26f443-af18-4f92-8b50-f693541f679f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:22:01.333692605Z [2024-05-26 01:22:01,333: INFO/ForkPoolWorker-16] [d3e0ee1b-a5dc-4e93-9e33-e6cf468e70e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:22:01.334465797Z [2024-05-26 01:22:01,334: INFO/ForkPoolWorker-1] [dbd325fc-ce12-4f43-b780-d3f3a268367c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:22:01.345097781Z [2024-05-26 01:22:01,344: INFO/ForkPoolWorker-2] [db787ad7-fc13-4d83-a930-8da691a42148] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:22:01.781968348Z [2024-05-26 01:22:01,778: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:22:01.805201640Z [2024-05-26 01:22:01,802: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:22:01.813058161Z [2024-05-26 01:22:01,799: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:22:01.925831485Z [2024-05-26 01:22:01,918: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:22:02.178119504Z [2024-05-26 01:22:02,177: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:22:02.195577447Z [2024-05-26 01:22:02,195: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:22:02.228258603Z [2024-05-26 01:22:02,228: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:22:02.241555023Z [2024-05-26 01:22:02,241: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:22:02.247375421Z [2024-05-26 01:22:02,247: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:22:02.247854324Z [2024-05-26 01:22:02,247: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:22:02.248079766Z [2024-05-26 01:22:02,247: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:22:02.248456613Z [2024-05-26 01:22:02,248: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:22:02.394447320Z [2024-05-26 01:22:02,394: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:22:03.025152843Z [2024-05-26 01:22:03,024: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc26f443-af18-4f92-8b50-f693541f679f] succeeded in 1.718188001001181s: None 2024-05-26T01:22:03.111765467Z [2024-05-26 01:22:03,111: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[db787ad7-fc13-4d83-a930-8da691a42148] succeeded in 1.7926259440009744s: None 2024-05-26T01:22:03.417942906Z [2024-05-26 01:22:03,416: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:22:03.423662225Z [2024-05-26 01:22:03,420: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:22:03.459675372Z [2024-05-26 01:22:03,452: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:22:03.459698669Z [2024-05-26 01:22:03,455: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:22:03.459702398Z [2024-05-26 01:22:03,455: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:22:03.459706275Z [2024-05-26 01:22:03,455: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:22:03.459710225Z [2024-05-26 01:22:03,455: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:22:03.459717470Z [2024-05-26 01:22:03,455: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:22:03.459720680Z [2024-05-26 01:22:03,455: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:22:03.530775059Z [2024-05-26 01:22:03,530: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:22:03.534126161Z [2024-05-26 01:22:03,533: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:22:03.597942779Z [2024-05-26 01:22:03,597: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:22:03.605161765Z [2024-05-26 01:22:03,604: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:22:03.610855655Z [2024-05-26 01:22:03,610: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:22:03.611202831Z [2024-05-26 01:22:03,610: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:22:03.611418792Z [2024-05-26 01:22:03,611: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:22:03.611603413Z [2024-05-26 01:22:03,611: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:22:03.611921049Z [2024-05-26 01:22:03,611: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:22:03.612068009Z [2024-05-26 01:22:03,611: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:22:03.739722985Z [2024-05-26 01:22:03,739: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:22:05.312595846Z [2024-05-26 01:22:05,312: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dbd325fc-ce12-4f43-b780-d3f3a268367c] succeeded in 4.001061244998709s: None 2024-05-26T01:22:06.100563829Z [2024-05-26 01:22:06,100: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d3e0ee1b-a5dc-4e93-9e33-e6cf468e70e9] succeeded in 4.792736198000057s: None 2024-05-26T01:23:00.893263023Z [2024-05-26 01:23:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5115bf9-bc3d-43fd-a0da-37fb3bc249a0] received 2024-05-26T01:23:00.907340278Z [2024-05-26 01:23:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a847a7d-b55a-4baf-a480-2b7e27acbec8] received 2024-05-26T01:23:00.910663101Z [2024-05-26 01:23:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c16734d6-eeb3-41a0-a4ea-b1869743a347] received 2024-05-26T01:23:00.915303034Z [2024-05-26 01:23:00,914: INFO/ForkPoolWorker-15] [c5115bf9-bc3d-43fd-a0da-37fb3bc249a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:23:00.922603873Z [2024-05-26 01:23:00,922: INFO/ForkPoolWorker-16] [4a847a7d-b55a-4baf-a480-2b7e27acbec8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:23:00.928576208Z [2024-05-26 01:23:00,928: INFO/ForkPoolWorker-1] [c16734d6-eeb3-41a0-a4ea-b1869743a347] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:23:01.256519931Z [2024-05-26 01:23:01,252: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:23:01.313723594Z [2024-05-26 01:23:01,310: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:23:01.364025845Z [2024-05-26 01:23:01,360: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:23:01.409645250Z [2024-05-26 01:23:01,409: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T01:23:01.413327437Z [2024-05-26 01:23:01,412: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:23:01.437638364Z [2024-05-26 01:23:01,437: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:23:01.438791636Z [2024-05-26 01:23:01,438: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:23:01.438848988Z [2024-05-26 01:23:01,438: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:23:01.438906199Z [2024-05-26 01:23:01,438: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T01:23:01.439196566Z [2024-05-26 01:23:01,439: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:23:01.526085474Z [2024-05-26 01:23:01,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:23:02.173481366Z [2024-05-26 01:23:02,172: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5115bf9-bc3d-43fd-a0da-37fb3bc249a0] succeeded in 1.276667679001548s: None 2024-05-26T01:23:02.567187656Z [2024-05-26 01:23:02,566: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:23:02.570263291Z [2024-05-26 01:23:02,569: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:23:02.608511573Z [2024-05-26 01:23:02,608: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:23:02.609722867Z [2024-05-26 01:23:02,609: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:23:02.609815672Z [2024-05-26 01:23:02,609: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:23:02.609967900Z [2024-05-26 01:23:02,609: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:23:02.610118584Z [2024-05-26 01:23:02,610: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:23:02.610469528Z [2024-05-26 01:23:02,610: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:23:02.610602978Z [2024-05-26 01:23:02,610: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:23:02.676333444Z [2024-05-26 01:23:02,675: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:23:02.679748931Z [2024-05-26 01:23:02,679: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:23:02.700478901Z [2024-05-26 01:23:02,700: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:23:02.701732971Z [2024-05-26 01:23:02,701: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:23:02.702975097Z [2024-05-26 01:23:02,702: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:23:02.702990215Z [2024-05-26 01:23:02,702: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:23:02.703181733Z [2024-05-26 01:23:02,702: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:23:02.703257902Z [2024-05-26 01:23:02,703: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:23:02.703691348Z [2024-05-26 01:23:02,703: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:23:02.703768513Z [2024-05-26 01:23:02,703: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:23:02.770983451Z [2024-05-26 01:23:02,770: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:23:04.554678722Z [2024-05-26 01:23:04,554: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c16734d6-eeb3-41a0-a4ea-b1869743a347] succeeded in 3.63964490699982s: None 2024-05-26T01:23:05.469375521Z [2024-05-26 01:23:05,469: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a847a7d-b55a-4baf-a480-2b7e27acbec8] succeeded in 4.559633126000335s: None 2024-05-26T01:24:00.342668018Z [2024-05-26 01:24:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35129c7f-5867-4b9f-9cf5-e44bd9f4e585] received 2024-05-26T01:24:00.346564910Z [2024-05-26 01:24:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53a43d7c-895b-4328-8205-b294008d927c] received 2024-05-26T01:24:00.351110489Z [2024-05-26 01:24:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cacd2d9-bb1f-45cb-ad5c-1319eb33eba9] received 2024-05-26T01:24:00.353816097Z [2024-05-26 01:24:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bab44417-cb72-48ec-a666-b32623a84ae0] received 2024-05-26T01:24:00.359997761Z [2024-05-26 01:24:00,359: INFO/ForkPoolWorker-15] [35129c7f-5867-4b9f-9cf5-e44bd9f4e585] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:24:00.366954210Z [2024-05-26 01:24:00,365: INFO/ForkPoolWorker-1] [0cacd2d9-bb1f-45cb-ad5c-1319eb33eba9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:24:00.374550701Z [2024-05-26 01:24:00,371: INFO/ForkPoolWorker-16] [53a43d7c-895b-4328-8205-b294008d927c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:24:00.378490889Z [2024-05-26 01:24:00,378: INFO/ForkPoolWorker-2] [bab44417-cb72-48ec-a666-b32623a84ae0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:24:00.679475122Z [2024-05-26 01:24:00,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:24:00.698131861Z [2024-05-26 01:24:00,695: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:24:00.755888184Z [2024-05-26 01:24:00,747: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:24:00.854554873Z [2024-05-26 01:24:00,850: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:24:01.016593356Z [2024-05-26 01:24:01,016: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:24:01.020693819Z [2024-05-26 01:24:01,020: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:24:01.058803643Z [2024-05-26 01:24:01,058: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:24:01.059873734Z [2024-05-26 01:24:01,059: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:24:01.064518214Z [2024-05-26 01:24:01,064: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:24:01.064602083Z [2024-05-26 01:24:01,064: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:24:01.064659760Z [2024-05-26 01:24:01,064: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:24:01.064895109Z [2024-05-26 01:24:01,064: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:24:01.177197069Z [2024-05-26 01:24:01,176: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:24:01.656016732Z [2024-05-26 01:24:01,655: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35129c7f-5867-4b9f-9cf5-e44bd9f4e585] succeeded in 1.3110894830006146s: None 2024-05-26T01:24:01.795766442Z [2024-05-26 01:24:01,795: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bab44417-cb72-48ec-a666-b32623a84ae0] succeeded in 1.4393827349995263s: None 2024-05-26T01:24:01.990536638Z [2024-05-26 01:24:01,990: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:24:01.993938610Z [2024-05-26 01:24:01,993: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:24:02.018202740Z [2024-05-26 01:24:02,018: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:24:02.019360591Z [2024-05-26 01:24:02,019: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:24:02.019486381Z [2024-05-26 01:24:02,019: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:24:02.019698828Z [2024-05-26 01:24:02,019: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:24:02.019783870Z [2024-05-26 01:24:02,019: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:24:02.020012442Z [2024-05-26 01:24:02,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:24:02.020154896Z [2024-05-26 01:24:02,020: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:24:02.064796593Z [2024-05-26 01:24:02,064: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:24:02.068249190Z [2024-05-26 01:24:02,067: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:24:02.090556480Z [2024-05-26 01:24:02,090: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:24:02.091790688Z [2024-05-26 01:24:02,091: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:24:02.091902493Z [2024-05-26 01:24:02,091: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:24:02.092108101Z [2024-05-26 01:24:02,091: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:24:02.092222321Z [2024-05-26 01:24:02,092: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:24:02.092955624Z [2024-05-26 01:24:02,092: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:24:02.093067821Z [2024-05-26 01:24:02,092: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:24:02.104809897Z [2024-05-26 01:24:02,104: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:24:02.226887787Z [2024-05-26 01:24:02,226: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:24:03.760684891Z [2024-05-26 01:24:03,760: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0cacd2d9-bb1f-45cb-ad5c-1319eb33eba9] succeeded in 3.4071041790011805s: None 2024-05-26T01:24:03.886964165Z [2024-05-26 01:24:03,886: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53a43d7c-895b-4328-8205-b294008d927c] succeeded in 3.5374753209998744s: None 2024-05-26T01:25:00.569215931Z [2024-05-26 01:25:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe6a7e5c-91df-491b-887a-b6d90c92c6b9] received 2024-05-26T01:25:00.573356485Z [2024-05-26 01:25:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9a216b8-374b-4430-8947-b7fcfbc37046] received 2024-05-26T01:25:00.581103187Z [2024-05-26 01:25:00,580: INFO/ForkPoolWorker-16] [e9a216b8-374b-4430-8947-b7fcfbc37046] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:25:00.582638057Z [2024-05-26 01:25:00,582: INFO/ForkPoolWorker-15] [fe6a7e5c-91df-491b-887a-b6d90c92c6b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:25:00.588611436Z [2024-05-26 01:25:00,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8ccf0bd-ae2c-407f-a2e6-12046d3e607b] received 2024-05-26T01:25:00.593196129Z [2024-05-26 01:25:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e7ad945-c205-4edd-b753-d880f5279c1c] received 2024-05-26T01:25:00.602006389Z [2024-05-26 01:25:00,601: INFO/ForkPoolWorker-2] [9e7ad945-c205-4edd-b753-d880f5279c1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:25:00.602706677Z [2024-05-26 01:25:00,602: INFO/ForkPoolWorker-1] [c8ccf0bd-ae2c-407f-a2e6-12046d3e607b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:25:00.902313206Z [2024-05-26 01:25:00,899: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:25:00.994500963Z [2024-05-26 01:25:00,990: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:25:00.995876952Z [2024-05-26 01:25:00,991: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:25:01.059783574Z [2024-05-26 01:25:01,056: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:25:01.215800961Z [2024-05-26 01:25:01,215: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:25:01.219870591Z [2024-05-26 01:25:01,219: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:25:01.245200121Z [2024-05-26 01:25:01,245: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:25:01.246360673Z [2024-05-26 01:25:01,246: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:25:01.246445695Z [2024-05-26 01:25:01,246: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:25:01.246490876Z [2024-05-26 01:25:01,246: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:25:01.246686280Z [2024-05-26 01:25:01,246: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:25:01.402884662Z [2024-05-26 01:25:01,402: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:25:01.928605958Z [2024-05-26 01:25:01,928: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9e7ad945-c205-4edd-b753-d880f5279c1c] succeeded in 1.3329372810003406s: None 2024-05-26T01:25:02.024264464Z [2024-05-26 01:25:02,023: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:25:02.032270379Z [2024-05-26 01:25:02,031: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:25:02.054409357Z [2024-05-26 01:25:02,054: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:25:02.055784637Z [2024-05-26 01:25:02,055: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:25:02.055950413Z [2024-05-26 01:25:02,055: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:25:02.056358145Z [2024-05-26 01:25:02,056: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:25:02.056522535Z [2024-05-26 01:25:02,056: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:25:02.056926342Z [2024-05-26 01:25:02,056: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:25:02.057079342Z [2024-05-26 01:25:02,056: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:25:02.132952437Z [2024-05-26 01:25:02,132: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:25:02.238998492Z [2024-05-26 01:25:02,238: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:25:02.242203666Z [2024-05-26 01:25:02,241: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:25:02.258976780Z [2024-05-26 01:25:02,258: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:25:02.260032702Z [2024-05-26 01:25:02,259: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:25:02.260078006Z [2024-05-26 01:25:02,259: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:25:02.260161564Z [2024-05-26 01:25:02,260: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:25:02.260175848Z [2024-05-26 01:25:02,260: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:25:02.260376737Z [2024-05-26 01:25:02,260: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:25:02.260397729Z [2024-05-26 01:25:02,260: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:25:02.301476215Z [2024-05-26 01:25:02,301: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:25:02.305438484Z [2024-05-26 01:25:02,304: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:25:02.339253398Z [2024-05-26 01:25:02,339: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:25:02.340787918Z [2024-05-26 01:25:02,340: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:25:02.340918734Z [2024-05-26 01:25:02,340: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:25:02.341286285Z [2024-05-26 01:25:02,341: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:25:02.341731977Z [2024-05-26 01:25:02,341: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:25:02.342311475Z [2024-05-26 01:25:02,342: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:25:02.342484291Z [2024-05-26 01:25:02,342: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:25:02.350474750Z [2024-05-26 01:25:02,350: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:25:02.439135859Z [2024-05-26 01:25:02,438: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:25:02.940425312Z [2024-05-26 01:25:02,939: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe6a7e5c-91df-491b-887a-b6d90c92c6b9] succeeded in 2.3675234989987075s: None 2024-05-26T01:25:03.341092479Z [2024-05-26 01:25:03,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64577032-93c8-4e1c-88c4-7d21dde5829f] received 2024-05-26T01:25:03.350684042Z [2024-05-26 01:25:03,350: INFO/ForkPoolWorker-15] [64577032-93c8-4e1c-88c4-7d21dde5829f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:25:03.624678514Z [2024-05-26 01:25:03,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:25:03.960994838Z [2024-05-26 01:25:03,960: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c8ccf0bd-ae2c-407f-a2e6-12046d3e607b] succeeded in 3.370167188000778s: None 2024-05-26T01:25:04.056303376Z [2024-05-26 01:25:04,055: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9a216b8-374b-4430-8947-b7fcfbc37046] succeeded in 3.481576755999413s: None 2024-05-26T01:25:05.083740467Z [2024-05-26 01:25:05,083: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:25:05.086689484Z [2024-05-26 01:25:05,086: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:25:05.103853568Z [2024-05-26 01:25:05,103: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:25:05.104963073Z [2024-05-26 01:25:05,104: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:25:05.104978982Z [2024-05-26 01:25:05,104: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:25:05.105091831Z [2024-05-26 01:25:05,104: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:25:05.105117065Z [2024-05-26 01:25:05,105: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:25:05.105310496Z [2024-05-26 01:25:05,105: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:25:05.105333324Z [2024-05-26 01:25:05,105: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:25:05.189588072Z [2024-05-26 01:25:05,189: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:25:05.848774618Z [2024-05-26 01:25:05,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9727a10-3b1a-42c0-b805-d9acd7a9438f] received 2024-05-26T01:25:05.865903803Z [2024-05-26 01:25:05,865: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64577032-93c8-4e1c-88c4-7d21dde5829f] succeeded in 2.5213738860002195s: None 2024-05-26T01:25:05.868688345Z [2024-05-26 01:25:05,866: INFO/ForkPoolWorker-16] [a9727a10-3b1a-42c0-b805-d9acd7a9438f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:25:06.174206704Z [2024-05-26 01:25:06,171: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:25:07.247746686Z [2024-05-26 01:25:07,247: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:25:07.250756706Z [2024-05-26 01:25:07,250: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:25:07.273691819Z [2024-05-26 01:25:07,273: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:25:07.274951318Z [2024-05-26 01:25:07,274: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:25:07.274967768Z [2024-05-26 01:25:07,274: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:25:07.275107223Z [2024-05-26 01:25:07,274: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:25:07.275116100Z [2024-05-26 01:25:07,275: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:25:07.275373349Z [2024-05-26 01:25:07,275: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:25:07.275380169Z [2024-05-26 01:25:07,275: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:25:07.378271711Z [2024-05-26 01:25:07,377: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:25:07.992453063Z [2024-05-26 01:25:07,992: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9727a10-3b1a-42c0-b805-d9acd7a9438f] succeeded in 2.136929574999158s: None 2024-05-26T01:25:08.206343291Z [2024-05-26 01:25:08,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85c62ef9-2159-4a6b-a0be-7cf291d8c6fa] received 2024-05-26T01:25:08.213207879Z [2024-05-26 01:25:08,212: INFO/ForkPoolWorker-15] [85c62ef9-2159-4a6b-a0be-7cf291d8c6fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:25:08.494921613Z [2024-05-26 01:25:08,478: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:25:09.546407956Z [2024-05-26 01:25:09,545: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:25:09.549593197Z [2024-05-26 01:25:09,549: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:25:09.571684659Z [2024-05-26 01:25:09,571: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:25:09.573265752Z [2024-05-26 01:25:09,572: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:25:09.573301003Z [2024-05-26 01:25:09,573: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:25:09.573544219Z [2024-05-26 01:25:09,573: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:25:09.573717621Z [2024-05-26 01:25:09,573: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:25:09.574666199Z [2024-05-26 01:25:09,574: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:25:09.574724601Z [2024-05-26 01:25:09,574: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:25:09.677765433Z [2024-05-26 01:25:09,675: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:25:10.290538132Z [2024-05-26 01:25:10,290: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85c62ef9-2159-4a6b-a0be-7cf291d8c6fa] succeeded in 2.0810680630002025s: None 2024-05-26T01:26:00.554124833Z [2024-05-26 01:26:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7be35211-ac4f-4aa0-869c-a5fc4f1aebd1] received 2024-05-26T01:26:00.559283200Z [2024-05-26 01:26:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0bcc495-c38c-421a-81ef-da624cc5d84f] received 2024-05-26T01:26:00.563638456Z [2024-05-26 01:26:00,563: INFO/ForkPoolWorker-15] [7be35211-ac4f-4aa0-869c-a5fc4f1aebd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:26:00.567772725Z [2024-05-26 01:26:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[562367da-7322-4087-9451-89f481c178dd] received 2024-05-26T01:26:00.571441851Z [2024-05-26 01:26:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbc0c030-de3c-4c14-b7e5-6b88223c2189] received 2024-05-26T01:26:00.573169804Z [2024-05-26 01:26:00,572: INFO/ForkPoolWorker-16] [b0bcc495-c38c-421a-81ef-da624cc5d84f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:26:00.582407097Z [2024-05-26 01:26:00,582: INFO/ForkPoolWorker-1] [562367da-7322-4087-9451-89f481c178dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:26:00.582939141Z [2024-05-26 01:26:00,582: INFO/ForkPoolWorker-2] [fbc0c030-de3c-4c14-b7e5-6b88223c2189] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:26:00.892953472Z [2024-05-26 01:26:00,890: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:26:00.934886977Z [2024-05-26 01:26:00,929: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:26:01.048862761Z [2024-05-26 01:26:01,045: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:26:01.075699264Z [2024-05-26 01:26:01,072: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:26:01.132858252Z [2024-05-26 01:26:01,132: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:26:01.229227381Z [2024-05-26 01:26:01,228: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:26:01.235433086Z [2024-05-26 01:26:01,234: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:26:01.292875951Z [2024-05-26 01:26:01,292: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:26:01.294015324Z [2024-05-26 01:26:01,293: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:26:01.294138842Z [2024-05-26 01:26:01,293: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:26:01.294157861Z [2024-05-26 01:26:01,293: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:26:01.294253136Z [2024-05-26 01:26:01,294: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:26:01.446100081Z [2024-05-26 01:26:01,445: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:26:01.801530195Z [2024-05-26 01:26:01,801: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7be35211-ac4f-4aa0-869c-a5fc4f1aebd1] succeeded in 1.2450227240005916s: None 2024-05-26T01:26:02.006102443Z [2024-05-26 01:26:02,005: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fbc0c030-de3c-4c14-b7e5-6b88223c2189] succeeded in 1.4326030439988244s: None 2024-05-26T01:26:02.253160130Z [2024-05-26 01:26:02,252: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:26:02.256506664Z [2024-05-26 01:26:02,256: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:26:02.277829830Z [2024-05-26 01:26:02,277: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:26:02.280432535Z [2024-05-26 01:26:02,280: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:26:02.280497617Z [2024-05-26 01:26:02,280: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:26:02.280681742Z [2024-05-26 01:26:02,280: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:26:02.280796026Z [2024-05-26 01:26:02,280: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:26:02.281232396Z [2024-05-26 01:26:02,281: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:26:02.281332922Z [2024-05-26 01:26:02,281: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:26:02.292390222Z [2024-05-26 01:26:02,292: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:26:02.296252683Z [2024-05-26 01:26:02,295: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:26:02.327075095Z [2024-05-26 01:26:02,326: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:26:02.328940116Z [2024-05-26 01:26:02,328: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:26:02.329325671Z [2024-05-26 01:26:02,329: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:26:02.329723937Z [2024-05-26 01:26:02,329: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:26:02.330024454Z [2024-05-26 01:26:02,329: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:26:02.330716733Z [2024-05-26 01:26:02,330: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:26:02.331002969Z [2024-05-26 01:26:02,330: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:26:02.358031741Z [2024-05-26 01:26:02,357: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:26:02.420847221Z [2024-05-26 01:26:02,420: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:26:04.033061161Z [2024-05-26 01:26:04,032: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[562367da-7322-4087-9451-89f481c178dd] succeeded in 3.462127752000015s: None 2024-05-26T01:26:04.684470628Z [2024-05-26 01:26:04,684: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0bcc495-c38c-421a-81ef-da624cc5d84f] succeeded in 4.120803570000135s: None 2024-05-26T01:26:09.420277531Z [2024-05-26 01:26:09,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d88acbe-ef48-4ec7-b681-b2657b7662a8] received 2024-05-26T01:26:09.428836457Z [2024-05-26 01:26:09,428: INFO/ForkPoolWorker-15] [7d88acbe-ef48-4ec7-b681-b2657b7662a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240526012607_907234', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-26T01:26:09.687756381Z [2024-05-26 01:26:09,684: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-05-26T01:26:09.985181708Z [2024-05-26 01:26:09,984: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:26:10.636576795Z [2024-05-26 01:26:10,635: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d88acbe-ef48-4ec7-b681-b2657b7662a8] succeeded in 1.2143377239990514s: None 2024-05-26T01:27:00.390469076Z [2024-05-26 01:27:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94304e19-5904-4aff-8650-bc1cc15ef0fb] received 2024-05-26T01:27:00.401451808Z [2024-05-26 01:27:00,400: INFO/ForkPoolWorker-15] [94304e19-5904-4aff-8650-bc1cc15ef0fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:27:00.412240359Z [2024-05-26 01:27:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[032d0875-8b36-4d28-908f-e4f1b43240db] received 2024-05-26T01:27:00.420373861Z [2024-05-26 01:27:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7337d333-616b-4a16-a543-dc1701a3f092] received 2024-05-26T01:27:00.425460749Z [2024-05-26 01:27:00,425: INFO/ForkPoolWorker-16] [032d0875-8b36-4d28-908f-e4f1b43240db] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:27:00.434405252Z [2024-05-26 01:27:00,434: INFO/ForkPoolWorker-1] [7337d333-616b-4a16-a543-dc1701a3f092] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:27:00.714958085Z [2024-05-26 01:27:00,711: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:27:00.738485510Z [2024-05-26 01:27:00,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:27:00.767443164Z [2024-05-26 01:27:00,762: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:27:00.891284380Z [2024-05-26 01:27:00,890: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:27:00.895097970Z [2024-05-26 01:27:00,894: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:27:00.923999425Z [2024-05-26 01:27:00,923: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:27:00.925651307Z [2024-05-26 01:27:00,925: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:27:00.925937660Z [2024-05-26 01:27:00,925: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:27:00.926193507Z [2024-05-26 01:27:00,925: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:27:00.926810030Z [2024-05-26 01:27:00,926: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:27:01.053288058Z [2024-05-26 01:27:01,053: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:27:01.687759179Z [2024-05-26 01:27:01,687: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[032d0875-8b36-4d28-908f-e4f1b43240db] succeeded in 1.2737045300000318s: None 2024-05-26T01:27:01.917888260Z [2024-05-26 01:27:01,917: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:27:01.921005656Z [2024-05-26 01:27:01,920: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:27:01.950223917Z [2024-05-26 01:27:01,950: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:27:01.951485506Z [2024-05-26 01:27:01,951: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:27:01.951677008Z [2024-05-26 01:27:01,951: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:27:01.951868054Z [2024-05-26 01:27:01,951: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:27:01.951938945Z [2024-05-26 01:27:01,951: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:27:01.952294819Z [2024-05-26 01:27:01,952: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:27:01.954129483Z [2024-05-26 01:27:01,953: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:27:02.055042192Z [2024-05-26 01:27:02,054: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:27:02.115323150Z [2024-05-26 01:27:02,114: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:27:02.118475113Z [2024-05-26 01:27:02,117: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:27:02.137911618Z [2024-05-26 01:27:02,137: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:27:02.139831530Z [2024-05-26 01:27:02,139: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:27:02.139847520Z [2024-05-26 01:27:02,139: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:27:02.139997124Z [2024-05-26 01:27:02,139: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:27:02.140008277Z [2024-05-26 01:27:02,139: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:27:02.140246178Z [2024-05-26 01:27:02,140: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:27:02.140257217Z [2024-05-26 01:27:02,140: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:27:02.236369098Z [2024-05-26 01:27:02,236: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:27:03.547207202Z [2024-05-26 01:27:03,546: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94304e19-5904-4aff-8650-bc1cc15ef0fb] succeeded in 3.155183925999154s: None 2024-05-26T01:27:03.989400630Z [2024-05-26 01:27:03,989: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7337d333-616b-4a16-a543-dc1701a3f092] succeeded in 3.5666335059995617s: None 2024-05-26T01:27:54.028512120Z [2024-05-26 01:27:54,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[690b5999-212e-4397-99c9-d44a6c10fee9] received 2024-05-26T01:27:54.056294347Z [2024-05-26 01:27:54,056: INFO/ForkPoolWorker-15] [690b5999-212e-4397-99c9-d44a6c10fee9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:27:54.181203704Z [2024-05-26 01:27:54,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca2b8a77-11aa-4b3d-b6c4-f7cff4e31ca1] received 2024-05-26T01:27:54.208228533Z [2024-05-26 01:27:54,207: INFO/ForkPoolWorker-16] [ca2b8a77-11aa-4b3d-b6c4-f7cff4e31ca1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:27:54.370977714Z [2024-05-26 01:27:54,368: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:27:54.612928960Z [2024-05-26 01:27:54,609: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:27:55.439291882Z [2024-05-26 01:27:55,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7bf8308-68ab-41d7-aec4-79ef3bfded62] received 2024-05-26T01:27:55.489306003Z [2024-05-26 01:27:55,489: INFO/ForkPoolWorker-1] [a7bf8308-68ab-41d7-aec4-79ef3bfded62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:27:55.505080151Z [2024-05-26 01:27:55,504: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:27:55.514643842Z [2024-05-26 01:27:55,514: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:27:55.544168246Z [2024-05-26 01:27:55,544: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:27:55.545407001Z [2024-05-26 01:27:55,545: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:27:55.545481075Z [2024-05-26 01:27:55,545: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:27:55.545554635Z [2024-05-26 01:27:55,545: INFO/ForkPoolWorker-15] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:27:55.545717019Z [2024-05-26 01:27:55,545: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:27:55.545782512Z [2024-05-26 01:27:55,545: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:27:55.546559579Z [2024-05-26 01:27:55,546: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:27:55.546618514Z [2024-05-26 01:27:55,546: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:27:55.551943468Z [2024-05-26 01:27:55,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:27:55.643995744Z [2024-05-26 01:27:55,643: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:27:55.765964107Z [2024-05-26 01:27:55,765: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:27:55.769362120Z [2024-05-26 01:27:55,768: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:27:55.799586508Z [2024-05-26 01:27:55,799: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:27:55.801669212Z [2024-05-26 01:27:55,801: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:27:55.801746251Z [2024-05-26 01:27:55,801: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:27:55.801832772Z [2024-05-26 01:27:55,801: INFO/ForkPoolWorker-16] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:27:55.802075036Z [2024-05-26 01:27:55,801: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:27:55.802128782Z [2024-05-26 01:27:55,802: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:27:55.802592987Z [2024-05-26 01:27:55,802: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:27:55.802765891Z [2024-05-26 01:27:55,802: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:27:55.811131985Z [2024-05-26 01:27:55,810: INFO/ForkPoolWorker-16] Creating DAG vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:27:55.903584604Z [2024-05-26 01:27:55,903: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:27:55.906976209Z [2024-05-26 01:27:55,903: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:27:56.193641121Z [2024-05-26 01:27:56,193: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[690b5999-212e-4397-99c9-d44a6c10fee9] succeeded in 2.1600077109997073s: None 2024-05-26T01:27:56.491589825Z [2024-05-26 01:27:56,491: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d347fef-3e8d-4ce5-90e0-bb464deab188] received 2024-05-26T01:27:56.499965183Z [2024-05-26 01:27:56,499: INFO/ForkPoolWorker-15] [3d347fef-3e8d-4ce5-90e0-bb464deab188] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'split_metrics', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:27:56.783975339Z [2024-05-26 01:27:56,770: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:27:57.015355548Z [2024-05-26 01:27:57,014: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:27:57.017638779Z [2024-05-26 01:27:57,017: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:27:57.054833331Z [2024-05-26 01:27:57,054: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:27:57.057311434Z [2024-05-26 01:27:57,056: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:27:57.057348169Z [2024-05-26 01:27:57,056: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:27:57.057352302Z [2024-05-26 01:27:57,056: INFO/ForkPoolWorker-1] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:27:57.057365707Z [2024-05-26 01:27:57,056: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:27:57.057369160Z [2024-05-26 01:27:57,056: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:27:57.057372130Z [2024-05-26 01:27:57,056: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:27:57.057375307Z [2024-05-26 01:27:57,056: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:27:57.066411277Z [2024-05-26 01:27:57,066: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:27:57.191243957Z [2024-05-26 01:27:57,190: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:27:57.275490026Z [2024-05-26 01:27:57,275: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca2b8a77-11aa-4b3d-b6c4-f7cff4e31ca1] succeeded in 3.0908050799989724s: None 2024-05-26T01:27:57.872421903Z [2024-05-26 01:27:57,871: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:27:57.875162299Z [2024-05-26 01:27:57,874: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:27:57.899246509Z [2024-05-26 01:27:57,898: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:27:57.901072570Z [2024-05-26 01:27:57,900: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:27:57.901181598Z [2024-05-26 01:27:57,901: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:27:57.901260391Z [2024-05-26 01:27:57,901: INFO/ForkPoolWorker-15] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:27:57.901590269Z [2024-05-26 01:27:57,901: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:27:57.902168714Z [2024-05-26 01:27:57,901: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:27:57.902636038Z [2024-05-26 01:27:57,902: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:27:57.902808143Z [2024-05-26 01:27:57,902: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:27:57.912294016Z [2024-05-26 01:27:57,911: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:27:58.032428126Z [2024-05-26 01:27:58,031: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:27:58.766967044Z [2024-05-26 01:27:58,766: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d347fef-3e8d-4ce5-90e0-bb464deab188] succeeded in 2.2733128130003024s: None 2024-05-26T01:27:58.865450714Z [2024-05-26 01:27:58,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bfcda8f-9373-4280-8cbc-872c6a046eb3] received 2024-05-26T01:27:58.879870293Z [2024-05-26 01:27:58,879: INFO/ForkPoolWorker-15] [6bfcda8f-9373-4280-8cbc-872c6a046eb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'collect_metrics', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:27:58.938374905Z [2024-05-26 01:27:58,938: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a7bf8308-68ab-41d7-aec4-79ef3bfded62] succeeded in 3.4942556749992946s: None 2024-05-26T01:27:59.148306776Z [2024-05-26 01:27:59,144: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:28:00.177696179Z [2024-05-26 01:28:00,177: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:28:00.180668698Z [2024-05-26 01:28:00,180: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:28:00.205736241Z [2024-05-26 01:28:00,205: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:28:00.207400255Z [2024-05-26 01:28:00,207: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:28:00.207451568Z [2024-05-26 01:28:00,207: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:28:00.207569372Z [2024-05-26 01:28:00,207: INFO/ForkPoolWorker-15] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:28:00.207723544Z [2024-05-26 01:28:00,207: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:28:00.207737637Z [2024-05-26 01:28:00,207: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:28:00.208118605Z [2024-05-26 01:28:00,207: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:28:00.208197558Z [2024-05-26 01:28:00,208: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:28:00.215668888Z [2024-05-26 01:28:00,215: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:28:00.305708463Z [2024-05-26 01:28:00,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:28:00.362476940Z [2024-05-26 01:28:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb00d7f7-0ff3-4619-a3e0-5db459f6a16c] received 2024-05-26T01:28:00.370242742Z [2024-05-26 01:28:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24b90658-d837-439b-81d3-29bbd7acb05b] received 2024-05-26T01:28:00.372429109Z [2024-05-26 01:28:00,372: INFO/ForkPoolWorker-16] [fb00d7f7-0ff3-4619-a3e0-5db459f6a16c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:28:00.375685583Z [2024-05-26 01:28:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[691a3ec2-5800-4a24-9869-0684fc71672c] received 2024-05-26T01:28:00.378843608Z [2024-05-26 01:28:00,378: INFO/ForkPoolWorker-1] [24b90658-d837-439b-81d3-29bbd7acb05b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:28:00.379447737Z [2024-05-26 01:28:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7805eb3a-8ffa-4ae8-8df6-28f45591ed2a] received 2024-05-26T01:28:00.391862908Z [2024-05-26 01:28:00,391: INFO/ForkPoolWorker-2] [691a3ec2-5800-4a24-9869-0684fc71672c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:28:00.407909347Z [2024-05-26 01:28:00,407: INFO/ForkPoolWorker-3] [7805eb3a-8ffa-4ae8-8df6-28f45591ed2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:28:00.413523296Z [2024-05-26 01:28:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c434689-ec72-40ff-aca1-7f2ae2ed61bb] received 2024-05-26T01:28:00.418234310Z [2024-05-26 01:28:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d02e3670-9d8b-48b6-97f7-05c15f6d31c0] received 2024-05-26T01:28:00.428715498Z [2024-05-26 01:28:00,428: INFO/ForkPoolWorker-4] [2c434689-ec72-40ff-aca1-7f2ae2ed61bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:28:00.435392719Z [2024-05-26 01:28:00,434: INFO/ForkPoolWorker-5] [d02e3670-9d8b-48b6-97f7-05c15f6d31c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:28:00.959569168Z [2024-05-26 01:28:00,955: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:28:00.960872165Z [2024-05-26 01:28:00,957: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:28:01.026643007Z [2024-05-26 01:28:01,022: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:28:01.076460674Z [2024-05-26 01:28:01,073: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:28:01.116559537Z [2024-05-26 01:28:01,116: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6bfcda8f-9373-4280-8cbc-872c6a046eb3] succeeded in 2.2442400399995677s: None 2024-05-26T01:28:01.369431368Z [2024-05-26 01:28:01,343: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:28:01.392499858Z [2024-05-26 01:28:01,359: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:28:01.400943302Z [2024-05-26 01:28:01,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1cee992-42f8-4f8c-ba52-637078ff2ab0] received 2024-05-26T01:28:01.419707373Z [2024-05-26 01:28:01,419: INFO/ForkPoolWorker-15] [f1cee992-42f8-4f8c-ba52-637078ff2ab0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'send_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:28:01.654141981Z [2024-05-26 01:28:01,653: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-26T01:28:01.658169747Z [2024-05-26 01:28:01,657: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:28:01.700405346Z [2024-05-26 01:28:01,700: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T01:28:01.703293319Z [2024-05-26 01:28:01,703: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:28:01.703422551Z [2024-05-26 01:28:01,703: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:28:01.703488085Z [2024-05-26 01:28:01,703: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-26T01:28:01.703795359Z [2024-05-26 01:28:01,703: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:28:01.851433097Z [2024-05-26 01:28:01,851: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:28:01.856188300Z [2024-05-26 01:28:01,855: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:28:01.872209786Z [2024-05-26 01:28:01,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:28:02.404812140Z [2024-05-26 01:28:02,404: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7805eb3a-8ffa-4ae8-8df6-28f45591ed2a] succeeded in 2.0223719009991328s: None 2024-05-26T01:28:02.482494020Z [2024-05-26 01:28:02,482: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb00d7f7-0ff3-4619-a3e0-5db459f6a16c] succeeded in 2.1186329720003414s: None 2024-05-26T01:28:02.822287476Z [2024-05-26 01:28:02,821: INFO/ForkPoolWorker-5] Getting VIM list 2024-05-26T01:28:02.831634946Z [2024-05-26 01:28:02,831: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:28:02.908474963Z [2024-05-26 01:28:02,908: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-26T01:28:02.913335293Z [2024-05-26 01:28:02,913: INFO/ForkPoolWorker-5] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:28:02.913353606Z [2024-05-26 01:28:02,913: INFO/ForkPoolWorker-5] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:28:02.913362933Z [2024-05-26 01:28:02,913: INFO/ForkPoolWorker-5] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:28:02.913511074Z [2024-05-26 01:28:02,913: INFO/ForkPoolWorker-5] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:28:02.913532238Z [2024-05-26 01:28:02,913: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-05-26T01:28:02.913765851Z [2024-05-26 01:28:02,913: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:28:02.913796493Z [2024-05-26 01:28:02,913: INFO/ForkPoolWorker-5] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:28:02.918756437Z [2024-05-26 01:28:02,918: INFO/ForkPoolWorker-5] Creating DAG vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:28:02.969697338Z [2024-05-26 01:28:02,969: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:28:02.973490413Z [2024-05-26 01:28:02,973: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:28:03.021078831Z [2024-05-26 01:28:03,020: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:28:03.024371269Z [2024-05-26 01:28:03,024: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:28:03.024490375Z [2024-05-26 01:28:03,024: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:28:03.024604985Z [2024-05-26 01:28:03,024: INFO/ForkPoolWorker-1] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:28:03.024805610Z [2024-05-26 01:28:03,024: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:28:03.024968606Z [2024-05-26 01:28:03,024: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:28:03.025277171Z [2024-05-26 01:28:03,025: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:28:03.025421249Z [2024-05-26 01:28:03,025: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:28:03.030719200Z [2024-05-26 01:28:03,030: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:28:03.063374034Z [2024-05-26 01:28:03,063: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:28:03.175071905Z [2024-05-26 01:28:03,174: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:28:03.309918012Z [2024-05-26 01:28:03,309: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-26T01:28:03.320782211Z [2024-05-26 01:28:03,320: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:28:03.371085071Z [2024-05-26 01:28:03,370: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-26T01:28:03.372631674Z [2024-05-26 01:28:03,372: INFO/ForkPoolWorker-4] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:28:03.372731802Z [2024-05-26 01:28:03,372: INFO/ForkPoolWorker-4] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:28:03.372855482Z [2024-05-26 01:28:03,372: INFO/ForkPoolWorker-4] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:28:03.372950036Z [2024-05-26 01:28:03,372: INFO/ForkPoolWorker-4] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:28:03.372974882Z [2024-05-26 01:28:03,372: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-26T01:28:03.373183246Z [2024-05-26 01:28:03,373: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:28:03.373216674Z [2024-05-26 01:28:03,373: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:28:03.377274015Z [2024-05-26 01:28:03,377: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:28:03.527436337Z [2024-05-26 01:28:03,527: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:28:04.132410110Z [2024-05-26 01:28:04,132: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:28:04.156452980Z [2024-05-26 01:28:04,155: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:28:04.204569888Z [2024-05-26 01:28:04,204: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:28:04.206196806Z [2024-05-26 01:28:04,205: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:28:04.206297959Z [2024-05-26 01:28:04,206: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:28:04.206419547Z [2024-05-26 01:28:04,206: INFO/ForkPoolWorker-2] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:28:04.206603374Z [2024-05-26 01:28:04,206: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:28:04.206702016Z [2024-05-26 01:28:04,206: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:28:04.206993427Z [2024-05-26 01:28:04,206: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:28:04.207094405Z [2024-05-26 01:28:04,206: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:28:04.212920196Z [2024-05-26 01:28:04,212: INFO/ForkPoolWorker-2] Creating DAG vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:28:04.221478155Z [2024-05-26 01:28:04,221: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:28:04.225478335Z [2024-05-26 01:28:04,224: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:28:04.275101123Z [2024-05-26 01:28:04,274: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:28:04.281257222Z [2024-05-26 01:28:04,280: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:28:04.281286503Z [2024-05-26 01:28:04,281: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:28:04.281327855Z [2024-05-26 01:28:04,281: INFO/ForkPoolWorker-15] Read VIM 1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 (basic01_978609) 2024-05-26T01:28:04.281496645Z [2024-05-26 01:28:04,281: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'name': 'basic01_978609', 'vim_type': 'openstack'}] 2024-05-26T01:28:04.281507199Z [2024-05-26 01:28:04,281: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:28:04.281786554Z [2024-05-26 01:28:04,281: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:28:04.281800282Z [2024-05-26 01:28:04,281: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:28:04.288273509Z [2024-05-26 01:28:04,288: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 2024-05-26T01:28:04.308575572Z [2024-05-26 01:28:04,308: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:28:04.370326129Z [2024-05-26 01:28:04,370: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:28:05.133564689Z [2024-05-26 01:28:05,133: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1cee992-42f8-4f8c-ba52-637078ff2ab0] succeeded in 3.7289889759995276s: None 2024-05-26T01:28:05.637593829Z [2024-05-26 01:28:05,637: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[d02e3670-9d8b-48b6-97f7-05c15f6d31c0] succeeded in 5.214158856000722s: None 2024-05-26T01:28:05.979387909Z [2024-05-26 01:28:05,978: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[24b90658-d837-439b-81d3-29bbd7acb05b] succeeded in 5.607808194001336s: None 2024-05-26T01:28:06.048734127Z [2024-05-26 01:28:06,048: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[2c434689-ec72-40ff-aca1-7f2ae2ed61bb] succeeded in 5.632749520000289s: None 2024-05-26T01:28:06.462081560Z [2024-05-26 01:28:06,461: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[691a3ec2-5800-4a24-9869-0684fc71672c] succeeded in 6.081988477999403s: None 2024-05-26T01:29:01.221728432Z [2024-05-26 01:29:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10ed788b-9cfa-486b-b2c7-637222326a86] received 2024-05-26T01:29:01.223680700Z [2024-05-26 01:29:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86f2ff77-5c24-4042-ac42-d553c8566205] received 2024-05-26T01:29:01.235253072Z [2024-05-26 01:29:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef437cd1-290f-4d1f-becb-8618739124b0] received 2024-05-26T01:29:01.243991679Z [2024-05-26 01:29:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75d73903-c067-4485-a20a-57ee15d02a75] received 2024-05-26T01:29:01.248475129Z [2024-05-26 01:29:01,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58b44cd6-e8be-4596-9ca2-7e4caf74e32e] received 2024-05-26T01:29:01.253447022Z [2024-05-26 01:29:01,253: INFO/ForkPoolWorker-1] [ef437cd1-290f-4d1f-becb-8618739124b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:29:01.256207996Z [2024-05-26 01:29:01,255: INFO/ForkPoolWorker-15] [10ed788b-9cfa-486b-b2c7-637222326a86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:29:01.277839055Z [2024-05-26 01:29:01,248: INFO/ForkPoolWorker-16] [86f2ff77-5c24-4042-ac42-d553c8566205] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:29:01.279629581Z [2024-05-26 01:29:01,279: INFO/ForkPoolWorker-2] [75d73903-c067-4485-a20a-57ee15d02a75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:29:01.283209407Z [2024-05-26 01:29:01,282: INFO/ForkPoolWorker-3] [58b44cd6-e8be-4596-9ca2-7e4caf74e32e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:29:01.629375094Z [2024-05-26 01:29:01,626: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:29:01.696351029Z [2024-05-26 01:29:01,691: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:29:01.706307821Z [2024-05-26 01:29:01,701: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:29:01.769221022Z [2024-05-26 01:29:01,765: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:29:01.861244419Z [2024-05-26 01:29:01,860: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-26T01:29:01.865256787Z [2024-05-26 01:29:01,864: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:01.870894290Z [2024-05-26 01:29:01,860: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:29:01.905653817Z [2024-05-26 01:29:01,905: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T01:29:01.907745815Z [2024-05-26 01:29:01,907: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:29:01.907999446Z [2024-05-26 01:29:01,907: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:29:01.908192865Z [2024-05-26 01:29:01,908: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-26T01:29:01.908506545Z [2024-05-26 01:29:01,908: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:29:02.015442422Z [2024-05-26 01:29:02,015: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:29:02.610602828Z [2024-05-26 01:29:02,610: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[58b44cd6-e8be-4596-9ca2-7e4caf74e32e] succeeded in 1.3539919040013046s: None 2024-05-26T01:29:03.016620022Z [2024-05-26 01:29:03,016: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:29:03.020589214Z [2024-05-26 01:29:03,020: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:03.045311798Z [2024-05-26 01:29:03,045: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:29:03.046792639Z [2024-05-26 01:29:03,046: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:03.046861231Z [2024-05-26 01:29:03,046: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:03.047017401Z [2024-05-26 01:29:03,046: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:03.047124986Z [2024-05-26 01:29:03,047: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:29:03.047346236Z [2024-05-26 01:29:03,047: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:29:03.047893668Z [2024-05-26 01:29:03,047: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:03.053997565Z [2024-05-26 01:29:03,053: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:29:03.054871079Z [2024-05-26 01:29:03,054: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:29:03.056391529Z [2024-05-26 01:29:03,056: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:29:03.059285030Z [2024-05-26 01:29:03,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:03.088096671Z [2024-05-26 01:29:03,087: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:29:03.092566568Z [2024-05-26 01:29:03,092: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:03.092686408Z [2024-05-26 01:29:03,092: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:03.092861809Z [2024-05-26 01:29:03,092: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:03.092962217Z [2024-05-26 01:29:03,092: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:29:03.093292975Z [2024-05-26 01:29:03,093: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:29:03.093438937Z [2024-05-26 01:29:03,093: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:03.098620690Z [2024-05-26 01:29:03,097: ERROR/ForkPoolWorker-16] [86f2ff77-5c24-4042-ac42-d553c8566205] Failed to execute task Dag 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse.. 2024-05-26T01:29:03.098648300Z Traceback (most recent call last): 2024-05-26T01:29:03.098652272Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T01:29:03.098655752Z args.func(args) 2024-05-26T01:29:03.098659331Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T01:29:03.098662910Z return func(*args, **kwargs) 2024-05-26T01:29:03.098665827Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T01:29:03.098668671Z return f(*args, **kwargs) 2024-05-26T01:29:03.098671772Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T01:29:03.098674787Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T01:29:03.098677651Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T01:29:03.098680573Z raise AirflowException( 2024-05-26T01:29:03.098684037Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse. 2024-05-26T01:29:03.145521281Z [2024-05-26 01:29:03,142: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86f2ff77-5c24-4042-ac42-d553c8566205] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 86f2ff77-5c24-4042-ac42-d553c8566205') 2024-05-26T01:29:03.145544074Z Traceback (most recent call last): 2024-05-26T01:29:03.145548257Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T01:29:03.145551839Z R = retval = fun(*args, **kwargs) 2024-05-26T01:29:03.145554888Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T01:29:03.145558099Z return self.run(*args, **kwargs) 2024-05-26T01:29:03.145561743Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T01:29:03.145565690Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T01:29:03.145568723Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T01:29:03.145572180Z raise AirflowException(msg) 2024-05-26T01:29:03.145575874Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 86f2ff77-5c24-4042-ac42-d553c8566205 2024-05-26T01:29:03.304324053Z [2024-05-26 01:29:03,303: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:29:03.309491422Z [2024-05-26 01:29:03,309: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:03.342913781Z [2024-05-26 01:29:03,342: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:29:03.345591505Z [2024-05-26 01:29:03,345: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:03.345791264Z [2024-05-26 01:29:03,345: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:03.346086663Z [2024-05-26 01:29:03,345: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:03.346284315Z [2024-05-26 01:29:03,346: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:29:03.346665378Z [2024-05-26 01:29:03,346: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:29:03.347312180Z [2024-05-26 01:29:03,346: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:03.370064636Z [2024-05-26 01:29:03,369: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:29:03.373519557Z [2024-05-26 01:29:03,373: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:03.411704065Z [2024-05-26 01:29:03,401: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:29:03.419663400Z [2024-05-26 01:29:03,411: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:03.419721687Z [2024-05-26 01:29:03,411: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:03.419738981Z [2024-05-26 01:29:03,411: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:03.419743451Z [2024-05-26 01:29:03,412: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:29:03.419746767Z [2024-05-26 01:29:03,412: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:29:03.419750386Z [2024-05-26 01:29:03,412: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:03.514088218Z [2024-05-26 01:29:03,513: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:29:03.519040085Z [2024-05-26 01:29:03,518: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:29:03.524117290Z [2024-05-26 01:29:03,523: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:03.560471490Z [2024-05-26 01:29:03,560: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:29:03.566133579Z [2024-05-26 01:29:03,565: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:29:03.568186688Z [2024-05-26 01:29:03,567: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:03.568229863Z [2024-05-26 01:29:03,568: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:03.571465239Z [2024-05-26 01:29:03,568: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:03.571788938Z [2024-05-26 01:29:03,571: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:29:03.572057929Z [2024-05-26 01:29:03,571: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:29:03.572110268Z [2024-05-26 01:29:03,572: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:03.595047623Z [2024-05-26 01:29:03,594: WARNING/ForkPoolWorker-2] Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:29:03.600680159Z [2024-05-26 01:29:03,600: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:29:03.604332601Z [2024-05-26 01:29:03,604: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:29:03.619659995Z [2024-05-26 01:29:03,617: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:03.641306871Z [2024-05-26 01:29:03,641: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:29:03.642738608Z [2024-05-26 01:29:03,642: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:03.642949765Z [2024-05-26 01:29:03,642: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:03.643197329Z [2024-05-26 01:29:03,642: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:03.643365248Z [2024-05-26 01:29:03,643: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:29:03.644065486Z [2024-05-26 01:29:03,643: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:29:03.644184293Z [2024-05-26 01:29:03,644: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:03.648721286Z [2024-05-26 01:29:03,648: ERROR/ForkPoolWorker-2] [75d73903-c067-4485-a20a-57ee15d02a75] Failed to execute task Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse.. 2024-05-26T01:29:03.648735963Z Traceback (most recent call last): 2024-05-26T01:29:03.648744291Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T01:29:03.648748572Z args.func(args) 2024-05-26T01:29:03.648751997Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T01:29:03.648755495Z return func(*args, **kwargs) 2024-05-26T01:29:03.648758609Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T01:29:03.648761663Z return f(*args, **kwargs) 2024-05-26T01:29:03.648764885Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T01:29:03.648767903Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T01:29:03.648770951Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T01:29:03.648773905Z raise AirflowException( 2024-05-26T01:29:03.648777230Z airflow.exceptions.AirflowException: Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse. 2024-05-26T01:29:03.717211189Z [2024-05-26 01:29:03,716: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[75d73903-c067-4485-a20a-57ee15d02a75] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 75d73903-c067-4485-a20a-57ee15d02a75') 2024-05-26T01:29:03.717231088Z Traceback (most recent call last): 2024-05-26T01:29:03.717235089Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T01:29:03.717238454Z R = retval = fun(*args, **kwargs) 2024-05-26T01:29:03.717241626Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T01:29:03.717258013Z return self.run(*args, **kwargs) 2024-05-26T01:29:03.717261671Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T01:29:03.717265281Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T01:29:03.717268190Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T01:29:03.717272091Z raise AirflowException(msg) 2024-05-26T01:29:03.717275672Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 75d73903-c067-4485-a20a-57ee15d02a75 2024-05-26T01:29:05.205202192Z [2024-05-26 01:29:05,204: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef437cd1-290f-4d1f-becb-8618739124b0] succeeded in 3.9658061250011087s: None 2024-05-26T01:29:05.706176222Z [2024-05-26 01:29:05,705: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[10ed788b-9cfa-486b-b2c7-637222326a86] succeeded in 4.4796659640014695s: None 2024-05-26T01:29:13.964164574Z [2024-05-26 01:29:13,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4797a98-3850-44a5-9f6b-32b40513b0e1] received 2024-05-26T01:29:13.969593308Z [2024-05-26 01:29:13,969: INFO/ForkPoolWorker-15] [f4797a98-3850-44a5-9f6b-32b40513b0e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:29:14.004199401Z [2024-05-26 01:29:14,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da584aac-c13c-4a18-bd73-932aff9f314f] received 2024-05-26T01:29:14.018801695Z [2024-05-26 01:29:14,018: INFO/ForkPoolWorker-16] [da584aac-c13c-4a18-bd73-932aff9f314f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:29:14.360427715Z [2024-05-26 01:29:14,357: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:29:14.385377868Z [2024-05-26 01:29:14,382: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:29:15.752892668Z [2024-05-26 01:29:15,752: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:29:15.756152830Z [2024-05-26 01:29:15,755: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:15.788838709Z [2024-05-26 01:29:15,788: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:29:15.790230568Z [2024-05-26 01:29:15,790: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:15.790386014Z [2024-05-26 01:29:15,790: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:15.790577094Z [2024-05-26 01:29:15,790: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:15.790719669Z [2024-05-26 01:29:15,790: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:29:15.790997468Z [2024-05-26 01:29:15,790: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:29:15.791127362Z [2024-05-26 01:29:15,791: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:15.797268356Z [2024-05-26 01:29:15,797: WARNING/ForkPoolWorker-16] Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:29:15.798279828Z [2024-05-26 01:29:15,797: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:29:15.799490647Z [2024-05-26 01:29:15,799: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:29:15.802081920Z [2024-05-26 01:29:15,801: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:15.822601833Z [2024-05-26 01:29:15,822: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:29:15.824438322Z [2024-05-26 01:29:15,824: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:15.824693688Z [2024-05-26 01:29:15,824: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:15.824928102Z [2024-05-26 01:29:15,824: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:15.825101894Z [2024-05-26 01:29:15,824: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:29:15.825486297Z [2024-05-26 01:29:15,825: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:29:15.826015471Z [2024-05-26 01:29:15,825: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:15.826347433Z [2024-05-26 01:29:15,825: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:29:15.830757445Z [2024-05-26 01:29:15,830: ERROR/ForkPoolWorker-16] [da584aac-c13c-4a18-bd73-932aff9f314f] Failed to execute task Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse.. 2024-05-26T01:29:15.830775772Z Traceback (most recent call last): 2024-05-26T01:29:15.830779782Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T01:29:15.830784584Z args.func(args) 2024-05-26T01:29:15.830788014Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T01:29:15.830805365Z return func(*args, **kwargs) 2024-05-26T01:29:15.830808609Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T01:29:15.830812003Z return f(*args, **kwargs) 2024-05-26T01:29:15.830814909Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T01:29:15.830817882Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T01:29:15.830820736Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T01:29:15.830823689Z raise AirflowException( 2024-05-26T01:29:15.830829394Z airflow.exceptions.AirflowException: Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse. 2024-05-26T01:29:15.830833315Z [2024-05-26 01:29:15,830: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:15.852398040Z [2024-05-26 01:29:15,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:29:15.854281794Z [2024-05-26 01:29:15,853: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:15.854295634Z [2024-05-26 01:29:15,853: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:15.854311436Z [2024-05-26 01:29:15,853: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:15.854316065Z [2024-05-26 01:29:15,854: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:29:15.854536348Z [2024-05-26 01:29:15,854: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:29:15.854714922Z [2024-05-26 01:29:15,854: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:15.862114666Z [2024-05-26 01:29:15,861: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:29:15.863485150Z [2024-05-26 01:29:15,862: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:29:15.864455353Z [2024-05-26 01:29:15,864: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:29:15.867662809Z [2024-05-26 01:29:15,867: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:29:15.871136814Z [2024-05-26 01:29:15,870: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[da584aac-c13c-4a18-bd73-932aff9f314f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id da584aac-c13c-4a18-bd73-932aff9f314f') 2024-05-26T01:29:15.871150859Z Traceback (most recent call last): 2024-05-26T01:29:15.871154681Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T01:29:15.871157709Z R = retval = fun(*args, **kwargs) 2024-05-26T01:29:15.871172579Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T01:29:15.871187185Z return self.run(*args, **kwargs) 2024-05-26T01:29:15.871191356Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T01:29:15.871195547Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T01:29:15.871198491Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T01:29:15.871203098Z raise AirflowException(msg) 2024-05-26T01:29:15.871206691Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id da584aac-c13c-4a18-bd73-932aff9f314f 2024-05-26T01:29:15.896649962Z [2024-05-26 01:29:15,896: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:29:15.900296168Z [2024-05-26 01:29:15,899: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:29:15.900538574Z [2024-05-26 01:29:15,900: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:29:15.900863180Z [2024-05-26 01:29:15,900: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:29:15.901070041Z [2024-05-26 01:29:15,900: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:29:15.901480892Z [2024-05-26 01:29:15,901: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:29:15.901704540Z [2024-05-26 01:29:15,901: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:29:15.911072475Z [2024-05-26 01:29:15,910: ERROR/ForkPoolWorker-15] [f4797a98-3850-44a5-9f6b-32b40513b0e1] Failed to execute task Dag 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse.. 2024-05-26T01:29:15.911092785Z Traceback (most recent call last): 2024-05-26T01:29:15.911097411Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T01:29:15.911103719Z args.func(args) 2024-05-26T01:29:15.911107412Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T01:29:15.911117053Z return func(*args, **kwargs) 2024-05-26T01:29:15.911120111Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T01:29:15.911123141Z return f(*args, **kwargs) 2024-05-26T01:29:15.911126209Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T01:29:15.911129323Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T01:29:15.911132457Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T01:29:15.911135437Z raise AirflowException( 2024-05-26T01:29:15.911148299Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse. 2024-05-26T01:29:15.949284145Z [2024-05-26 01:29:15,948: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4797a98-3850-44a5-9f6b-32b40513b0e1] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f4797a98-3850-44a5-9f6b-32b40513b0e1') 2024-05-26T01:29:15.949314115Z Traceback (most recent call last): 2024-05-26T01:29:15.949318287Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T01:29:15.949321664Z R = retval = fun(*args, **kwargs) 2024-05-26T01:29:15.949324601Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T01:29:15.949327848Z return self.run(*args, **kwargs) 2024-05-26T01:29:15.949331303Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T01:29:15.949334696Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T01:29:15.949337696Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T01:29:15.949341213Z raise AirflowException(msg) 2024-05-26T01:29:15.949345089Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f4797a98-3850-44a5-9f6b-32b40513b0e1 2024-05-26T01:30:00.464095207Z [2024-05-26 01:30:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[827e15d6-2387-4993-a332-c7a3a9a4b355] received 2024-05-26T01:30:00.473301041Z [2024-05-26 01:30:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b939261-8d25-4dc0-98a6-ccda971dfc87] received 2024-05-26T01:30:00.480905405Z [2024-05-26 01:30:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dea1c92-1213-4a1c-8468-cf3991991cb0] received 2024-05-26T01:30:00.482049733Z [2024-05-26 01:30:00,481: INFO/ForkPoolWorker-15] [827e15d6-2387-4993-a332-c7a3a9a4b355] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:30:00.488792040Z [2024-05-26 01:30:00,488: INFO/ForkPoolWorker-1] [5dea1c92-1213-4a1c-8468-cf3991991cb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:00.488859072Z [2024-05-26 01:30:00,488: INFO/ForkPoolWorker-16] [1b939261-8d25-4dc0-98a6-ccda971dfc87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:00.505496616Z [2024-05-26 01:30:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f39dab68-b2dc-4ded-8671-bda687fdbdf9] received 2024-05-26T01:30:00.512129471Z [2024-05-26 01:30:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2452dd1-c52b-4467-b07f-b196baa89ce1] received 2024-05-26T01:30:00.512339098Z [2024-05-26 01:30:00,512: INFO/ForkPoolWorker-2] [f39dab68-b2dc-4ded-8671-bda687fdbdf9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:30:00.520721514Z [2024-05-26 01:30:00,520: INFO/ForkPoolWorker-3] [f2452dd1-c52b-4467-b07f-b196baa89ce1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:30:00.530236894Z [2024-05-26 01:30:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4d309c3-c0f8-44ad-8d95-6732144185e6] received 2024-05-26T01:30:00.535599359Z [2024-05-26 01:30:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f275b07-3129-451b-807e-9f2b3f6cf6d2] received 2024-05-26T01:30:00.551867200Z [2024-05-26 01:30:00,551: INFO/ForkPoolWorker-5] [1f275b07-3129-451b-807e-9f2b3f6cf6d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:30:00.556273512Z [2024-05-26 01:30:00,555: INFO/ForkPoolWorker-4] [d4d309c3-c0f8-44ad-8d95-6732144185e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:30:00.913967847Z [2024-05-26 01:30:00,910: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:00.998183218Z [2024-05-26 01:30:00,994: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:30:01.105887162Z [2024-05-26 01:30:01,102: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:30:01.373702258Z [2024-05-26 01:30:01,368: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:01.383072130Z [2024-05-26 01:30:01,378: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:30:01.687195996Z [2024-05-26 01:30:01,683: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:30:01.733226257Z [2024-05-26 01:30:01,732: INFO/ForkPoolWorker-5] Getting SDNC list 2024-05-26T01:30:01.745402285Z [2024-05-26 01:30:01,744: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:01.784269067Z [2024-05-26 01:30:01,784: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:30:01.845494517Z [2024-05-26 01:30:01,845: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-26T01:30:01.852553287Z [2024-05-26 01:30:01,852: INFO/ForkPoolWorker-5] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:30:01.852621653Z [2024-05-26 01:30:01,852: INFO/ForkPoolWorker-5] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:30:01.852821634Z [2024-05-26 01:30:01,852: INFO/ForkPoolWorker-5] Getting SDNC list OK 2024-05-26T01:30:01.853178564Z [2024-05-26 01:30:01,852: INFO/ForkPoolWorker-5] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:30:01.941937997Z [2024-05-26 01:30:01,938: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:30:02.052605355Z [2024-05-26 01:30:02,052: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:30:02.980163116Z [2024-05-26 01:30:02,979: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[1f275b07-3129-451b-807e-9f2b3f6cf6d2] succeeded in 2.4424945509999816s: None 2024-05-26T01:30:03.082508101Z [2024-05-26 01:30:03,082: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f39dab68-b2dc-4ded-8671-bda687fdbdf9] succeeded in 2.575680050998926s: None 2024-05-26T01:30:03.191655892Z [2024-05-26 01:30:03,186: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:30:03.191683892Z [2024-05-26 01:30:03,190: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:03.271711413Z [2024-05-26 01:30:03,256: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:30:03.271731631Z [2024-05-26 01:30:03,259: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:03.271735088Z [2024-05-26 01:30:03,268: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:03.271739028Z [2024-05-26 01:30:03,268: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:03.271742985Z [2024-05-26 01:30:03,268: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:30:03.271746260Z [2024-05-26 01:30:03,268: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:30:03.271750473Z [2024-05-26 01:30:03,268: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:03.275654458Z [2024-05-26 01:30:03,274: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:30:03.279682625Z [2024-05-26 01:30:03,276: WARNING/ForkPoolWorker-1] Dag 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:03.279705011Z [2024-05-26 01:30:03,276: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:03.279709238Z [2024-05-26 01:30:03,278: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:30:03.279712543Z [2024-05-26 01:30:03,277: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:03.286804539Z [2024-05-26 01:30:03,286: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:03.324348747Z [2024-05-26 01:30:03,324: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:30:03.326049981Z [2024-05-26 01:30:03,325: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:03.326203789Z [2024-05-26 01:30:03,325: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:03.326400442Z [2024-05-26 01:30:03,326: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:03.326600331Z [2024-05-26 01:30:03,326: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:30:03.326912928Z [2024-05-26 01:30:03,326: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:30:03.327064486Z [2024-05-26 01:30:03,326: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:03.330765608Z [2024-05-26 01:30:03,330: ERROR/ForkPoolWorker-1] [5dea1c92-1213-4a1c-8468-cf3991991cb0] Failed to execute task Dag 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse.. 2024-05-26T01:30:03.330779299Z Traceback (most recent call last): 2024-05-26T01:30:03.330783275Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T01:30:03.330786852Z args.func(args) 2024-05-26T01:30:03.330790165Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T01:30:03.330793890Z return func(*args, **kwargs) 2024-05-26T01:30:03.330815374Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T01:30:03.330819351Z return f(*args, **kwargs) 2024-05-26T01:30:03.330822923Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T01:30:03.330826460Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T01:30:03.330829558Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T01:30:03.330832713Z raise AirflowException( 2024-05-26T01:30:03.330839994Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse. 2024-05-26T01:30:03.331439153Z [2024-05-26 01:30:03,331: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:30:03.335011739Z [2024-05-26 01:30:03,334: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:03.335032225Z [2024-05-26 01:30:03,334: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:03.335130963Z [2024-05-26 01:30:03,334: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:03.335175579Z [2024-05-26 01:30:03,335: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:30:03.335434603Z [2024-05-26 01:30:03,335: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:30:03.335465564Z [2024-05-26 01:30:03,335: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:03.427610453Z [2024-05-26 01:30:03,421: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5dea1c92-1213-4a1c-8468-cf3991991cb0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5dea1c92-1213-4a1c-8468-cf3991991cb0') 2024-05-26T01:30:03.427635560Z Traceback (most recent call last): 2024-05-26T01:30:03.427639727Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T01:30:03.427643176Z R = retval = fun(*args, **kwargs) 2024-05-26T01:30:03.427646726Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T01:30:03.427661271Z return self.run(*args, **kwargs) 2024-05-26T01:30:03.427664947Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T01:30:03.427668642Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T01:30:03.427671608Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T01:30:03.427675226Z raise AirflowException(msg) 2024-05-26T01:30:03.427678777Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5dea1c92-1213-4a1c-8468-cf3991991cb0 2024-05-26T01:30:03.494626891Z [2024-05-26 01:30:03,494: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:30:03.924548755Z [2024-05-26 01:30:03,924: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-26T01:30:03.938857471Z [2024-05-26 01:30:03,938: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:03.997832407Z [2024-05-26 01:30:03,997: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-26T01:30:03.999339573Z [2024-05-26 01:30:03,999: INFO/ForkPoolWorker-4] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:03.999377828Z [2024-05-26 01:30:03,999: INFO/ForkPoolWorker-4] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:03.999609379Z [2024-05-26 01:30:03,999: INFO/ForkPoolWorker-4] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:03.999704327Z [2024-05-26 01:30:03,999: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-26T01:30:03.999993872Z [2024-05-26 01:30:03,999: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:30:04.000167064Z [2024-05-26 01:30:04,000: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:04.126531210Z [2024-05-26 01:30:04,126: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:30:04.267450418Z [2024-05-26 01:30:04,267: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:30:04.271174534Z [2024-05-26 01:30:04,270: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:04.333478956Z [2024-05-26 01:30:04,333: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:30:04.342408186Z [2024-05-26 01:30:04,342: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:04.343830466Z [2024-05-26 01:30:04,343: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:04.347912950Z [2024-05-26 01:30:04,344: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:04.348140101Z [2024-05-26 01:30:04,347: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:30:04.348668721Z [2024-05-26 01:30:04,348: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:30:04.349011688Z [2024-05-26 01:30:04,348: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:04.488144073Z [2024-05-26 01:30:04,486: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T01:30:04.492768024Z [2024-05-26 01:30:04,491: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:04.600245488Z [2024-05-26 01:30:04,600: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T01:30:04.604267100Z [2024-05-26 01:30:04,604: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:04.604288052Z [2024-05-26 01:30:04,604: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:04.604367214Z [2024-05-26 01:30:04,604: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:04.604374340Z [2024-05-26 01:30:04,604: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T01:30:04.604608258Z [2024-05-26 01:30:04,604: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:30:04.604621267Z [2024-05-26 01:30:04,604: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:04.623073193Z [2024-05-26 01:30:04,622: WARNING/ForkPoolWorker-3] Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:30:04.623984510Z [2024-05-26 01:30:04,623: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:30:04.624802231Z [2024-05-26 01:30:04,624: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T01:30:04.627238089Z [2024-05-26 01:30:04,627: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:04.632889920Z [2024-05-26 01:30:04,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:30:04.717725663Z [2024-05-26 01:30:04,717: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T01:30:04.728371800Z [2024-05-26 01:30:04,728: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:04.728420597Z [2024-05-26 01:30:04,728: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:04.728593232Z [2024-05-26 01:30:04,728: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:04.728637253Z [2024-05-26 01:30:04,728: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T01:30:04.728928651Z [2024-05-26 01:30:04,728: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:30:04.728970069Z [2024-05-26 01:30:04,728: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:04.733170667Z [2024-05-26 01:30:04,732: ERROR/ForkPoolWorker-3] [f2452dd1-c52b-4467-b07f-b196baa89ce1] Failed to execute task Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse.. 2024-05-26T01:30:04.733184915Z Traceback (most recent call last): 2024-05-26T01:30:04.733188843Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T01:30:04.733192444Z args.func(args) 2024-05-26T01:30:04.733195988Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T01:30:04.733199918Z return func(*args, **kwargs) 2024-05-26T01:30:04.733203002Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T01:30:04.733206366Z return f(*args, **kwargs) 2024-05-26T01:30:04.733209602Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T01:30:04.733217234Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T01:30:04.733220449Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T01:30:04.733223489Z raise AirflowException( 2024-05-26T01:30:04.733226995Z airflow.exceptions.AirflowException: Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse. 2024-05-26T01:30:04.787224737Z [2024-05-26 01:30:04,786: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f2452dd1-c52b-4467-b07f-b196baa89ce1] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f2452dd1-c52b-4467-b07f-b196baa89ce1') 2024-05-26T01:30:04.787241648Z Traceback (most recent call last): 2024-05-26T01:30:04.787245700Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T01:30:04.787248846Z R = retval = fun(*args, **kwargs) 2024-05-26T01:30:04.787251801Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T01:30:04.787254887Z return self.run(*args, **kwargs) 2024-05-26T01:30:04.787283491Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T01:30:04.787287775Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T01:30:04.787290724Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T01:30:04.787294856Z raise AirflowException(msg) 2024-05-26T01:30:04.787298435Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f2452dd1-c52b-4467-b07f-b196baa89ce1 2024-05-26T01:30:05.019546601Z [2024-05-26 01:30:05,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b939261-8d25-4dc0-98a6-ccda971dfc87] succeeded in 4.5420252949988935s: None 2024-05-26T01:30:05.826833408Z [2024-05-26 01:30:05,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f10c4536-2316-4db9-9522-b2b5a5dffdd6] received 2024-05-26T01:30:05.842503046Z [2024-05-26 01:30:05,842: INFO/ForkPoolWorker-16] [f10c4536-2316-4db9-9522-b2b5a5dffdd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:06.292930974Z [2024-05-26 01:30:06,289: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:06.313466026Z [2024-05-26 01:30:06,313: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[d4d309c3-c0f8-44ad-8d95-6732144185e6] succeeded in 5.781095855998501s: None 2024-05-26T01:30:06.447471877Z [2024-05-26 01:30:06,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[827e15d6-2387-4993-a332-c7a3a9a4b355] succeeded in 5.973112416000731s: None 2024-05-26T01:30:07.496332547Z [2024-05-26 01:30:07,495: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:30:07.499606180Z [2024-05-26 01:30:07,499: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:07.516300823Z [2024-05-26 01:30:07,516: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:30:07.517606751Z [2024-05-26 01:30:07,517: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:07.517728166Z [2024-05-26 01:30:07,517: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:07.517877345Z [2024-05-26 01:30:07,517: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:07.517977262Z [2024-05-26 01:30:07,517: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:30:07.518226986Z [2024-05-26 01:30:07,518: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:30:07.518332614Z [2024-05-26 01:30:07,518: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:07.621176142Z [2024-05-26 01:30:07,620: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:30:08.310197572Z [2024-05-26 01:30:08,309: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f10c4536-2316-4db9-9522-b2b5a5dffdd6] succeeded in 2.480066688998704s: None 2024-05-26T01:30:08.530942290Z [2024-05-26 01:30:08,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[200ed808-49e1-4e3e-903d-64216a903de1] received 2024-05-26T01:30:08.539643426Z [2024-05-26 01:30:08,539: INFO/ForkPoolWorker-15] [200ed808-49e1-4e3e-903d-64216a903de1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:30:08.724134399Z [2024-05-26 01:30:08,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5479c48-7916-4ac2-bdc7-49d97be34253] received 2024-05-26T01:30:08.736563696Z [2024-05-26 01:30:08,736: INFO/ForkPoolWorker-16] [e5479c48-7916-4ac2-bdc7-49d97be34253] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240526013007_378503', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-26T01:30:08.839270102Z [2024-05-26 01:30:08,836: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:09.027276091Z [2024-05-26 01:30:09,024: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-05-26T01:30:09.340157869Z [2024-05-26 01:30:09,339: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:30:09.972658823Z [2024-05-26 01:30:09,972: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5479c48-7916-4ac2-bdc7-49d97be34253] succeeded in 1.246810008000466s: None 2024-05-26T01:30:10.173566476Z [2024-05-26 01:30:10,173: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:30:10.178209652Z [2024-05-26 01:30:10,177: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:10.200338960Z [2024-05-26 01:30:10,200: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:30:10.201618009Z [2024-05-26 01:30:10,201: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:10.201631051Z [2024-05-26 01:30:10,201: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:10.201888574Z [2024-05-26 01:30:10,201: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:10.201923789Z [2024-05-26 01:30:10,201: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:30:10.202089877Z [2024-05-26 01:30:10,201: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:30:10.202119722Z [2024-05-26 01:30:10,202: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:10.297777576Z [2024-05-26 01:30:10,297: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:30:10.894196030Z [2024-05-26 01:30:10,893: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[200ed808-49e1-4e3e-903d-64216a903de1] succeeded in 2.361029628998949s: None 2024-05-26T01:30:11.898501432Z [2024-05-26 01:30:11,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db528017-8a36-423e-ac3e-c8a0404ada82] received 2024-05-26T01:30:11.908135782Z [2024-05-26 01:30:11,907: INFO/ForkPoolWorker-15] [db528017-8a36-423e-ac3e-c8a0404ada82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:12.270657541Z [2024-05-26 01:30:12,267: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:13.384761477Z [2024-05-26 01:30:13,384: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:30:13.388078831Z [2024-05-26 01:30:13,387: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:13.411651213Z [2024-05-26 01:30:13,411: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:30:13.413159122Z [2024-05-26 01:30:13,412: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:13.413461422Z [2024-05-26 01:30:13,413: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:13.413924337Z [2024-05-26 01:30:13,413: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:13.414264019Z [2024-05-26 01:30:13,414: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:30:13.415282465Z [2024-05-26 01:30:13,415: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:30:13.415505241Z [2024-05-26 01:30:13,415: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:13.501737931Z [2024-05-26 01:30:13,501: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:30:14.154308037Z [2024-05-26 01:30:14,153: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db528017-8a36-423e-ac3e-c8a0404ada82] succeeded in 2.2530904359991837s: None 2024-05-26T01:30:14.724901534Z [2024-05-26 01:30:14,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dc5fa2f-347c-4e46-965e-a31ac67f07bd] received 2024-05-26T01:30:14.737869905Z [2024-05-26 01:30:14,737: INFO/ForkPoolWorker-15] [1dc5fa2f-347c-4e46-965e-a31ac67f07bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:15.047074766Z [2024-05-26 01:30:15,043: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:16.282909272Z [2024-05-26 01:30:16,282: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:30:16.286178573Z [2024-05-26 01:30:16,285: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:16.303954265Z [2024-05-26 01:30:16,303: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:30:16.305652183Z [2024-05-26 01:30:16,305: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:16.305704785Z [2024-05-26 01:30:16,305: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:16.305895699Z [2024-05-26 01:30:16,305: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:16.305950313Z [2024-05-26 01:30:16,305: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:30:16.306247595Z [2024-05-26 01:30:16,306: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:30:16.306329384Z [2024-05-26 01:30:16,306: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:16.312978867Z [2024-05-26 01:30:16,312: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:16.313588957Z [2024-05-26 01:30:16,313: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:30:16.314494206Z [2024-05-26 01:30:16,314: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:30:16.317226655Z [2024-05-26 01:30:16,316: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:16.335593126Z [2024-05-26 01:30:16,335: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:30:16.337430570Z [2024-05-26 01:30:16,337: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:16.337489627Z [2024-05-26 01:30:16,337: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:16.337869559Z [2024-05-26 01:30:16,337: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:16.337963577Z [2024-05-26 01:30:16,337: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:30:16.338641582Z [2024-05-26 01:30:16,338: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:30:16.338717791Z [2024-05-26 01:30:16,338: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:16.346003744Z [2024-05-26 01:30:16,345: ERROR/ForkPoolWorker-15] [1dc5fa2f-347c-4e46-965e-a31ac67f07bd] Failed to execute task Dag 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse.. 2024-05-26T01:30:16.346019047Z Traceback (most recent call last): 2024-05-26T01:30:16.346023179Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T01:30:16.346027005Z args.func(args) 2024-05-26T01:30:16.346030678Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T01:30:16.346034447Z return func(*args, **kwargs) 2024-05-26T01:30:16.346037417Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T01:30:16.346040385Z return f(*args, **kwargs) 2024-05-26T01:30:16.346043315Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T01:30:16.346046135Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T01:30:16.346048991Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T01:30:16.346051941Z raise AirflowException( 2024-05-26T01:30:16.346055344Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse. 2024-05-26T01:30:16.388425829Z [2024-05-26 01:30:16,387: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1dc5fa2f-347c-4e46-965e-a31ac67f07bd] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1dc5fa2f-347c-4e46-965e-a31ac67f07bd') 2024-05-26T01:30:16.388459192Z Traceback (most recent call last): 2024-05-26T01:30:16.388463550Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T01:30:16.388466694Z R = retval = fun(*args, **kwargs) 2024-05-26T01:30:16.388469736Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T01:30:16.388472664Z return self.run(*args, **kwargs) 2024-05-26T01:30:16.388476462Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T01:30:16.388480385Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T01:30:16.388483349Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T01:30:16.388487006Z raise AirflowException(msg) 2024-05-26T01:30:16.388491000Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1dc5fa2f-347c-4e46-965e-a31ac67f07bd 2024-05-26T01:30:17.088897308Z [2024-05-26 01:30:17,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e6abc34-4866-4af7-9130-cf6afb5c78ac] received 2024-05-26T01:30:17.096310614Z [2024-05-26 01:30:17,095: INFO/ForkPoolWorker-15] [3e6abc34-4866-4af7-9130-cf6afb5c78ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:30:17.379742677Z [2024-05-26 01:30:17,376: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:30:18.440598795Z [2024-05-26 01:30:18,440: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:30:18.444121865Z [2024-05-26 01:30:18,443: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:18.494155535Z [2024-05-26 01:30:18,493: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:30:18.496843132Z [2024-05-26 01:30:18,496: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:18.497324996Z [2024-05-26 01:30:18,496: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:18.497577733Z [2024-05-26 01:30:18,497: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:18.497629774Z [2024-05-26 01:30:18,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:30:18.497908409Z [2024-05-26 01:30:18,497: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:30:18.498021357Z [2024-05-26 01:30:18,497: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:18.505746459Z [2024-05-26 01:30:18,505: WARNING/ForkPoolWorker-15] Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:30:18.506370555Z [2024-05-26 01:30:18,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:30:18.507114139Z [2024-05-26 01:30:18,506: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:30:18.509827917Z [2024-05-26 01:30:18,509: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:30:18.533607965Z [2024-05-26 01:30:18,533: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:30:18.534571583Z [2024-05-26 01:30:18,534: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:30:18.534614812Z [2024-05-26 01:30:18,534: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:30:18.534700281Z [2024-05-26 01:30:18,534: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:30:18.534737820Z [2024-05-26 01:30:18,534: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:30:18.534951132Z [2024-05-26 01:30:18,534: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:30:18.534996785Z [2024-05-26 01:30:18,534: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:30:18.538649775Z [2024-05-26 01:30:18,538: ERROR/ForkPoolWorker-15] [3e6abc34-4866-4af7-9130-cf6afb5c78ac] Failed to execute task Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse.. 2024-05-26T01:30:18.538662534Z Traceback (most recent call last): 2024-05-26T01:30:18.538666255Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-26T01:30:18.538669952Z args.func(args) 2024-05-26T01:30:18.538673377Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-26T01:30:18.538677148Z return func(*args, **kwargs) 2024-05-26T01:30:18.538680122Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-26T01:30:18.538683563Z return f(*args, **kwargs) 2024-05-26T01:30:18.538686538Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-26T01:30:18.538689636Z dag = get_dag(args.subdir, args.dag_id) 2024-05-26T01:30:18.538692496Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-26T01:30:18.538695402Z raise AirflowException( 2024-05-26T01:30:18.538699362Z airflow.exceptions.AirflowException: Dag 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6' could not be found; either it does not exist or it failed to parse. 2024-05-26T01:30:18.583455388Z [2024-05-26 01:30:18,582: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e6abc34-4866-4af7-9130-cf6afb5c78ac] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3e6abc34-4866-4af7-9130-cf6afb5c78ac') 2024-05-26T01:30:18.583484846Z Traceback (most recent call last): 2024-05-26T01:30:18.583490781Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-26T01:30:18.583495561Z R = retval = fun(*args, **kwargs) 2024-05-26T01:30:18.583500551Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-26T01:30:18.583538179Z return self.run(*args, **kwargs) 2024-05-26T01:30:18.583547773Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-26T01:30:18.583580603Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-26T01:30:18.583589248Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-26T01:30:18.583612842Z raise AirflowException(msg) 2024-05-26T01:30:18.583624910Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3e6abc34-4866-4af7-9130-cf6afb5c78ac 2024-05-26T01:31:00.885766380Z [2024-05-26 01:31:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37db8514-a860-41cf-b1e3-635f522cafca] received 2024-05-26T01:31:00.890627389Z [2024-05-26 01:31:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51483db9-3b0c-4d9c-9231-80731d85bef3] received 2024-05-26T01:31:00.897306602Z [2024-05-26 01:31:00,897: INFO/ForkPoolWorker-15] [37db8514-a860-41cf-b1e3-635f522cafca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:31:00.915841193Z [2024-05-26 01:31:00,915: INFO/ForkPoolWorker-16] [51483db9-3b0c-4d9c-9231-80731d85bef3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:31:00.922960169Z [2024-05-26 01:31:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6029ede8-e103-4a6e-9f27-515d13602f36] received 2024-05-26T01:31:00.936389072Z [2024-05-26 01:31:00,935: INFO/ForkPoolWorker-1] [6029ede8-e103-4a6e-9f27-515d13602f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:31:01.174047906Z [2024-05-26 01:31:01,171: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:31:01.246701322Z [2024-05-26 01:31:01,243: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:31:01.266888254Z [2024-05-26 01:31:01,264: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:31:01.442908667Z [2024-05-26 01:31:01,442: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:31:01.447088355Z [2024-05-26 01:31:01,446: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:31:01.481760447Z [2024-05-26 01:31:01,481: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:31:01.482903145Z [2024-05-26 01:31:01,482: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:31:01.483114833Z [2024-05-26 01:31:01,482: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:31:01.483286808Z [2024-05-26 01:31:01,483: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:31:01.483618054Z [2024-05-26 01:31:01,483: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:31:01.582707748Z [2024-05-26 01:31:01,582: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:31:02.226809054Z [2024-05-26 01:31:02,226: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[51483db9-3b0c-4d9c-9231-80731d85bef3] succeeded in 1.3302144779991067s: None 2024-05-26T01:31:02.327231667Z [2024-05-26 01:31:02,326: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:31:02.330329409Z [2024-05-26 01:31:02,329: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:31:02.351932226Z [2024-05-26 01:31:02,351: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:31:02.356083216Z [2024-05-26 01:31:02,355: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:31:02.356100739Z [2024-05-26 01:31:02,355: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:31:02.356302447Z [2024-05-26 01:31:02,356: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:31:02.356409576Z [2024-05-26 01:31:02,356: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:31:02.356750237Z [2024-05-26 01:31:02,356: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:31:02.356873535Z [2024-05-26 01:31:02,356: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:31:02.426828205Z [2024-05-26 01:31:02,426: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:31:02.429578525Z [2024-05-26 01:31:02,429: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:31:02.430024022Z [2024-05-26 01:31:02,429: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:31:02.457658906Z [2024-05-26 01:31:02,457: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:31:02.459011493Z [2024-05-26 01:31:02,458: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:31:02.459161921Z [2024-05-26 01:31:02,459: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:31:02.459364078Z [2024-05-26 01:31:02,459: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:31:02.459464245Z [2024-05-26 01:31:02,459: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:31:02.459849442Z [2024-05-26 01:31:02,459: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:31:02.459964365Z [2024-05-26 01:31:02,459: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:31:02.535891998Z [2024-05-26 01:31:02,535: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:31:04.559004507Z [2024-05-26 01:31:04,558: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37db8514-a860-41cf-b1e3-635f522cafca] succeeded in 3.670924924001156s: None 2024-05-26T01:31:04.938881191Z [2024-05-26 01:31:04,936: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6029ede8-e103-4a6e-9f27-515d13602f36] succeeded in 4.011663696999676s: None 2024-05-26T01:32:00.306545488Z [2024-05-26 01:32:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[225fb8ca-d698-4a49-8bab-49b92a761613] received 2024-05-26T01:32:00.311363224Z [2024-05-26 01:32:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b64abfb-c8cc-42e2-a043-d8b5406560ab] received 2024-05-26T01:32:00.321277844Z [2024-05-26 01:32:00,320: INFO/ForkPoolWorker-16] [5b64abfb-c8cc-42e2-a043-d8b5406560ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:32:00.322349740Z [2024-05-26 01:32:00,321: INFO/ForkPoolWorker-15] [225fb8ca-d698-4a49-8bab-49b92a761613] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:32:00.324425954Z [2024-05-26 01:32:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c4d739b-d795-44b9-aadf-8f398787e5cd] received 2024-05-26T01:32:00.332865947Z [2024-05-26 01:32:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b584988a-fe32-4740-87b3-5022151e0976] received 2024-05-26T01:32:00.333532956Z [2024-05-26 01:32:00,333: INFO/ForkPoolWorker-1] [7c4d739b-d795-44b9-aadf-8f398787e5cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:32:00.355538467Z [2024-05-26 01:32:00,355: INFO/ForkPoolWorker-2] [b584988a-fe32-4740-87b3-5022151e0976] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:32:00.631429874Z [2024-05-26 01:32:00,627: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:32:00.668919479Z [2024-05-26 01:32:00,660: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:32:00.697805238Z [2024-05-26 01:32:00,694: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:32:00.737798956Z [2024-05-26 01:32:00,733: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:32:01.024666870Z [2024-05-26 01:32:01,024: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:32:01.025110059Z [2024-05-26 01:32:01,024: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:32:01.029662914Z [2024-05-26 01:32:01,029: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:32:01.060605050Z [2024-05-26 01:32:01,060: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:32:01.061712679Z [2024-05-26 01:32:01,061: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:32:01.061746974Z [2024-05-26 01:32:01,061: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:32:01.061763919Z [2024-05-26 01:32:01,061: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:32:01.061891285Z [2024-05-26 01:32:01,061: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:32:01.163215005Z [2024-05-26 01:32:01,162: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:32:01.732643020Z [2024-05-26 01:32:01,732: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[225fb8ca-d698-4a49-8bab-49b92a761613] succeeded in 1.418725794999773s: None 2024-05-26T01:32:01.874058104Z [2024-05-26 01:32:01,873: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b584988a-fe32-4740-87b3-5022151e0976] succeeded in 1.5387437999997928s: None 2024-05-26T01:32:02.200362336Z [2024-05-26 01:32:02,199: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:32:02.204277036Z [2024-05-26 01:32:02,203: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:32:02.226388449Z [2024-05-26 01:32:02,226: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:32:02.227683091Z [2024-05-26 01:32:02,227: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:32:02.227924204Z [2024-05-26 01:32:02,227: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:32:02.228092453Z [2024-05-26 01:32:02,227: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:32:02.228152380Z [2024-05-26 01:32:02,228: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:32:02.228471394Z [2024-05-26 01:32:02,228: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:32:02.228667005Z [2024-05-26 01:32:02,228: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:32:02.279957375Z [2024-05-26 01:32:02,279: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:32:02.283253918Z [2024-05-26 01:32:02,282: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:32:02.301340266Z [2024-05-26 01:32:02,301: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:32:02.302635636Z [2024-05-26 01:32:02,302: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:32:02.302713376Z [2024-05-26 01:32:02,302: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:32:02.302975971Z [2024-05-26 01:32:02,302: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:32:02.303075777Z [2024-05-26 01:32:02,302: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:32:02.303354395Z [2024-05-26 01:32:02,303: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:32:02.303452624Z [2024-05-26 01:32:02,303: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:32:02.341652295Z [2024-05-26 01:32:02,341: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:32:02.401732163Z [2024-05-26 01:32:02,401: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:32:03.996044538Z [2024-05-26 01:32:03,995: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c4d739b-d795-44b9-aadf-8f398787e5cd] succeeded in 3.6688130300008197s: None 2024-05-26T01:32:04.161534049Z [2024-05-26 01:32:04,161: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b64abfb-c8cc-42e2-a043-d8b5406560ab] succeeded in 3.8482662400001573s: None 2024-05-26T01:33:00.319124022Z [2024-05-26 01:33:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f4e7edb-89bc-4350-b3b4-9f578a6aa422] received 2024-05-26T01:33:00.320822764Z [2024-05-26 01:33:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[350f51eb-3208-4e39-8d6b-e8d3b19f2e48] received 2024-05-26T01:33:00.322794657Z [2024-05-26 01:33:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ea01081-e9d3-4974-80b9-05f18efdfb8c] received 2024-05-26T01:33:00.332868675Z [2024-05-26 01:33:00,332: INFO/ForkPoolWorker-16] [350f51eb-3208-4e39-8d6b-e8d3b19f2e48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:33:00.343413662Z [2024-05-26 01:33:00,343: INFO/ForkPoolWorker-15] [4f4e7edb-89bc-4350-b3b4-9f578a6aa422] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:33:00.344063510Z [2024-05-26 01:33:00,343: INFO/ForkPoolWorker-1] [0ea01081-e9d3-4974-80b9-05f18efdfb8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:33:00.630265246Z [2024-05-26 01:33:00,627: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:33:00.666143564Z [2024-05-26 01:33:00,662: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:33:00.684107900Z [2024-05-26 01:33:00,681: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:33:00.830784734Z [2024-05-26 01:33:00,830: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:33:00.835252609Z [2024-05-26 01:33:00,834: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:33:00.868834870Z [2024-05-26 01:33:00,868: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:33:00.870798682Z [2024-05-26 01:33:00,870: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:33:00.871055274Z [2024-05-26 01:33:00,870: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:33:00.871193712Z [2024-05-26 01:33:00,871: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:33:00.871966544Z [2024-05-26 01:33:00,871: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:33:00.985070081Z [2024-05-26 01:33:00,984: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:33:01.611439398Z [2024-05-26 01:33:01,610: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0ea01081-e9d3-4974-80b9-05f18efdfb8c] succeeded in 1.2851780300006794s: None 2024-05-26T01:33:01.833898450Z [2024-05-26 01:33:01,833: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:33:01.837243787Z [2024-05-26 01:33:01,836: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:33:01.870670230Z [2024-05-26 01:33:01,870: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:33:01.872708208Z [2024-05-26 01:33:01,872: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:33:01.872925681Z [2024-05-26 01:33:01,872: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:33:01.873201964Z [2024-05-26 01:33:01,872: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:33:01.873372912Z [2024-05-26 01:33:01,873: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:33:01.873815757Z [2024-05-26 01:33:01,873: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:33:01.873965530Z [2024-05-26 01:33:01,873: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:33:01.987817269Z [2024-05-26 01:33:01,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:33:01.990245997Z [2024-05-26 01:33:01,989: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:33:01.992092801Z [2024-05-26 01:33:01,991: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:33:02.020724965Z [2024-05-26 01:33:02,020: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:33:02.022154358Z [2024-05-26 01:33:02,021: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:33:02.022314394Z [2024-05-26 01:33:02,022: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:33:02.022538559Z [2024-05-26 01:33:02,022: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:33:02.022662159Z [2024-05-26 01:33:02,022: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:33:02.022953849Z [2024-05-26 01:33:02,022: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:33:02.023091738Z [2024-05-26 01:33:02,022: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:33:02.091859822Z [2024-05-26 01:33:02,091: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:33:03.892243149Z [2024-05-26 01:33:03,891: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f4e7edb-89bc-4350-b3b4-9f578a6aa422] succeeded in 3.570642292001139s: None 2024-05-26T01:33:03.944433870Z [2024-05-26 01:33:03,943: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[350f51eb-3208-4e39-8d6b-e8d3b19f2e48] succeeded in 3.6213998059993173s: None 2024-05-26T01:34:00.320871395Z [2024-05-26 01:34:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cf20705-20d3-4bb8-8195-ad769520c390] received 2024-05-26T01:34:00.322438265Z [2024-05-26 01:34:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2834b5c-9f1f-4a2d-898d-109e7f4d37a8] received 2024-05-26T01:34:00.330008171Z [2024-05-26 01:34:00,329: INFO/ForkPoolWorker-15] [0cf20705-20d3-4bb8-8195-ad769520c390] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:34:00.330480152Z [2024-05-26 01:34:00,330: INFO/ForkPoolWorker-16] [c2834b5c-9f1f-4a2d-898d-109e7f4d37a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:34:00.346321761Z [2024-05-26 01:34:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[add48f5b-51eb-49e8-9987-34223044bc00] received 2024-05-26T01:34:00.348023122Z [2024-05-26 01:34:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dc660d1-405b-4627-8df9-8d2480c382b1] received 2024-05-26T01:34:00.372059470Z [2024-05-26 01:34:00,371: INFO/ForkPoolWorker-1] [add48f5b-51eb-49e8-9987-34223044bc00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:34:00.378302907Z [2024-05-26 01:34:00,377: INFO/ForkPoolWorker-2] [9dc660d1-405b-4627-8df9-8d2480c382b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:34:00.683749562Z [2024-05-26 01:34:00,679: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:34:00.706540665Z [2024-05-26 01:34:00,703: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:34:00.790629890Z [2024-05-26 01:34:00,787: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:34:00.886952177Z [2024-05-26 01:34:00,883: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:34:01.022158085Z [2024-05-26 01:34:01,021: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:34:01.070576844Z [2024-05-26 01:34:01,070: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:34:01.074662741Z [2024-05-26 01:34:01,074: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:34:01.100838425Z [2024-05-26 01:34:01,100: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:34:01.102071992Z [2024-05-26 01:34:01,101: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:34:01.102112915Z [2024-05-26 01:34:01,102: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:34:01.102174259Z [2024-05-26 01:34:01,102: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:34:01.102339811Z [2024-05-26 01:34:01,102: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:34:01.223577561Z [2024-05-26 01:34:01,223: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:34:01.567049919Z [2024-05-26 01:34:01,566: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0cf20705-20d3-4bb8-8195-ad769520c390] succeeded in 1.2439836989997275s: None 2024-05-26T01:34:01.847067754Z [2024-05-26 01:34:01,846: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9dc660d1-405b-4627-8df9-8d2480c382b1] succeeded in 1.4878561759996956s: None 2024-05-26T01:34:01.957054806Z [2024-05-26 01:34:01,956: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:34:01.960749100Z [2024-05-26 01:34:01,960: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:34:01.977941321Z [2024-05-26 01:34:01,977: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:34:01.979123864Z [2024-05-26 01:34:01,978: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:34:01.979401876Z [2024-05-26 01:34:01,979: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:34:01.979677846Z [2024-05-26 01:34:01,979: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:34:01.979706974Z [2024-05-26 01:34:01,979: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:34:01.979955718Z [2024-05-26 01:34:01,979: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:34:01.980079106Z [2024-05-26 01:34:01,979: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:34:01.990175561Z [2024-05-26 01:34:01,989: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:34:01.993170302Z [2024-05-26 01:34:01,992: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:34:02.012334330Z [2024-05-26 01:34:02,012: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:34:02.013464849Z [2024-05-26 01:34:02,013: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:34:02.013609556Z [2024-05-26 01:34:02,013: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:34:02.013799376Z [2024-05-26 01:34:02,013: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:34:02.013954588Z [2024-05-26 01:34:02,013: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:34:02.014267618Z [2024-05-26 01:34:02,014: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:34:02.014436554Z [2024-05-26 01:34:02,014: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:34:02.045104480Z [2024-05-26 01:34:02,044: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:34:02.087751760Z [2024-05-26 01:34:02,087: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:34:03.662994797Z [2024-05-26 01:34:03,662: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[add48f5b-51eb-49e8-9987-34223044bc00] succeeded in 3.3140176750002865s: None 2024-05-26T01:34:04.093707481Z [2024-05-26 01:34:04,093: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c2834b5c-9f1f-4a2d-898d-109e7f4d37a8] succeeded in 3.769611760000771s: None 2024-05-26T01:35:00.324504233Z [2024-05-26 01:35:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8099d4a3-3fe2-4239-b99e-f98320a2eae9] received 2024-05-26T01:35:00.325829940Z [2024-05-26 01:35:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc851187-06dd-42a9-ac7d-a8749e787f1e] received 2024-05-26T01:35:00.337886773Z [2024-05-26 01:35:00,337: INFO/ForkPoolWorker-15] [8099d4a3-3fe2-4239-b99e-f98320a2eae9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:35:00.342035836Z [2024-05-26 01:35:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05c020d3-8a90-4ae7-8065-c23ef15a2a00] received 2024-05-26T01:35:00.343639299Z [2024-05-26 01:35:00,342: INFO/ForkPoolWorker-16] [cc851187-06dd-42a9-ac7d-a8749e787f1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:35:00.351889306Z [2024-05-26 01:35:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c5ddb4a-aaae-4434-81c0-f0c14883a703] received 2024-05-26T01:35:00.357473814Z [2024-05-26 01:35:00,357: INFO/ForkPoolWorker-1] [05c020d3-8a90-4ae7-8065-c23ef15a2a00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:35:00.362899524Z [2024-05-26 01:35:00,362: INFO/ForkPoolWorker-2] [9c5ddb4a-aaae-4434-81c0-f0c14883a703] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:35:00.658763771Z [2024-05-26 01:35:00,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:35:00.680065517Z [2024-05-26 01:35:00,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:35:00.824661010Z [2024-05-26 01:35:00,821: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:35:00.828960402Z [2024-05-26 01:35:00,822: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:35:00.870348210Z [2024-05-26 01:35:00,869: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:35:00.884962546Z [2024-05-26 01:35:00,884: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:35:00.923390144Z [2024-05-26 01:35:00,923: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:35:00.925074276Z [2024-05-26 01:35:00,924: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:35:00.925247622Z [2024-05-26 01:35:00,924: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:35:00.925293872Z [2024-05-26 01:35:00,925: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:35:00.925508801Z [2024-05-26 01:35:00,925: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:35:01.033286785Z [2024-05-26 01:35:01,032: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:35:01.821229379Z [2024-05-26 01:35:01,820: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc851187-06dd-42a9-ac7d-a8749e787f1e] succeeded in 1.4940999699992972s: None 2024-05-26T01:35:01.945351750Z [2024-05-26 01:35:01,944: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:35:01.948453022Z [2024-05-26 01:35:01,948: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:35:01.980564840Z [2024-05-26 01:35:01,980: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:35:01.991483374Z [2024-05-26 01:35:01,991: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:35:01.993056225Z [2024-05-26 01:35:01,992: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:35:01.993074467Z [2024-05-26 01:35:01,992: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:35:01.993149527Z [2024-05-26 01:35:01,993: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:35:01.993246597Z [2024-05-26 01:35:01,993: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:35:01.993443411Z [2024-05-26 01:35:01,993: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:35:01.993495843Z [2024-05-26 01:35:01,993: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:35:01.995318114Z [2024-05-26 01:35:01,994: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:35:02.020925851Z [2024-05-26 01:35:02,020: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:35:02.021998952Z [2024-05-26 01:35:02,021: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:35:02.022006172Z [2024-05-26 01:35:02,021: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:35:02.022153758Z [2024-05-26 01:35:02,021: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:35:02.022160231Z [2024-05-26 01:35:02,022: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:35:02.022462166Z [2024-05-26 01:35:02,022: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:35:02.022477837Z [2024-05-26 01:35:02,022: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:35:02.082768800Z [2024-05-26 01:35:02,082: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:35:02.114117744Z [2024-05-26 01:35:02,113: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:35:02.346559388Z [2024-05-26 01:35:02,346: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:35:02.349954196Z [2024-05-26 01:35:02,349: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:35:02.376578900Z [2024-05-26 01:35:02,376: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:35:02.379775665Z [2024-05-26 01:35:02,379: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:35:02.380223202Z [2024-05-26 01:35:02,379: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:35:02.380888102Z [2024-05-26 01:35:02,380: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:35:02.382280377Z [2024-05-26 01:35:02,381: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:35:02.382890317Z [2024-05-26 01:35:02,382: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:35:02.383946827Z [2024-05-26 01:35:02,383: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:35:02.469165639Z [2024-05-26 01:35:02,468: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:35:02.706439361Z [2024-05-26 01:35:02,706: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[05c020d3-8a90-4ae7-8065-c23ef15a2a00] succeeded in 2.3604161250004836s: None 2024-05-26T01:35:02.893668887Z [2024-05-26 01:35:02,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[204cf279-88a1-4c06-9df6-f55e6cff4242] received 2024-05-26T01:35:02.904990956Z [2024-05-26 01:35:02,904: INFO/ForkPoolWorker-16] [204cf279-88a1-4c06-9df6-f55e6cff4242] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:35:03.232041571Z [2024-05-26 01:35:03,228: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:35:03.487009994Z [2024-05-26 01:35:03,486: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8099d4a3-3fe2-4239-b99e-f98320a2eae9] succeeded in 3.1591238630007865s: None 2024-05-26T01:35:04.380431090Z [2024-05-26 01:35:04,379: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9c5ddb4a-aaae-4434-81c0-f0c14883a703] succeeded in 4.0258057359988015s: None 2024-05-26T01:35:04.443220740Z [2024-05-26 01:35:04,442: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:35:04.446783621Z [2024-05-26 01:35:04,446: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:35:04.557385742Z [2024-05-26 01:35:04,557: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:35:04.565817430Z [2024-05-26 01:35:04,565: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:35:04.565899834Z [2024-05-26 01:35:04,565: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:35:04.566095313Z [2024-05-26 01:35:04,565: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:35:04.566142388Z [2024-05-26 01:35:04,566: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:35:04.566570871Z [2024-05-26 01:35:04,566: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:35:04.566623573Z [2024-05-26 01:35:04,566: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:35:04.707774635Z [2024-05-26 01:35:04,706: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:35:05.402928467Z [2024-05-26 01:35:05,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[123896ac-9cd1-4e84-a7b7-5ec8710f4d96] received 2024-05-26T01:35:05.412719242Z [2024-05-26 01:35:05,412: INFO/ForkPoolWorker-15] [123896ac-9cd1-4e84-a7b7-5ec8710f4d96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:35:05.512988095Z [2024-05-26 01:35:05,511: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[204cf279-88a1-4c06-9df6-f55e6cff4242] succeeded in 2.6166949440012104s: None 2024-05-26T01:35:05.870455061Z [2024-05-26 01:35:05,866: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:35:07.099787990Z [2024-05-26 01:35:07,099: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:35:07.102948564Z [2024-05-26 01:35:07,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:35:07.129222561Z [2024-05-26 01:35:07,128: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:35:07.131832658Z [2024-05-26 01:35:07,131: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:35:07.131905585Z [2024-05-26 01:35:07,131: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:35:07.132154584Z [2024-05-26 01:35:07,131: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:35:07.132175679Z [2024-05-26 01:35:07,132: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:35:07.132521617Z [2024-05-26 01:35:07,132: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:35:07.132662700Z [2024-05-26 01:35:07,132: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:35:07.228517216Z [2024-05-26 01:35:07,228: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:35:07.917180098Z [2024-05-26 01:35:07,916: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[123896ac-9cd1-4e84-a7b7-5ec8710f4d96] succeeded in 2.5089253969999845s: None 2024-05-26T01:35:08.072181207Z [2024-05-26 01:35:08,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc4bf1b7-e2a9-4a07-9a4a-370397f0ccf0] received 2024-05-26T01:35:08.087957364Z [2024-05-26 01:35:08,087: INFO/ForkPoolWorker-15] [dc4bf1b7-e2a9-4a07-9a4a-370397f0ccf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:35:08.358459164Z [2024-05-26 01:35:08,355: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:35:09.484954267Z [2024-05-26 01:35:09,484: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:35:09.488288109Z [2024-05-26 01:35:09,487: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:35:09.511727646Z [2024-05-26 01:35:09,511: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:35:09.513323106Z [2024-05-26 01:35:09,513: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:35:09.513482560Z [2024-05-26 01:35:09,513: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:35:09.513716115Z [2024-05-26 01:35:09,513: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:35:09.513737202Z [2024-05-26 01:35:09,513: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:35:09.514363315Z [2024-05-26 01:35:09,514: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:35:09.514493600Z [2024-05-26 01:35:09,514: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:35:09.626911108Z [2024-05-26 01:35:09,626: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:35:10.305638745Z [2024-05-26 01:35:10,305: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc4bf1b7-e2a9-4a07-9a4a-370397f0ccf0] succeeded in 2.22770299900003s: None 2024-05-26T01:36:00.698042243Z [2024-05-26 01:36:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12be6a6e-87b4-41f3-92a2-030bf350ab50] received 2024-05-26T01:36:00.703415514Z [2024-05-26 01:36:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2ef5971-b632-4354-87f8-94dd139c7160] received 2024-05-26T01:36:00.716740859Z [2024-05-26 01:36:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cb5cad0-3256-4433-9aa0-6da503470952] received 2024-05-26T01:36:00.717227198Z [2024-05-26 01:36:00,716: INFO/ForkPoolWorker-15] [12be6a6e-87b4-41f3-92a2-030bf350ab50] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:36:00.719407624Z [2024-05-26 01:36:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[703fbfbb-e51f-44c7-8be4-0db61e776ed8] received 2024-05-26T01:36:00.732559889Z [2024-05-26 01:36:00,732: INFO/ForkPoolWorker-16] [e2ef5971-b632-4354-87f8-94dd139c7160] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:36:00.742084525Z [2024-05-26 01:36:00,738: INFO/ForkPoolWorker-2] [703fbfbb-e51f-44c7-8be4-0db61e776ed8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:36:00.784316564Z [2024-05-26 01:36:00,783: INFO/ForkPoolWorker-1] [4cb5cad0-3256-4433-9aa0-6da503470952] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:36:01.088735857Z [2024-05-26 01:36:01,077: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:36:01.093599809Z [2024-05-26 01:36:01,087: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:36:01.141080266Z [2024-05-26 01:36:01,136: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:36:01.192008136Z [2024-05-26 01:36:01,188: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:36:01.440611994Z [2024-05-26 01:36:01,440: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:36:01.452714409Z [2024-05-26 01:36:01,452: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:36:01.505626483Z [2024-05-26 01:36:01,505: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:36:01.508682462Z [2024-05-26 01:36:01,507: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:36:01.508695226Z [2024-05-26 01:36:01,508: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:36:01.508699058Z [2024-05-26 01:36:01,508: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:36:01.509595604Z [2024-05-26 01:36:01,508: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:36:01.587280944Z [2024-05-26 01:36:01,587: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:36:01.634172066Z [2024-05-26 01:36:01,633: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:36:02.248653739Z [2024-05-26 01:36:02,248: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[703fbfbb-e51f-44c7-8be4-0db61e776ed8] succeeded in 1.5252385120002145s: None 2024-05-26T01:36:02.249828083Z [2024-05-26 01:36:02,249: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12be6a6e-87b4-41f3-92a2-030bf350ab50] succeeded in 1.5475275049993797s: None 2024-05-26T01:36:02.788944716Z [2024-05-26 01:36:02,788: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:36:02.792833773Z [2024-05-26 01:36:02,792: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:36:02.811767491Z [2024-05-26 01:36:02,811: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:36:02.814825452Z [2024-05-26 01:36:02,814: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:36:02.827504595Z [2024-05-26 01:36:02,827: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:36:02.830264870Z [2024-05-26 01:36:02,830: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:36:02.830277998Z [2024-05-26 01:36:02,830: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:36:02.830408555Z [2024-05-26 01:36:02,830: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:36:02.830417934Z [2024-05-26 01:36:02,830: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:36:02.830658308Z [2024-05-26 01:36:02,830: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:36:02.830667160Z [2024-05-26 01:36:02,830: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:36:02.842600624Z [2024-05-26 01:36:02,842: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:36:02.844118952Z [2024-05-26 01:36:02,843: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:36:02.844278059Z [2024-05-26 01:36:02,844: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:36:02.844481426Z [2024-05-26 01:36:02,844: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:36:02.844603856Z [2024-05-26 01:36:02,844: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:36:02.845266297Z [2024-05-26 01:36:02,845: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:36:02.845417670Z [2024-05-26 01:36:02,845: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:36:02.924722556Z [2024-05-26 01:36:02,924: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:36:02.949832073Z [2024-05-26 01:36:02,949: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:36:05.133110966Z [2024-05-26 01:36:05,132: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4cb5cad0-3256-4433-9aa0-6da503470952] succeeded in 4.412958924000122s: None 2024-05-26T01:36:05.752928855Z [2024-05-26 01:36:05,749: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2ef5971-b632-4354-87f8-94dd139c7160] succeeded in 5.042580487999658s: None 2024-05-26T01:37:01.075236619Z [2024-05-26 01:37:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61ce0ccf-b02b-4f3d-ad33-c29dfd84732f] received 2024-05-26T01:37:01.083854651Z [2024-05-26 01:37:01,083: INFO/ForkPoolWorker-15] [61ce0ccf-b02b-4f3d-ad33-c29dfd84732f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:37:01.088610562Z [2024-05-26 01:37:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[223cc58f-9d52-480a-a6e8-2e1921a7b9b1] received 2024-05-26T01:37:01.098901424Z [2024-05-26 01:37:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[969e0828-f98a-41dc-a1aa-79451de76b3e] received 2024-05-26T01:37:01.101322272Z [2024-05-26 01:37:01,101: INFO/ForkPoolWorker-16] [223cc58f-9d52-480a-a6e8-2e1921a7b9b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:37:01.107999470Z [2024-05-26 01:37:01,107: INFO/ForkPoolWorker-1] [969e0828-f98a-41dc-a1aa-79451de76b3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:37:01.382992636Z [2024-05-26 01:37:01,380: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:37:01.432027817Z [2024-05-26 01:37:01,422: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:37:01.447229764Z [2024-05-26 01:37:01,444: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:37:01.598306317Z [2024-05-26 01:37:01,597: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:37:01.602329512Z [2024-05-26 01:37:01,601: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:37:01.628886520Z [2024-05-26 01:37:01,628: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:37:01.630262913Z [2024-05-26 01:37:01,630: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:37:01.630424572Z [2024-05-26 01:37:01,630: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:37:01.630522039Z [2024-05-26 01:37:01,630: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:37:01.630841435Z [2024-05-26 01:37:01,630: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:37:01.719249149Z [2024-05-26 01:37:01,718: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:37:02.248528451Z [2024-05-26 01:37:02,248: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[969e0828-f98a-41dc-a1aa-79451de76b3e] succeeded in 1.1475296549997438s: None 2024-05-26T01:37:02.550751797Z [2024-05-26 01:37:02,550: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:37:02.554030314Z [2024-05-26 01:37:02,553: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:37:02.586224728Z [2024-05-26 01:37:02,585: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:37:02.588187636Z [2024-05-26 01:37:02,587: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:37:02.588461267Z [2024-05-26 01:37:02,588: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:37:02.588734266Z [2024-05-26 01:37:02,588: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:37:02.588929222Z [2024-05-26 01:37:02,588: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:37:02.589319999Z [2024-05-26 01:37:02,589: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:37:02.589679472Z [2024-05-26 01:37:02,589: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:37:02.644472214Z [2024-05-26 01:37:02,644: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:37:02.647461788Z [2024-05-26 01:37:02,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:37:02.672540060Z [2024-05-26 01:37:02,672: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:37:02.673907130Z [2024-05-26 01:37:02,673: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:37:02.673925725Z [2024-05-26 01:37:02,673: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:37:02.674146148Z [2024-05-26 01:37:02,673: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:37:02.674207429Z [2024-05-26 01:37:02,674: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:37:02.674796945Z [2024-05-26 01:37:02,674: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:37:02.674864167Z [2024-05-26 01:37:02,674: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:37:02.695785723Z [2024-05-26 01:37:02,695: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:37:02.768800464Z [2024-05-26 01:37:02,768: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:37:04.204255587Z [2024-05-26 01:37:04,203: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[223cc58f-9d52-480a-a6e8-2e1921a7b9b1] succeeded in 3.1129690849993494s: None 2024-05-26T01:37:04.587879181Z [2024-05-26 01:37:04,587: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61ce0ccf-b02b-4f3d-ad33-c29dfd84732f] succeeded in 3.509959004999473s: None 2024-05-26T01:38:00.979159711Z [2024-05-26 01:38:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ec79709-058f-47ee-bd03-95eccf765bb0] received 2024-05-26T01:38:00.984005666Z [2024-05-26 01:38:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[406c27df-6003-4826-b8bd-6beff192079b] received 2024-05-26T01:38:00.986610214Z [2024-05-26 01:38:00,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77154f9a-b43e-449c-83f4-efb4976f56a9] received 2024-05-26T01:38:00.994627660Z [2024-05-26 01:38:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c66e24da-81a7-4621-9e4b-37143f94db07] received 2024-05-26T01:38:00.999482429Z [2024-05-26 01:38:00,998: INFO/ForkPoolWorker-15] [7ec79709-058f-47ee-bd03-95eccf765bb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:38:01.004236637Z [2024-05-26 01:38:01,003: INFO/ForkPoolWorker-16] [406c27df-6003-4826-b8bd-6beff192079b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:38:01.011709288Z [2024-05-26 01:38:01,011: INFO/ForkPoolWorker-1] [77154f9a-b43e-449c-83f4-efb4976f56a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:38:01.019943469Z [2024-05-26 01:38:01,019: INFO/ForkPoolWorker-2] [c66e24da-81a7-4621-9e4b-37143f94db07] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:38:01.320174555Z [2024-05-26 01:38:01,317: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:38:01.322735188Z [2024-05-26 01:38:01,318: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:38:01.426129367Z [2024-05-26 01:38:01,416: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:38:01.487502237Z [2024-05-26 01:38:01,482: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:38:01.502554039Z [2024-05-26 01:38:01,502: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:38:01.509602729Z [2024-05-26 01:38:01,509: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:38:01.548850528Z [2024-05-26 01:38:01,548: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:38:01.554168801Z [2024-05-26 01:38:01,553: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:38:01.554606866Z [2024-05-26 01:38:01,554: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:38:01.554729352Z [2024-05-26 01:38:01,554: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:38:01.555008902Z [2024-05-26 01:38:01,554: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:38:01.656996093Z [2024-05-26 01:38:01,656: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:38:01.753318329Z [2024-05-26 01:38:01,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:38:02.184815878Z [2024-05-26 01:38:02,184: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c66e24da-81a7-4621-9e4b-37143f94db07] succeeded in 1.1787865810001676s: None 2024-05-26T01:38:02.322083796Z [2024-05-26 01:38:02,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ec79709-058f-47ee-bd03-95eccf765bb0] succeeded in 1.3391009689985367s: None 2024-05-26T01:38:02.645158873Z [2024-05-26 01:38:02,644: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:38:02.650140431Z [2024-05-26 01:38:02,649: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:38:02.675197549Z [2024-05-26 01:38:02,674: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:38:02.676920300Z [2024-05-26 01:38:02,676: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:38:02.677047862Z [2024-05-26 01:38:02,676: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:38:02.677209059Z [2024-05-26 01:38:02,677: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:38:02.677236526Z [2024-05-26 01:38:02,677: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:38:02.677504878Z [2024-05-26 01:38:02,677: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:38:02.677554193Z [2024-05-26 01:38:02,677: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:38:02.745462069Z [2024-05-26 01:38:02,745: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:38:02.748746096Z [2024-05-26 01:38:02,748: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:38:02.766147669Z [2024-05-26 01:38:02,765: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:38:02.767448526Z [2024-05-26 01:38:02,767: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:38:02.767611699Z [2024-05-26 01:38:02,767: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:38:02.767937529Z [2024-05-26 01:38:02,767: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:38:02.768100797Z [2024-05-26 01:38:02,767: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:38:02.768371552Z [2024-05-26 01:38:02,768: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:38:02.768509216Z [2024-05-26 01:38:02,768: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:38:02.775345327Z [2024-05-26 01:38:02,775: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:38:02.842139205Z [2024-05-26 01:38:02,841: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:38:04.815230773Z [2024-05-26 01:38:04,814: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77154f9a-b43e-449c-83f4-efb4976f56a9] succeeded in 3.82612716299991s: None 2024-05-26T01:38:05.102857388Z [2024-05-26 01:38:05,102: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[406c27df-6003-4826-b8bd-6beff192079b] succeeded in 4.116285902999152s: None 2024-05-26T01:39:00.840592852Z [2024-05-26 01:39:00,839: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c28ac7b6-7119-4c5f-9d4b-6c9fb6caa576] received 2024-05-26T01:39:00.847161698Z [2024-05-26 01:39:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a58fe6f4-a4a0-4324-b473-eb45f5eee8d0] received 2024-05-26T01:39:00.851640509Z [2024-05-26 01:39:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9955022-7787-4328-a403-8e3c2c737933] received 2024-05-26T01:39:00.859602989Z [2024-05-26 01:39:00,859: INFO/ForkPoolWorker-16] [a58fe6f4-a4a0-4324-b473-eb45f5eee8d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:39:00.865809614Z [2024-05-26 01:39:00,865: INFO/ForkPoolWorker-1] [c9955022-7787-4328-a403-8e3c2c737933] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:39:00.866325606Z [2024-05-26 01:39:00,866: INFO/ForkPoolWorker-15] [c28ac7b6-7119-4c5f-9d4b-6c9fb6caa576] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:39:01.157366714Z [2024-05-26 01:39:01,150: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:39:01.265178288Z [2024-05-26 01:39:01,261: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:39:01.266070137Z [2024-05-26 01:39:01,262: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:39:01.432436488Z [2024-05-26 01:39:01,432: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T01:39:01.436632960Z [2024-05-26 01:39:01,436: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:39:01.476668295Z [2024-05-26 01:39:01,476: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:39:01.480743579Z [2024-05-26 01:39:01,480: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:39:01.481564747Z [2024-05-26 01:39:01,481: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:39:01.481893121Z [2024-05-26 01:39:01,481: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T01:39:01.482309894Z [2024-05-26 01:39:01,482: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:39:01.625149942Z [2024-05-26 01:39:01,624: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:39:02.336012311Z [2024-05-26 01:39:02,335: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c28ac7b6-7119-4c5f-9d4b-6c9fb6caa576] succeeded in 1.4870570429993677s: None 2024-05-26T01:39:02.562351069Z [2024-05-26 01:39:02,561: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:39:02.568539633Z [2024-05-26 01:39:02,568: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:39:02.593065346Z [2024-05-26 01:39:02,592: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:39:02.594542139Z [2024-05-26 01:39:02,594: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:39:02.594582337Z [2024-05-26 01:39:02,594: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:39:02.594831797Z [2024-05-26 01:39:02,594: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:39:02.594897092Z [2024-05-26 01:39:02,594: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:39:02.595260414Z [2024-05-26 01:39:02,595: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:39:02.595280580Z [2024-05-26 01:39:02,595: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:39:02.656365296Z [2024-05-26 01:39:02,655: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:39:02.659471932Z [2024-05-26 01:39:02,659: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:39:02.682750102Z [2024-05-26 01:39:02,682: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:39:02.684390635Z [2024-05-26 01:39:02,684: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:39:02.684719631Z [2024-05-26 01:39:02,684: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:39:02.684888742Z [2024-05-26 01:39:02,684: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:39:02.684961841Z [2024-05-26 01:39:02,684: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:39:02.685234423Z [2024-05-26 01:39:02,685: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:39:02.685583939Z [2024-05-26 01:39:02,685: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:39:02.694991691Z [2024-05-26 01:39:02,694: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:39:02.785333913Z [2024-05-26 01:39:02,784: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:39:04.176045081Z [2024-05-26 01:39:04,175: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c9955022-7787-4328-a403-8e3c2c737933] succeeded in 3.318600788999902s: None 2024-05-26T01:39:04.711987166Z [2024-05-26 01:39:04,711: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a58fe6f4-a4a0-4324-b473-eb45f5eee8d0] succeeded in 3.8601480899997114s: None 2024-05-26T01:40:00.780174845Z [2024-05-26 01:40:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f534196e-acc2-4216-ac39-030622fa9026] received 2024-05-26T01:40:00.784025852Z [2024-05-26 01:40:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83ebead4-c298-4656-805f-1e357ed5e3d7] received 2024-05-26T01:40:00.794867926Z [2024-05-26 01:40:00,794: INFO/ForkPoolWorker-16] [83ebead4-c298-4656-805f-1e357ed5e3d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:40:00.795349735Z [2024-05-26 01:40:00,795: INFO/ForkPoolWorker-15] [f534196e-acc2-4216-ac39-030622fa9026] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:40:00.798576721Z [2024-05-26 01:40:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed321f75-77b3-4ea1-ae7b-24714aa0cbea] received 2024-05-26T01:40:00.809106668Z [2024-05-26 01:40:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35ba5363-2769-4bf6-ad62-1ec0208cd577] received 2024-05-26T01:40:00.813052691Z [2024-05-26 01:40:00,812: INFO/ForkPoolWorker-1] [ed321f75-77b3-4ea1-ae7b-24714aa0cbea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:40:00.817877371Z [2024-05-26 01:40:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80f20b11-d303-460a-a39a-fcf9ccf148ad] received 2024-05-26T01:40:00.822564748Z [2024-05-26 01:40:00,822: INFO/ForkPoolWorker-2] [35ba5363-2769-4bf6-ad62-1ec0208cd577] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:40:00.837761870Z [2024-05-26 01:40:00,836: INFO/ForkPoolWorker-3] [80f20b11-d303-460a-a39a-fcf9ccf148ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:40:01.254123960Z [2024-05-26 01:40:01,250: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:40:01.274193059Z [2024-05-26 01:40:01,270: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:40:01.435271989Z [2024-05-26 01:40:01,430: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:40:01.483017040Z [2024-05-26 01:40:01,477: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:40:01.499542369Z [2024-05-26 01:40:01,494: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:40:01.855174273Z [2024-05-26 01:40:01,854: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-26T01:40:01.867181169Z [2024-05-26 01:40:01,866: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:40:01.921430688Z [2024-05-26 01:40:01,921: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T01:40:01.922819760Z [2024-05-26 01:40:01,922: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:40:01.922975045Z [2024-05-26 01:40:01,922: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:40:01.923100231Z [2024-05-26 01:40:01,922: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-26T01:40:01.923341571Z [2024-05-26 01:40:01,923: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:40:02.056342561Z [2024-05-26 01:40:02,056: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:40:02.070110734Z [2024-05-26 01:40:02,069: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:40:02.628614720Z [2024-05-26 01:40:02,628: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83ebead4-c298-4656-805f-1e357ed5e3d7] succeeded in 1.8425377210005536s: None 2024-05-26T01:40:03.011274988Z [2024-05-26 01:40:03,008: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[80f20b11-d303-460a-a39a-fcf9ccf148ad] succeeded in 2.1856880049999745s: None 2024-05-26T01:40:03.112177781Z [2024-05-26 01:40:03,111: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:40:03.115224124Z [2024-05-26 01:40:03,114: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:40:03.160356223Z [2024-05-26 01:40:03,160: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:40:03.174226925Z [2024-05-26 01:40:03,167: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:40:03.174248890Z [2024-05-26 01:40:03,167: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:40:03.174255764Z [2024-05-26 01:40:03,167: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:40:03.185031918Z [2024-05-26 01:40:03,167: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:40:03.185051497Z [2024-05-26 01:40:03,182: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:40:03.185054759Z [2024-05-26 01:40:03,182: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:40:03.351883979Z [2024-05-26 01:40:03,351: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:40:03.479313412Z [2024-05-26 01:40:03,478: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:40:03.482784770Z [2024-05-26 01:40:03,482: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:40:03.509525788Z [2024-05-26 01:40:03,509: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:40:03.510716183Z [2024-05-26 01:40:03,510: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:40:03.510890823Z [2024-05-26 01:40:03,510: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:40:03.511097023Z [2024-05-26 01:40:03,510: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:40:03.511252751Z [2024-05-26 01:40:03,511: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:40:03.511629807Z [2024-05-26 01:40:03,511: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:40:03.511791765Z [2024-05-26 01:40:03,511: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:40:03.656200282Z [2024-05-26 01:40:03,655: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:40:04.409471494Z [2024-05-26 01:40:04,409: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f534196e-acc2-4216-ac39-030622fa9026] succeeded in 3.6245689379993564s: None 2024-05-26T01:40:04.469800967Z [2024-05-26 01:40:04,469: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:40:04.473179066Z [2024-05-26 01:40:04,472: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:40:04.521347867Z [2024-05-26 01:40:04,521: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:40:04.528667657Z [2024-05-26 01:40:04,528: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:40:04.528711627Z [2024-05-26 01:40:04,528: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:40:04.528918621Z [2024-05-26 01:40:04,528: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:40:04.529061270Z [2024-05-26 01:40:04,528: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:40:04.529581351Z [2024-05-26 01:40:04,529: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:40:04.529695881Z [2024-05-26 01:40:04,529: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:40:04.651143193Z [2024-05-26 01:40:04,650: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:40:05.154704421Z [2024-05-26 01:40:05,154: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[35ba5363-2769-4bf6-ad62-1ec0208cd577] succeeded in 4.340818870001385s: None 2024-05-26T01:40:05.396732834Z [2024-05-26 01:40:05,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[140fccfb-b723-4cfc-b0df-3716163c8f47] received 2024-05-26T01:40:05.423584364Z [2024-05-26 01:40:05,422: INFO/ForkPoolWorker-15] [140fccfb-b723-4cfc-b0df-3716163c8f47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:40:05.779633271Z [2024-05-26 01:40:05,776: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:40:06.498723840Z [2024-05-26 01:40:06,498: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed321f75-77b3-4ea1-ae7b-24714aa0cbea] succeeded in 5.696440957000959s: None 2024-05-26T01:40:07.136283724Z [2024-05-26 01:40:07,135: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:40:07.139234974Z [2024-05-26 01:40:07,138: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:40:07.166717952Z [2024-05-26 01:40:07,166: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:40:07.169340631Z [2024-05-26 01:40:07,168: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:40:07.169466243Z [2024-05-26 01:40:07,169: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:40:07.170098159Z [2024-05-26 01:40:07,169: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:40:07.170199598Z [2024-05-26 01:40:07,170: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:40:07.170653226Z [2024-05-26 01:40:07,170: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:40:07.170783795Z [2024-05-26 01:40:07,170: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:40:07.267597268Z [2024-05-26 01:40:07,266: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:40:07.912673525Z [2024-05-26 01:40:07,912: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[140fccfb-b723-4cfc-b0df-3716163c8f47] succeeded in 2.5062144250005076s: None 2024-05-26T01:40:08.645177315Z [2024-05-26 01:40:08,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[333e70c6-aa5e-47d6-80c2-4bc158ea9264] received 2024-05-26T01:40:08.652267902Z [2024-05-26 01:40:08,652: INFO/ForkPoolWorker-15] [333e70c6-aa5e-47d6-80c2-4bc158ea9264] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:40:08.975437139Z [2024-05-26 01:40:08,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:40:09.999993606Z [2024-05-26 01:40:09,999: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:40:10.003042142Z [2024-05-26 01:40:10,002: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:40:10.025517256Z [2024-05-26 01:40:10,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:40:10.026851311Z [2024-05-26 01:40:10,026: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:40:10.026908926Z [2024-05-26 01:40:10,026: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:40:10.027052082Z [2024-05-26 01:40:10,026: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:40:10.027100846Z [2024-05-26 01:40:10,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:40:10.027405703Z [2024-05-26 01:40:10,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:40:10.027410411Z [2024-05-26 01:40:10,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:40:10.120074438Z [2024-05-26 01:40:10,119: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:40:10.824328959Z [2024-05-26 01:40:10,823: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[333e70c6-aa5e-47d6-80c2-4bc158ea9264] succeeded in 2.1766057059994637s: None 2024-05-26T01:40:11.096524611Z [2024-05-26 01:40:11,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14222c93-d8af-48f4-9fdf-71b06ac626ae] received 2024-05-26T01:40:11.111780229Z [2024-05-26 01:40:11,111: INFO/ForkPoolWorker-15] [14222c93-d8af-48f4-9fdf-71b06ac626ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:40:11.380381821Z [2024-05-26 01:40:11,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:40:12.437506143Z [2024-05-26 01:40:12,437: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:40:12.440619935Z [2024-05-26 01:40:12,440: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:40:12.469861553Z [2024-05-26 01:40:12,469: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:40:12.472071183Z [2024-05-26 01:40:12,471: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:40:12.472310316Z [2024-05-26 01:40:12,472: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:40:12.472624971Z [2024-05-26 01:40:12,472: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:40:12.472823544Z [2024-05-26 01:40:12,472: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:40:12.473364097Z [2024-05-26 01:40:12,473: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:40:12.473555331Z [2024-05-26 01:40:12,473: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:40:12.584614815Z [2024-05-26 01:40:12,584: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:40:13.145288541Z [2024-05-26 01:40:13,144: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14222c93-d8af-48f4-9fdf-71b06ac626ae] succeeded in 2.0452910029998748s: None 2024-05-26T01:41:00.576324692Z [2024-05-26 01:41:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95e12da0-0e5f-4755-9616-8dec7345f200] received 2024-05-26T01:41:00.578040860Z [2024-05-26 01:41:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71487d22-05a4-439e-8a07-b1874ddbaa67] received 2024-05-26T01:41:00.588188106Z [2024-05-26 01:41:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45af254b-0dd3-4fc5-ac78-65dc6d05097a] received 2024-05-26T01:41:00.589274603Z [2024-05-26 01:41:00,588: INFO/ForkPoolWorker-15] [95e12da0-0e5f-4755-9616-8dec7345f200] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:41:00.592765580Z [2024-05-26 01:41:00,592: INFO/ForkPoolWorker-16] [71487d22-05a4-439e-8a07-b1874ddbaa67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:41:00.593960795Z [2024-05-26 01:41:00,593: INFO/ForkPoolWorker-1] [45af254b-0dd3-4fc5-ac78-65dc6d05097a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:41:00.985640538Z [2024-05-26 01:41:00,981: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:41:01.019008148Z [2024-05-26 01:41:01,015: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:41:01.104737743Z [2024-05-26 01:41:01,101: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:41:01.221003049Z [2024-05-26 01:41:01,220: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:41:01.225362571Z [2024-05-26 01:41:01,224: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:41:01.269046485Z [2024-05-26 01:41:01,268: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:41:01.287663882Z [2024-05-26 01:41:01,281: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:41:01.287687668Z [2024-05-26 01:41:01,285: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:41:01.287707063Z [2024-05-26 01:41:01,285: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:41:01.287710410Z [2024-05-26 01:41:01,285: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:41:01.465479624Z [2024-05-26 01:41:01,465: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:41:02.132693187Z [2024-05-26 01:41:02,132: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71487d22-05a4-439e-8a07-b1874ddbaa67] succeeded in 1.5506338290015265s: None 2024-05-26T01:41:02.387363641Z [2024-05-26 01:41:02,386: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:41:02.390547730Z [2024-05-26 01:41:02,390: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:41:02.394572295Z [2024-05-26 01:41:02,394: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:41:02.399117542Z [2024-05-26 01:41:02,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:41:02.407116729Z [2024-05-26 01:41:02,406: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:41:02.408322223Z [2024-05-26 01:41:02,408: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:41:02.408335272Z [2024-05-26 01:41:02,408: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:41:02.408492025Z [2024-05-26 01:41:02,408: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:41:02.408521919Z [2024-05-26 01:41:02,408: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:41:02.408720694Z [2024-05-26 01:41:02,408: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:41:02.408738906Z [2024-05-26 01:41:02,408: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:41:02.427698610Z [2024-05-26 01:41:02,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:41:02.429319123Z [2024-05-26 01:41:02,429: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:41:02.429407960Z [2024-05-26 01:41:02,429: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:41:02.429568084Z [2024-05-26 01:41:02,429: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:41:02.429669079Z [2024-05-26 01:41:02,429: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:41:02.430099180Z [2024-05-26 01:41:02,429: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:41:02.430129836Z [2024-05-26 01:41:02,429: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:41:02.494755905Z [2024-05-26 01:41:02,494: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:41:02.535215828Z [2024-05-26 01:41:02,534: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:41:05.057008857Z [2024-05-26 01:41:05,056: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95e12da0-0e5f-4755-9616-8dec7345f200] succeeded in 4.477799729000253s: None 2024-05-26T01:41:05.278025120Z [2024-05-26 01:41:05,277: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[45af254b-0dd3-4fc5-ac78-65dc6d05097a] succeeded in 4.688275300000896s: None 2024-05-26T01:42:01.107926298Z [2024-05-26 01:42:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a921168e-290d-4bd7-b066-dab6f4f992db] received 2024-05-26T01:42:01.110237255Z [2024-05-26 01:42:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71164ec4-b14f-488e-b7b2-1038816a243e] received 2024-05-26T01:42:01.114573846Z [2024-05-26 01:42:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37191917-3a42-40e2-8eb0-74d2e4bda3b2] received 2024-05-26T01:42:01.121150281Z [2024-05-26 01:42:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c99d0665-9fd7-4813-b050-24aa7d3edbf4] received 2024-05-26T01:42:01.121169976Z [2024-05-26 01:42:01,120: INFO/ForkPoolWorker-15] [a921168e-290d-4bd7-b066-dab6f4f992db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:42:01.131188922Z [2024-05-26 01:42:01,130: INFO/ForkPoolWorker-1] [37191917-3a42-40e2-8eb0-74d2e4bda3b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:42:01.131339476Z [2024-05-26 01:42:01,130: INFO/ForkPoolWorker-2] [c99d0665-9fd7-4813-b050-24aa7d3edbf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:42:01.132207842Z [2024-05-26 01:42:01,131: INFO/ForkPoolWorker-16] [71164ec4-b14f-488e-b7b2-1038816a243e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:42:01.410404137Z [2024-05-26 01:42:01,407: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:42:01.443026019Z [2024-05-26 01:42:01,439: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:42:01.486810527Z [2024-05-26 01:42:01,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:42:01.511984421Z [2024-05-26 01:42:01,507: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:42:01.604589597Z [2024-05-26 01:42:01,604: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:42:01.608929918Z [2024-05-26 01:42:01,608: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:42:01.637981373Z [2024-05-26 01:42:01,637: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:42:01.639189408Z [2024-05-26 01:42:01,638: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:42:01.639391328Z [2024-05-26 01:42:01,639: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:42:01.639543355Z [2024-05-26 01:42:01,639: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:42:01.639969239Z [2024-05-26 01:42:01,639: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:42:01.763188911Z [2024-05-26 01:42:01,762: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:42:01.898130513Z [2024-05-26 01:42:01,897: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:42:02.476797717Z [2024-05-26 01:42:02,476: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71164ec4-b14f-488e-b7b2-1038816a243e] succeeded in 1.364777425000284s: None 2024-05-26T01:42:02.581004776Z [2024-05-26 01:42:02,580: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37191917-3a42-40e2-8eb0-74d2e4bda3b2] succeeded in 1.4643321660005313s: None 2024-05-26T01:42:02.949013727Z [2024-05-26 01:42:02,948: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:42:02.953790484Z [2024-05-26 01:42:02,953: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:42:02.978341772Z [2024-05-26 01:42:02,978: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:42:02.979844626Z [2024-05-26 01:42:02,979: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:42:02.979974447Z [2024-05-26 01:42:02,979: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:42:02.980184070Z [2024-05-26 01:42:02,979: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:42:02.980321920Z [2024-05-26 01:42:02,980: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:42:02.980812359Z [2024-05-26 01:42:02,980: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:42:02.980979647Z [2024-05-26 01:42:02,980: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:42:02.986025129Z [2024-05-26 01:42:02,985: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:42:02.990038613Z [2024-05-26 01:42:02,989: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:42:03.007560341Z [2024-05-26 01:42:03,007: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:42:03.008718362Z [2024-05-26 01:42:03,008: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:42:03.008803317Z [2024-05-26 01:42:03,008: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:42:03.009156464Z [2024-05-26 01:42:03,008: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:42:03.009225724Z [2024-05-26 01:42:03,009: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:42:03.009453733Z [2024-05-26 01:42:03,009: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:42:03.009558647Z [2024-05-26 01:42:03,009: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:42:03.070068142Z [2024-05-26 01:42:03,069: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:42:03.102808723Z [2024-05-26 01:42:03,102: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:42:04.865166893Z [2024-05-26 01:42:04,864: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a921168e-290d-4bd7-b066-dab6f4f992db] succeeded in 3.752573966001364s: None 2024-05-26T01:42:05.202067216Z [2024-05-26 01:42:05,201: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c99d0665-9fd7-4813-b050-24aa7d3edbf4] succeeded in 4.077946871000677s: None 2024-05-26T01:43:00.389238975Z [2024-05-26 01:43:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97ae8a1b-1e43-4906-bdab-5d34ae91e0c7] received 2024-05-26T01:43:00.400733511Z [2024-05-26 01:43:00,400: INFO/ForkPoolWorker-15] [97ae8a1b-1e43-4906-bdab-5d34ae91e0c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:43:00.401024792Z [2024-05-26 01:43:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81a80305-0a6c-4791-9575-6d502fdee3d2] received 2024-05-26T01:43:00.404750558Z [2024-05-26 01:43:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e30846b0-07c5-4e19-806b-b2bdfd1e6139] received 2024-05-26T01:43:00.409150340Z [2024-05-26 01:43:00,408: INFO/ForkPoolWorker-16] [81a80305-0a6c-4791-9575-6d502fdee3d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:43:00.420944207Z [2024-05-26 01:43:00,420: INFO/ForkPoolWorker-1] [e30846b0-07c5-4e19-806b-b2bdfd1e6139] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:43:00.706583954Z [2024-05-26 01:43:00,701: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:43:00.710116856Z [2024-05-26 01:43:00,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:43:00.734591109Z [2024-05-26 01:43:00,730: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:43:00.933584152Z [2024-05-26 01:43:00,932: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:43:00.937965913Z [2024-05-26 01:43:00,937: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:43:00.988177228Z [2024-05-26 01:43:00,987: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:43:00.996168513Z [2024-05-26 01:43:00,995: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:43:00.996441992Z [2024-05-26 01:43:00,996: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:43:00.996604787Z [2024-05-26 01:43:00,996: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:43:00.996985553Z [2024-05-26 01:43:00,996: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:43:01.227030932Z [2024-05-26 01:43:01,226: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:43:01.969590332Z [2024-05-26 01:43:01,969: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:43:01.974426240Z [2024-05-26 01:43:01,973: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:43:01.982293301Z [2024-05-26 01:43:01,981: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e30846b0-07c5-4e19-806b-b2bdfd1e6139] succeeded in 1.5754615480000211s: None 2024-05-26T01:43:01.998794213Z [2024-05-26 01:43:01,998: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:43:01.999919081Z [2024-05-26 01:43:01,999: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:43:01.999950822Z [2024-05-26 01:43:01,999: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:43:02.000090397Z [2024-05-26 01:43:01,999: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:43:02.003158702Z [2024-05-26 01:43:02,000: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:43:02.003488710Z [2024-05-26 01:43:02,003: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:43:02.003631376Z [2024-05-26 01:43:02,003: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:43:02.115919298Z [2024-05-26 01:43:02,115: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:43:02.122675646Z [2024-05-26 01:43:02,122: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:43:02.125803894Z [2024-05-26 01:43:02,125: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:43:02.148800466Z [2024-05-26 01:43:02,148: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:43:02.149875097Z [2024-05-26 01:43:02,149: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:43:02.149906494Z [2024-05-26 01:43:02,149: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:43:02.150055539Z [2024-05-26 01:43:02,149: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:43:02.150071722Z [2024-05-26 01:43:02,149: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:43:02.150255591Z [2024-05-26 01:43:02,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:43:02.150294272Z [2024-05-26 01:43:02,150: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:43:02.235289907Z [2024-05-26 01:43:02,235: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:43:03.728308738Z [2024-05-26 01:43:03,727: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[81a80305-0a6c-4791-9575-6d502fdee3d2] succeeded in 3.325195815999905s: None 2024-05-26T01:43:04.188637097Z [2024-05-26 01:43:04,188: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97ae8a1b-1e43-4906-bdab-5d34ae91e0c7] succeeded in 3.7961821489989234s: None 2024-05-26T01:44:00.462017760Z [2024-05-26 01:44:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3cb194d-b29b-4589-8cf1-8bff14f5173c] received 2024-05-26T01:44:00.473035730Z [2024-05-26 01:44:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efa61b6b-41c5-41f4-aadd-b0e5991539b6] received 2024-05-26T01:44:00.475233102Z [2024-05-26 01:44:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a1e8af6-bacc-4c90-b3fc-3d95ae3b1441] received 2024-05-26T01:44:00.480154792Z [2024-05-26 01:44:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19836dc4-1489-4419-9b3e-f7d662613cda] received 2024-05-26T01:44:00.486187287Z [2024-05-26 01:44:00,485: INFO/ForkPoolWorker-15] [b3cb194d-b29b-4589-8cf1-8bff14f5173c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:44:00.487100920Z [2024-05-26 01:44:00,486: INFO/ForkPoolWorker-16] [efa61b6b-41c5-41f4-aadd-b0e5991539b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:44:00.497904132Z [2024-05-26 01:44:00,497: INFO/ForkPoolWorker-1] [6a1e8af6-bacc-4c90-b3fc-3d95ae3b1441] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:44:00.504560270Z [2024-05-26 01:44:00,504: INFO/ForkPoolWorker-2] [19836dc4-1489-4419-9b3e-f7d662613cda] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:44:00.767903542Z [2024-05-26 01:44:00,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:44:00.842090158Z [2024-05-26 01:44:00,839: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:44:00.866868814Z [2024-05-26 01:44:00,863: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:44:00.926036598Z [2024-05-26 01:44:00,921: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:44:01.027974469Z [2024-05-26 01:44:01,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:44:01.157898449Z [2024-05-26 01:44:01,157: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:44:01.162658057Z [2024-05-26 01:44:01,161: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:44:01.216619052Z [2024-05-26 01:44:01,216: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:44:01.224573783Z [2024-05-26 01:44:01,224: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:44:01.224729070Z [2024-05-26 01:44:01,224: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:44:01.224867755Z [2024-05-26 01:44:01,224: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:44:01.225125978Z [2024-05-26 01:44:01,224: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:44:01.340451833Z [2024-05-26 01:44:01,340: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:44:01.596685023Z [2024-05-26 01:44:01,596: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3cb194d-b29b-4589-8cf1-8bff14f5173c] succeeded in 1.1219073320007737s: None 2024-05-26T01:44:01.975781900Z [2024-05-26 01:44:01,975: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[19836dc4-1489-4419-9b3e-f7d662613cda] succeeded in 1.4833532430002379s: None 2024-05-26T01:44:02.113893806Z [2024-05-26 01:44:02,113: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:44:02.117056730Z [2024-05-26 01:44:02,116: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:44:02.140033711Z [2024-05-26 01:44:02,139: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:44:02.143706580Z [2024-05-26 01:44:02,143: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:44:02.156101713Z [2024-05-26 01:44:02,155: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:44:02.157450651Z [2024-05-26 01:44:02,157: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:44:02.157469584Z [2024-05-26 01:44:02,157: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:44:02.157590645Z [2024-05-26 01:44:02,157: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:44:02.157608802Z [2024-05-26 01:44:02,157: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:44:02.163087982Z [2024-05-26 01:44:02,162: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:44:02.163112632Z [2024-05-26 01:44:02,162: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:44:02.173125630Z [2024-05-26 01:44:02,172: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:44:02.174305743Z [2024-05-26 01:44:02,174: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:44:02.174325827Z [2024-05-26 01:44:02,174: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:44:02.174470305Z [2024-05-26 01:44:02,174: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:44:02.174502697Z [2024-05-26 01:44:02,174: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:44:02.179276721Z [2024-05-26 01:44:02,178: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:44:02.179304535Z [2024-05-26 01:44:02,179: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:44:02.300739723Z [2024-05-26 01:44:02,300: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:44:02.304379738Z [2024-05-26 01:44:02,304: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:44:04.261126166Z [2024-05-26 01:44:04,259: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6a1e8af6-bacc-4c90-b3fc-3d95ae3b1441] succeeded in 3.778018946000884s: None 2024-05-26T01:44:04.897701617Z [2024-05-26 01:44:04,892: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[efa61b6b-41c5-41f4-aadd-b0e5991539b6] succeeded in 4.416458829999101s: None 2024-05-26T01:45:01.193558018Z [2024-05-26 01:45:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03a3e84c-2d94-4880-a6fe-09e98cbd4d48] received 2024-05-26T01:45:01.200365100Z [2024-05-26 01:45:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b029e7b-b797-45d1-97ec-b2eda9cfd4ae] received 2024-05-26T01:45:01.207193822Z [2024-05-26 01:45:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc6fb8e1-f32a-4452-97ec-f67a9ee25166] received 2024-05-26T01:45:01.208914437Z [2024-05-26 01:45:01,208: INFO/ForkPoolWorker-15] [03a3e84c-2d94-4880-a6fe-09e98cbd4d48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:45:01.209732736Z [2024-05-26 01:45:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4941c21-97ce-44a1-a373-d67fed0480b0] received 2024-05-26T01:45:01.222513099Z [2024-05-26 01:45:01,222: INFO/ForkPoolWorker-16] [7b029e7b-b797-45d1-97ec-b2eda9cfd4ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:45:01.228060991Z [2024-05-26 01:45:01,227: INFO/ForkPoolWorker-1] [bc6fb8e1-f32a-4452-97ec-f67a9ee25166] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:45:01.230218755Z [2024-05-26 01:45:01,229: INFO/ForkPoolWorker-2] [a4941c21-97ce-44a1-a373-d67fed0480b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:45:01.735422449Z [2024-05-26 01:45:01,730: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:45:01.791802305Z [2024-05-26 01:45:01,788: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:45:01.825027993Z [2024-05-26 01:45:01,821: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:45:01.826520351Z [2024-05-26 01:45:01,822: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:45:02.005257275Z [2024-05-26 01:45:02,004: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:45:02.011008918Z [2024-05-26 01:45:02,010: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:45:02.043563841Z [2024-05-26 01:45:02,043: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:45:02.045363875Z [2024-05-26 01:45:02,045: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:45:02.045828194Z [2024-05-26 01:45:02,045: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:45:02.045871990Z [2024-05-26 01:45:02,045: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:45:02.046416281Z [2024-05-26 01:45:02,046: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:45:02.151147225Z [2024-05-26 01:45:02,150: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:45:02.776995187Z [2024-05-26 01:45:02,776: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a4941c21-97ce-44a1-a373-d67fed0480b0] succeeded in 1.5648168070001702s: None 2024-05-26T01:45:03.231002023Z [2024-05-26 01:45:03,218: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:45:03.231031106Z [2024-05-26 01:45:03,221: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:45:03.231035741Z [2024-05-26 01:45:03,222: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:45:03.231039329Z [2024-05-26 01:45:03,224: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:45:03.274284668Z [2024-05-26 01:45:03,274: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:45:03.276146347Z [2024-05-26 01:45:03,275: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:45:03.276255336Z [2024-05-26 01:45:03,276: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:45:03.276423901Z [2024-05-26 01:45:03,276: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:45:03.276512454Z [2024-05-26 01:45:03,276: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:45:03.276759459Z [2024-05-26 01:45:03,276: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:45:03.276867505Z [2024-05-26 01:45:03,276: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:45:03.280171908Z [2024-05-26 01:45:03,279: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:45:03.281671832Z [2024-05-26 01:45:03,281: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:45:03.281689922Z [2024-05-26 01:45:03,281: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:45:03.281832656Z [2024-05-26 01:45:03,281: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:45:03.281867441Z [2024-05-26 01:45:03,281: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:45:03.282568752Z [2024-05-26 01:45:03,282: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:45:03.282612330Z [2024-05-26 01:45:03,282: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:45:03.350435434Z [2024-05-26 01:45:03,350: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:45:03.354661646Z [2024-05-26 01:45:03,354: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:45:03.361872214Z [2024-05-26 01:45:03,361: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:45:03.408271883Z [2024-05-26 01:45:03,407: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:45:03.468769622Z [2024-05-26 01:45:03,464: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:45:03.468784143Z [2024-05-26 01:45:03,466: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:45:03.468791927Z [2024-05-26 01:45:03,466: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:45:03.468796461Z [2024-05-26 01:45:03,466: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:45:03.468800348Z [2024-05-26 01:45:03,466: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:45:03.468803436Z [2024-05-26 01:45:03,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:45:03.468806722Z [2024-05-26 01:45:03,467: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:45:03.640331041Z [2024-05-26 01:45:03,640: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:45:04.978304990Z [2024-05-26 01:45:04,977: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03a3e84c-2d94-4880-a6fe-09e98cbd4d48] succeeded in 3.7800766239997756s: None 2024-05-26T01:45:05.621171558Z [2024-05-26 01:45:05,620: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bc6fb8e1-f32a-4452-97ec-f67a9ee25166] succeeded in 4.408571209998627s: None 2024-05-26T01:45:05.788114613Z [2024-05-26 01:45:05,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[110b0062-452b-4f86-9feb-e15b103bae7c] received 2024-05-26T01:45:05.824542302Z [2024-05-26 01:45:05,819: INFO/ForkPoolWorker-15] [110b0062-452b-4f86-9feb-e15b103bae7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:45:06.142027190Z [2024-05-26 01:45:06,138: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:45:07.286452535Z [2024-05-26 01:45:07,286: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b029e7b-b797-45d1-97ec-b2eda9cfd4ae] succeeded in 6.078037794999545s: None 2024-05-26T01:45:07.336850139Z [2024-05-26 01:45:07,336: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:45:07.340200835Z [2024-05-26 01:45:07,339: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:45:07.369140570Z [2024-05-26 01:45:07,368: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:45:07.370694741Z [2024-05-26 01:45:07,370: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:45:07.370789948Z [2024-05-26 01:45:07,370: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:45:07.370895010Z [2024-05-26 01:45:07,370: INFO/ForkPoolWorker-15] Read VIM f7e1d808-3373-4994-873c-6da831164d2d (k8s07_dummy) 2024-05-26T01:45:07.371100639Z [2024-05-26 01:45:07,370: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f7e1d808-3373-4994-873c-6da831164d2d', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-26T01:45:07.371192614Z [2024-05-26 01:45:07,371: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:45:07.371495885Z [2024-05-26 01:45:07,371: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:45:07.371676218Z [2024-05-26 01:45:07,371: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:45:07.378707609Z [2024-05-26 01:45:07,378: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:45:07.479224367Z [2024-05-26 01:45:07,478: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:45:08.184821202Z [2024-05-26 01:45:08,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[110b0062-452b-4f86-9feb-e15b103bae7c] succeeded in 2.394449421999525s: None 2024-05-26T01:45:09.234423899Z [2024-05-26 01:45:09,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79542a67-b848-4919-99ac-4d3cb3b609fe] received 2024-05-26T01:45:09.241072962Z [2024-05-26 01:45:09,240: INFO/ForkPoolWorker-15] [79542a67-b848-4919-99ac-4d3cb3b609fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:45:09.552521104Z [2024-05-26 01:45:09,548: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:45:10.773221896Z [2024-05-26 01:45:10,768: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:45:10.773250439Z [2024-05-26 01:45:10,771: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:45:10.864990891Z [2024-05-26 01:45:10,864: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:45:10.866218349Z [2024-05-26 01:45:10,866: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:45:10.866344916Z [2024-05-26 01:45:10,866: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:45:10.866452816Z [2024-05-26 01:45:10,866: INFO/ForkPoolWorker-15] Read VIM f7e1d808-3373-4994-873c-6da831164d2d (k8s07_dummy) 2024-05-26T01:45:10.866634795Z [2024-05-26 01:45:10,866: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f7e1d808-3373-4994-873c-6da831164d2d', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-26T01:45:10.866860538Z [2024-05-26 01:45:10,866: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:45:10.867312210Z [2024-05-26 01:45:10,867: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:45:10.867428122Z [2024-05-26 01:45:10,867: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:45:10.876463793Z [2024-05-26 01:45:10,875: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:45:10.979851591Z [2024-05-26 01:45:10,979: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:45:11.552451137Z [2024-05-26 01:45:11,552: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95f68034-8136-476c-933a-17cefa0ab0f0] received 2024-05-26T01:45:11.581298205Z [2024-05-26 01:45:11,580: INFO/ForkPoolWorker-16] [95f68034-8136-476c-933a-17cefa0ab0f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:45:11.632738181Z [2024-05-26 01:45:11,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79542a67-b848-4919-99ac-4d3cb3b609fe] succeeded in 2.396214469001279s: None 2024-05-26T01:45:12.018171288Z [2024-05-26 01:45:12,014: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:45:13.324868709Z [2024-05-26 01:45:13,324: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:45:13.328010556Z [2024-05-26 01:45:13,327: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:45:13.350848204Z [2024-05-26 01:45:13,350: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:45:13.352841495Z [2024-05-26 01:45:13,352: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:45:13.352996455Z [2024-05-26 01:45:13,352: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:45:13.353198635Z [2024-05-26 01:45:13,352: INFO/ForkPoolWorker-16] Read VIM f7e1d808-3373-4994-873c-6da831164d2d (k8s07_dummy) 2024-05-26T01:45:13.353513958Z [2024-05-26 01:45:13,353: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f7e1d808-3373-4994-873c-6da831164d2d', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-26T01:45:13.353693519Z [2024-05-26 01:45:13,353: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:45:13.354173446Z [2024-05-26 01:45:13,353: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:45:13.354340441Z [2024-05-26 01:45:13,354: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:45:13.362303235Z [2024-05-26 01:45:13,362: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:45:13.429224827Z [2024-05-26 01:45:13,428: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:45:14.098490468Z [2024-05-26 01:45:14,098: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[95f68034-8136-476c-933a-17cefa0ab0f0] succeeded in 2.5397177949998877s: None 2024-05-26T01:46:01.235297088Z [2024-05-26 01:46:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cfd923c-6e75-44c2-8b7c-1aa68f921b09] received 2024-05-26T01:46:01.237638441Z [2024-05-26 01:46:01,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7061c60-431b-43c3-8d62-337ca4a5238d] received 2024-05-26T01:46:01.252425527Z [2024-05-26 01:46:01,251: INFO/ForkPoolWorker-15] [3cfd923c-6e75-44c2-8b7c-1aa68f921b09] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:46:01.255575581Z [2024-05-26 01:46:01,255: INFO/ForkPoolWorker-16] [f7061c60-431b-43c3-8d62-337ca4a5238d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:46:01.273965436Z [2024-05-26 01:46:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e477a513-cf5a-44fb-817f-ba6f66f5b27f] received 2024-05-26T01:46:01.275969351Z [2024-05-26 01:46:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c061b6b9-e22b-46b1-a415-3205cdb16afe] received 2024-05-26T01:46:01.293501261Z [2024-05-26 01:46:01,293: INFO/ForkPoolWorker-1] [e477a513-cf5a-44fb-817f-ba6f66f5b27f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:46:01.298702525Z [2024-05-26 01:46:01,298: INFO/ForkPoolWorker-2] [c061b6b9-e22b-46b1-a415-3205cdb16afe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:46:01.672865905Z [2024-05-26 01:46:01,669: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:46:01.767806400Z [2024-05-26 01:46:01,763: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:46:01.823433992Z [2024-05-26 01:46:01,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:46:01.889328704Z [2024-05-26 01:46:01,874: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:46:02.170382167Z [2024-05-26 01:46:02,169: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:46:02.174811366Z [2024-05-26 01:46:02,174: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:46:02.229369301Z [2024-05-26 01:46:02,229: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:46:02.231145643Z [2024-05-26 01:46:02,230: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:46:02.231637260Z [2024-05-26 01:46:02,231: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:46:02.232014721Z [2024-05-26 01:46:02,231: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:46:02.232465937Z [2024-05-26 01:46:02,232: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:46:02.267973891Z [2024-05-26 01:46:02,267: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:46:02.352069130Z [2024-05-26 01:46:02,351: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:46:03.080094646Z [2024-05-26 01:46:03,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3cfd923c-6e75-44c2-8b7c-1aa68f921b09] succeeded in 1.8404678570004762s: None 2024-05-26T01:46:03.363722338Z [2024-05-26 01:46:03,363: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c061b6b9-e22b-46b1-a415-3205cdb16afe] succeeded in 2.0860350650000328s: None 2024-05-26T01:46:03.453647455Z [2024-05-26 01:46:03,452: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:46:03.459290747Z [2024-05-26 01:46:03,455: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:46:03.497283929Z [2024-05-26 01:46:03,497: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:46:03.499390479Z [2024-05-26 01:46:03,499: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:46:03.499617130Z [2024-05-26 01:46:03,499: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:46:03.499797573Z [2024-05-26 01:46:03,499: INFO/ForkPoolWorker-1] Read VIM f7e1d808-3373-4994-873c-6da831164d2d (k8s07_dummy) 2024-05-26T01:46:03.500116374Z [2024-05-26 01:46:03,499: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f7e1d808-3373-4994-873c-6da831164d2d', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-26T01:46:03.501761604Z [2024-05-26 01:46:03,501: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:46:03.502119945Z [2024-05-26 01:46:03,501: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:46:03.502707635Z [2024-05-26 01:46:03,502: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:46:03.508841058Z [2024-05-26 01:46:03,508: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:46:03.588132289Z [2024-05-26 01:46:03,587: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:46:03.695158952Z [2024-05-26 01:46:03,694: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:46:03.698770801Z [2024-05-26 01:46:03,698: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:46:03.717142506Z [2024-05-26 01:46:03,716: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:46:03.718362174Z [2024-05-26 01:46:03,718: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:46:03.718376586Z [2024-05-26 01:46:03,718: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:46:03.718458786Z [2024-05-26 01:46:03,718: INFO/ForkPoolWorker-16] Read VIM f7e1d808-3373-4994-873c-6da831164d2d (k8s07_dummy) 2024-05-26T01:46:03.718588767Z [2024-05-26 01:46:03,718: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f7e1d808-3373-4994-873c-6da831164d2d', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-26T01:46:03.718656538Z [2024-05-26 01:46:03,718: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:46:03.718893810Z [2024-05-26 01:46:03,718: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:46:03.718955873Z [2024-05-26 01:46:03,718: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:46:03.723415843Z [2024-05-26 01:46:03,723: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:46:03.828966321Z [2024-05-26 01:46:03,828: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:46:05.521699569Z [2024-05-26 01:46:05,521: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e477a513-cf5a-44fb-817f-ba6f66f5b27f] succeeded in 4.245505144001072s: None 2024-05-26T01:46:05.848117838Z [2024-05-26 01:46:05,847: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7061c60-431b-43c3-8d62-337ca4a5238d] succeeded in 4.607372067999677s: None 2024-05-26T01:47:01.171439699Z [2024-05-26 01:47:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ea6b804-d865-4f8d-a733-37ee146daffa] received 2024-05-26T01:47:01.173468846Z [2024-05-26 01:47:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a36822f-b0fa-4eae-84bc-99220e1b7250] received 2024-05-26T01:47:01.175224659Z [2024-05-26 01:47:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[514e75ae-c338-4e5c-8e8e-c889c25485c9] received 2024-05-26T01:47:01.186154351Z [2024-05-26 01:47:01,185: INFO/ForkPoolWorker-15] [8ea6b804-d865-4f8d-a733-37ee146daffa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:47:01.188374655Z [2024-05-26 01:47:01,187: INFO/ForkPoolWorker-16] [4a36822f-b0fa-4eae-84bc-99220e1b7250] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:47:01.192853951Z [2024-05-26 01:47:01,192: INFO/ForkPoolWorker-1] [514e75ae-c338-4e5c-8e8e-c889c25485c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:47:01.520996101Z [2024-05-26 01:47:01,517: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:47:01.525102433Z [2024-05-26 01:47:01,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:47:01.582529801Z [2024-05-26 01:47:01,578: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:47:01.686263388Z [2024-05-26 01:47:01,685: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:47:01.690850382Z [2024-05-26 01:47:01,690: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:47:01.720513356Z [2024-05-26 01:47:01,720: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:47:01.721582046Z [2024-05-26 01:47:01,721: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:47:01.721694159Z [2024-05-26 01:47:01,721: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:47:01.721768181Z [2024-05-26 01:47:01,721: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:47:01.721995566Z [2024-05-26 01:47:01,721: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:47:01.826746820Z [2024-05-26 01:47:01,826: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:47:02.468060885Z [2024-05-26 01:47:02,467: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[514e75ae-c338-4e5c-8e8e-c889c25485c9] succeeded in 1.2896655590011505s: None 2024-05-26T01:47:02.658749952Z [2024-05-26 01:47:02,658: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:47:02.662826758Z [2024-05-26 01:47:02,662: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:47:02.688317030Z [2024-05-26 01:47:02,688: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:47:02.689726627Z [2024-05-26 01:47:02,689: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:47:02.689809726Z [2024-05-26 01:47:02,689: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:47:02.689841810Z [2024-05-26 01:47:02,689: INFO/ForkPoolWorker-15] Read VIM f7e1d808-3373-4994-873c-6da831164d2d (k8s07_dummy) 2024-05-26T01:47:02.690036311Z [2024-05-26 01:47:02,689: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f7e1d808-3373-4994-873c-6da831164d2d', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-26T01:47:02.690115583Z [2024-05-26 01:47:02,689: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:47:02.690471503Z [2024-05-26 01:47:02,690: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:47:02.690622904Z [2024-05-26 01:47:02,690: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:47:02.696340636Z [2024-05-26 01:47:02,696: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:47:02.771501159Z [2024-05-26 01:47:02,771: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:47:02.814345929Z [2024-05-26 01:47:02,813: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:47:02.817722307Z [2024-05-26 01:47:02,817: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:47:02.840048226Z [2024-05-26 01:47:02,839: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:47:02.841533107Z [2024-05-26 01:47:02,841: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:47:02.841557193Z [2024-05-26 01:47:02,841: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:47:02.841574108Z [2024-05-26 01:47:02,841: INFO/ForkPoolWorker-16] Read VIM f7e1d808-3373-4994-873c-6da831164d2d (k8s07_dummy) 2024-05-26T01:47:02.841725585Z [2024-05-26 01:47:02,841: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f7e1d808-3373-4994-873c-6da831164d2d', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-26T01:47:02.841742562Z [2024-05-26 01:47:02,841: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:47:02.842048047Z [2024-05-26 01:47:02,841: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:47:02.842090519Z [2024-05-26 01:47:02,841: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:47:02.846993605Z [2024-05-26 01:47:02,846: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:47:02.937784587Z [2024-05-26 01:47:02,937: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:47:04.701860504Z [2024-05-26 01:47:04,701: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a36822f-b0fa-4eae-84bc-99220e1b7250] succeeded in 3.5259105829991313s: None 2024-05-26T01:47:05.168445694Z [2024-05-26 01:47:05,168: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8ea6b804-d865-4f8d-a733-37ee146daffa] succeeded in 3.994876224998734s: None 2024-05-26T01:48:01.132525490Z [2024-05-26 01:48:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdb039ca-e7c0-4c1c-a99b-de531d2c046b] received 2024-05-26T01:48:01.149057027Z [2024-05-26 01:48:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d038ac5a-25d8-44b9-a92e-91bfb4eeaa68] received 2024-05-26T01:48:01.159133657Z [2024-05-26 01:48:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b79d93d4-20be-4549-8983-1bf0f4f9ba5f] received 2024-05-26T01:48:01.161792065Z [2024-05-26 01:48:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60928454-2341-4847-9373-cbc759fdc15e] received 2024-05-26T01:48:01.161917574Z [2024-05-26 01:48:01,161: INFO/ForkPoolWorker-16] [d038ac5a-25d8-44b9-a92e-91bfb4eeaa68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:48:01.164887063Z [2024-05-26 01:48:01,164: INFO/ForkPoolWorker-15] [cdb039ca-e7c0-4c1c-a99b-de531d2c046b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:48:01.170916007Z [2024-05-26 01:48:01,170: INFO/ForkPoolWorker-1] [b79d93d4-20be-4549-8983-1bf0f4f9ba5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:48:01.180392126Z [2024-05-26 01:48:01,179: INFO/ForkPoolWorker-2] [60928454-2341-4847-9373-cbc759fdc15e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:48:01.541756558Z [2024-05-26 01:48:01,538: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:48:01.624006796Z [2024-05-26 01:48:01,620: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:48:01.653926509Z [2024-05-26 01:48:01,647: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:48:01.655394158Z [2024-05-26 01:48:01,651: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:48:01.922714532Z [2024-05-26 01:48:01,922: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:48:02.295222496Z [2024-05-26 01:48:02,294: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:48:02.303316499Z [2024-05-26 01:48:02,302: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:48:02.497859236Z [2024-05-26 01:48:02,497: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:48:02.500205379Z [2024-05-26 01:48:02,499: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:48:02.500383361Z [2024-05-26 01:48:02,500: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:48:02.500534555Z [2024-05-26 01:48:02,500: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:48:02.500809105Z [2024-05-26 01:48:02,500: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:48:02.717930331Z [2024-05-26 01:48:02,717: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:48:02.832515093Z [2024-05-26 01:48:02,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cdb039ca-e7c0-4c1c-a99b-de531d2c046b] succeeded in 1.6812029009997786s: None 2024-05-26T01:48:03.415757174Z [2024-05-26 01:48:03,411: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:48:03.415809718Z [2024-05-26 01:48:03,414: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:48:03.434405945Z [2024-05-26 01:48:03,426: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[60928454-2341-4847-9373-cbc759fdc15e] succeeded in 2.2624353989995143s: None 2024-05-26T01:48:03.453642980Z [2024-05-26 01:48:03,453: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:48:03.459603657Z [2024-05-26 01:48:03,456: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:48:03.473722904Z [2024-05-26 01:48:03,473: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:48:03.474847583Z [2024-05-26 01:48:03,474: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:48:03.474874015Z [2024-05-26 01:48:03,474: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:48:03.474978506Z [2024-05-26 01:48:03,474: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:48:03.475029220Z [2024-05-26 01:48:03,474: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:48:03.475204983Z [2024-05-26 01:48:03,475: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:48:03.475244535Z [2024-05-26 01:48:03,475: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:48:03.489215394Z [2024-05-26 01:48:03,489: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:48:03.490616833Z [2024-05-26 01:48:03,490: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:48:03.490663477Z [2024-05-26 01:48:03,490: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:48:03.490751057Z [2024-05-26 01:48:03,490: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:48:03.490796568Z [2024-05-26 01:48:03,490: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:48:03.490998075Z [2024-05-26 01:48:03,490: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:48:03.491036542Z [2024-05-26 01:48:03,490: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:48:03.559602441Z [2024-05-26 01:48:03,559: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:48:03.566041808Z [2024-05-26 01:48:03,565: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:48:05.266742371Z [2024-05-26 01:48:05,265: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b79d93d4-20be-4549-8983-1bf0f4f9ba5f] succeeded in 4.10443036900142s: None 2024-05-26T01:48:05.828059763Z [2024-05-26 01:48:05,827: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d038ac5a-25d8-44b9-a92e-91bfb4eeaa68] succeeded in 4.675469347999751s: None 2024-05-26T01:49:00.956274317Z [2024-05-26 01:49:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2ec7924-8c3c-4281-a3e8-dc8484b84fdd] received 2024-05-26T01:49:00.958007096Z [2024-05-26 01:49:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cf8072a-a4b4-491c-982a-0202a7fb429a] received 2024-05-26T01:49:00.959591384Z [2024-05-26 01:49:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6503134b-243a-4f77-bab4-59861107af5a] received 2024-05-26T01:49:00.973494194Z [2024-05-26 01:49:00,973: INFO/ForkPoolWorker-16] [4cf8072a-a4b4-491c-982a-0202a7fb429a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:49:00.974844027Z [2024-05-26 01:49:00,973: INFO/ForkPoolWorker-15] [d2ec7924-8c3c-4281-a3e8-dc8484b84fdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:49:00.976458795Z [2024-05-26 01:49:00,976: INFO/ForkPoolWorker-1] [6503134b-243a-4f77-bab4-59861107af5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:49:01.272079509Z [2024-05-26 01:49:01,264: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:49:01.273855700Z [2024-05-26 01:49:01,270: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:49:01.278962650Z [2024-05-26 01:49:01,275: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:49:01.505654806Z [2024-05-26 01:49:01,505: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:49:01.509744424Z [2024-05-26 01:49:01,509: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:49:01.529398724Z [2024-05-26 01:49:01,529: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:49:01.530462578Z [2024-05-26 01:49:01,530: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:49:01.530666478Z [2024-05-26 01:49:01,530: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:49:01.530756029Z [2024-05-26 01:49:01,530: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:49:01.531016149Z [2024-05-26 01:49:01,530: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:49:01.627605933Z [2024-05-26 01:49:01,627: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:49:02.301432017Z [2024-05-26 01:49:02,300: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6503134b-243a-4f77-bab4-59861107af5a] succeeded in 1.3386840960010886s: None 2024-05-26T01:49:02.416535891Z [2024-05-26 01:49:02,416: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:49:02.423826908Z [2024-05-26 01:49:02,419: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:49:02.434559509Z [2024-05-26 01:49:02,434: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:49:02.437905729Z [2024-05-26 01:49:02,437: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:49:02.454050150Z [2024-05-26 01:49:02,453: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:49:02.455664526Z [2024-05-26 01:49:02,455: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:49:02.455870839Z [2024-05-26 01:49:02,455: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:49:02.456090706Z [2024-05-26 01:49:02,455: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:49:02.456387996Z [2024-05-26 01:49:02,456: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:49:02.456815905Z [2024-05-26 01:49:02,456: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:49:02.456888378Z [2024-05-26 01:49:02,456: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:49:02.458176886Z [2024-05-26 01:49:02,457: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:49:02.459376552Z [2024-05-26 01:49:02,459: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:49:02.459428250Z [2024-05-26 01:49:02,459: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:49:02.459777727Z [2024-05-26 01:49:02,459: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:49:02.459916778Z [2024-05-26 01:49:02,459: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:49:02.460191153Z [2024-05-26 01:49:02,460: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:49:02.460332700Z [2024-05-26 01:49:02,460: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:49:02.529847039Z [2024-05-26 01:49:02,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:49:02.530982355Z [2024-05-26 01:49:02,530: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:49:04.538004356Z [2024-05-26 01:49:04,537: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4cf8072a-a4b4-491c-982a-0202a7fb429a] succeeded in 3.5751753429995006s: None 2024-05-26T01:49:05.037206596Z [2024-05-26 01:49:05,036: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2ec7924-8c3c-4281-a3e8-dc8484b84fdd] succeeded in 4.077644352000789s: None 2024-05-26T01:50:00.399409874Z [2024-05-26 01:50:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a684287-841f-4cc9-8efc-c0562c7277e5] received 2024-05-26T01:50:00.404072728Z [2024-05-26 01:50:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[432edbf3-8769-420a-adeb-4549cbeed90f] received 2024-05-26T01:50:00.413587082Z [2024-05-26 01:50:00,413: INFO/ForkPoolWorker-15] [5a684287-841f-4cc9-8efc-c0562c7277e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:50:00.416412968Z [2024-05-26 01:50:00,416: INFO/ForkPoolWorker-16] [432edbf3-8769-420a-adeb-4549cbeed90f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:50:00.423119984Z [2024-05-26 01:50:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e204b8bc-128f-44e3-bbac-cdd862bcf00c] received 2024-05-26T01:50:00.431329261Z [2024-05-26 01:50:00,431: INFO/ForkPoolWorker-1] [e204b8bc-128f-44e3-bbac-cdd862bcf00c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:50:00.432369208Z [2024-05-26 01:50:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82a6822d-285d-4a7a-a63d-d599afbb53ad] received 2024-05-26T01:50:00.443690628Z [2024-05-26 01:50:00,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f9a22c1-7a68-4e42-98b9-d27481067b99] received 2024-05-26T01:50:00.459703507Z [2024-05-26 01:50:00,459: INFO/ForkPoolWorker-2] [82a6822d-285d-4a7a-a63d-d599afbb53ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:50:00.473853055Z [2024-05-26 01:50:00,473: INFO/ForkPoolWorker-3] [9f9a22c1-7a68-4e42-98b9-d27481067b99] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:50:00.815836851Z [2024-05-26 01:50:00,788: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:50:00.938282127Z [2024-05-26 01:50:00,934: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:50:01.009500377Z [2024-05-26 01:50:00,988: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:50:01.139060731Z [2024-05-26 01:50:01,111: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:50:01.145875151Z [2024-05-26 01:50:01,141: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:50:01.220109097Z [2024-05-26 01:50:01,219: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:50:01.690732770Z [2024-05-26 01:50:01,690: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-26T01:50:01.723327041Z [2024-05-26 01:50:01,722: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:50:01.803614634Z [2024-05-26 01:50:01,803: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T01:50:01.805994713Z [2024-05-26 01:50:01,805: INFO/ForkPoolWorker-3] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:50:01.806053924Z [2024-05-26 01:50:01,805: INFO/ForkPoolWorker-3] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:50:01.806058959Z [2024-05-26 01:50:01,805: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-26T01:50:01.806251099Z [2024-05-26 01:50:01,806: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:50:01.913093856Z [2024-05-26 01:50:01,912: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:50:02.192091002Z [2024-05-26 01:50:02,191: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e204b8bc-128f-44e3-bbac-cdd862bcf00c] succeeded in 1.7661810909994529s: None 2024-05-26T01:50:02.569072659Z [2024-05-26 01:50:02,568: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9f9a22c1-7a68-4e42-98b9-d27481067b99] succeeded in 2.1166274740007793s: None 2024-05-26T01:50:02.732401196Z [2024-05-26 01:50:02,732: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:50:02.735903809Z [2024-05-26 01:50:02,735: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:50:02.776969082Z [2024-05-26 01:50:02,776: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:50:02.778961608Z [2024-05-26 01:50:02,778: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:50:02.779211956Z [2024-05-26 01:50:02,778: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:50:02.779601760Z [2024-05-26 01:50:02,779: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:50:02.779791117Z [2024-05-26 01:50:02,779: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:50:02.780188463Z [2024-05-26 01:50:02,780: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:50:02.780358959Z [2024-05-26 01:50:02,780: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:50:02.832976085Z [2024-05-26 01:50:02,832: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:50:02.836422031Z [2024-05-26 01:50:02,835: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:50:02.867684023Z [2024-05-26 01:50:02,867: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:50:02.876275412Z [2024-05-26 01:50:02,875: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:50:02.876294042Z [2024-05-26 01:50:02,876: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:50:02.876508323Z [2024-05-26 01:50:02,876: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:50:02.876573159Z [2024-05-26 01:50:02,876: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:50:02.876872519Z [2024-05-26 01:50:02,876: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:50:02.877209461Z [2024-05-26 01:50:02,876: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:50:02.889075206Z [2024-05-26 01:50:02,888: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:50:02.892089744Z [2024-05-26 01:50:02,891: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:50:02.894163210Z [2024-05-26 01:50:02,893: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:50:02.921308156Z [2024-05-26 01:50:02,921: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:50:02.922446457Z [2024-05-26 01:50:02,922: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:50:02.922538125Z [2024-05-26 01:50:02,922: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:50:02.922714039Z [2024-05-26 01:50:02,922: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:50:02.922768688Z [2024-05-26 01:50:02,922: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:50:02.923066431Z [2024-05-26 01:50:02,922: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:50:02.923231103Z [2024-05-26 01:50:02,923: INFO/ForkPoolWorker-2] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:50:02.975090913Z [2024-05-26 01:50:02,974: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:50:03.013898552Z [2024-05-26 01:50:03,013: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:50:03.829235983Z [2024-05-26 01:50:03,828: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a684287-841f-4cc9-8efc-c0562c7277e5] succeeded in 3.42683155099985s: None 2024-05-26T01:50:03.955598790Z [2024-05-26 01:50:03,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffdc976e-ee4a-4def-9124-0f834a068db5] received 2024-05-26T01:50:03.969449586Z [2024-05-26 01:50:03,969: INFO/ForkPoolWorker-15] [ffdc976e-ee4a-4def-9124-0f834a068db5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:50:04.379534068Z [2024-05-26 01:50:04,376: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:50:04.838093823Z [2024-05-26 01:50:04,837: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[82a6822d-285d-4a7a-a63d-d599afbb53ad] succeeded in 4.403419923999536s: None 2024-05-26T01:50:05.124656033Z [2024-05-26 01:50:05,124: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[432edbf3-8769-420a-adeb-4549cbeed90f] succeeded in 4.718458842000473s: None 2024-05-26T01:50:05.953712639Z [2024-05-26 01:50:05,953: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:50:05.957142210Z [2024-05-26 01:50:05,956: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:50:05.988108258Z [2024-05-26 01:50:05,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:50:05.989499117Z [2024-05-26 01:50:05,989: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:50:05.989514057Z [2024-05-26 01:50:05,989: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:50:05.989641080Z [2024-05-26 01:50:05,989: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:50:05.989649224Z [2024-05-26 01:50:05,989: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:50:05.989879380Z [2024-05-26 01:50:05,989: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:50:05.990071802Z [2024-05-26 01:50:05,989: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:50:06.106978819Z [2024-05-26 01:50:06,106: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:50:06.861160186Z [2024-05-26 01:50:06,854: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffdc976e-ee4a-4def-9124-0f834a068db5] succeeded in 2.8915526809996663s: None 2024-05-26T01:50:07.261007666Z [2024-05-26 01:50:07,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed0664cd-bda9-4d28-a84c-93f5327010e6] received 2024-05-26T01:50:07.276287115Z [2024-05-26 01:50:07,276: INFO/ForkPoolWorker-15] [ed0664cd-bda9-4d28-a84c-93f5327010e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:50:07.623027245Z [2024-05-26 01:50:07,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:50:08.873291103Z [2024-05-26 01:50:08,872: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:50:08.878257329Z [2024-05-26 01:50:08,876: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:50:08.911052917Z [2024-05-26 01:50:08,910: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:50:08.912364674Z [2024-05-26 01:50:08,912: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:50:08.912486669Z [2024-05-26 01:50:08,912: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:50:08.912664275Z [2024-05-26 01:50:08,912: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:50:08.912718707Z [2024-05-26 01:50:08,912: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:50:08.913270239Z [2024-05-26 01:50:08,913: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:50:08.913324267Z [2024-05-26 01:50:08,913: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:50:08.998259482Z [2024-05-26 01:50:08,997: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:50:09.611575173Z [2024-05-26 01:50:09,610: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed0664cd-bda9-4d28-a84c-93f5327010e6] succeeded in 2.348318668000502s: None 2024-05-26T01:50:09.659271253Z [2024-05-26 01:50:09,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c754c2f7-f4a5-42b5-98ea-b6c366aa151b] received 2024-05-26T01:50:09.681494403Z [2024-05-26 01:50:09,681: INFO/ForkPoolWorker-15] [c754c2f7-f4a5-42b5-98ea-b6c366aa151b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:50:09.958055504Z [2024-05-26 01:50:09,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:50:11.065774627Z [2024-05-26 01:50:11,065: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:50:11.069402452Z [2024-05-26 01:50:11,068: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:50:11.106720578Z [2024-05-26 01:50:11,106: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:50:11.109714145Z [2024-05-26 01:50:11,108: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:50:11.109779232Z [2024-05-26 01:50:11,109: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:50:11.109786700Z [2024-05-26 01:50:11,109: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:50:11.109793580Z [2024-05-26 01:50:11,109: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:50:11.110369000Z [2024-05-26 01:50:11,110: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:50:11.110665708Z [2024-05-26 01:50:11,110: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:50:11.215060618Z [2024-05-26 01:50:11,214: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:50:11.824650636Z [2024-05-26 01:50:11,824: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c754c2f7-f4a5-42b5-98ea-b6c366aa151b] succeeded in 2.1499453940014064s: None 2024-05-26T01:51:00.653853953Z [2024-05-26 01:51:00,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55770048-341d-45bf-b7e0-d80558f04a40] received 2024-05-26T01:51:00.661763600Z [2024-05-26 01:51:00,661: INFO/ForkPoolWorker-15] [55770048-341d-45bf-b7e0-d80558f04a40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:51:00.672773990Z [2024-05-26 01:51:00,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c2e957e-12a8-4575-aaad-d164aec06dec] received 2024-05-26T01:51:00.674104533Z [2024-05-26 01:51:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63113af4-239f-4874-9299-0ac36541faa2] received 2024-05-26T01:51:00.683327199Z [2024-05-26 01:51:00,683: INFO/ForkPoolWorker-16] [2c2e957e-12a8-4575-aaad-d164aec06dec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:51:00.693771866Z [2024-05-26 01:51:00,693: INFO/ForkPoolWorker-1] [63113af4-239f-4874-9299-0ac36541faa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:51:00.964044985Z [2024-05-26 01:51:00,961: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:51:00.990179608Z [2024-05-26 01:51:00,987: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:51:01.070942542Z [2024-05-26 01:51:01,066: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:51:01.270356615Z [2024-05-26 01:51:01,269: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:51:01.275632248Z [2024-05-26 01:51:01,275: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:51:01.304874276Z [2024-05-26 01:51:01,304: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:51:01.306173601Z [2024-05-26 01:51:01,305: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:51:01.306401623Z [2024-05-26 01:51:01,306: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:51:01.306618957Z [2024-05-26 01:51:01,306: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:51:01.306940093Z [2024-05-26 01:51:01,306: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:51:01.437735408Z [2024-05-26 01:51:01,437: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:51:02.054511622Z [2024-05-26 01:51:02,054: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:51:02.055866082Z [2024-05-26 01:51:02,054: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[63113af4-239f-4874-9299-0ac36541faa2] succeeded in 1.3760064439993585s: None 2024-05-26T01:51:02.060746962Z [2024-05-26 01:51:02,058: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:51:02.099047167Z [2024-05-26 01:51:02,096: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:51:02.101445857Z [2024-05-26 01:51:02,099: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:51:02.101461652Z [2024-05-26 01:51:02,100: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:51:02.101465768Z [2024-05-26 01:51:02,100: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:51:02.101469473Z [2024-05-26 01:51:02,100: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:51:02.105960146Z [2024-05-26 01:51:02,105: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:51:02.105973485Z [2024-05-26 01:51:02,105: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:51:02.154228425Z [2024-05-26 01:51:02,153: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:51:02.157479363Z [2024-05-26 01:51:02,157: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:51:02.176310215Z [2024-05-26 01:51:02,176: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:51:02.177911407Z [2024-05-26 01:51:02,177: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:51:02.178084224Z [2024-05-26 01:51:02,177: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:51:02.178297759Z [2024-05-26 01:51:02,178: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:51:02.178438642Z [2024-05-26 01:51:02,178: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:51:02.178808841Z [2024-05-26 01:51:02,178: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:51:02.178955774Z [2024-05-26 01:51:02,178: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:51:02.184946638Z [2024-05-26 01:51:02,184: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:51:02.258761066Z [2024-05-26 01:51:02,258: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:51:04.077357448Z [2024-05-26 01:51:04,076: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2c2e957e-12a8-4575-aaad-d164aec06dec] succeeded in 3.401875535000727s: None 2024-05-26T01:51:04.403269913Z [2024-05-26 01:51:04,402: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55770048-341d-45bf-b7e0-d80558f04a40] succeeded in 3.7477805239996087s: None 2024-05-26T01:52:00.601084958Z [2024-05-26 01:52:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6f69a60-a8f7-451b-bb0b-dc7b91858de0] received 2024-05-26T01:52:00.604764552Z [2024-05-26 01:52:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bebd8295-866c-4763-8859-afa4d0290c59] received 2024-05-26T01:52:00.607444423Z [2024-05-26 01:52:00,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e12c1e77-d446-4ea3-a8af-872458a0a63d] received 2024-05-26T01:52:00.609908654Z [2024-05-26 01:52:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0350d8b-3a5f-4c1d-ac46-5e2be2ab05e3] received 2024-05-26T01:52:00.626103915Z [2024-05-26 01:52:00,625: INFO/ForkPoolWorker-16] [bebd8295-866c-4763-8859-afa4d0290c59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:52:00.626864802Z [2024-05-26 01:52:00,626: INFO/ForkPoolWorker-15] [c6f69a60-a8f7-451b-bb0b-dc7b91858de0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:52:00.627280646Z [2024-05-26 01:52:00,626: INFO/ForkPoolWorker-1] [e12c1e77-d446-4ea3-a8af-872458a0a63d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:52:00.628377254Z [2024-05-26 01:52:00,628: INFO/ForkPoolWorker-2] [c0350d8b-3a5f-4c1d-ac46-5e2be2ab05e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:52:00.940800925Z [2024-05-26 01:52:00,935: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:52:00.999009018Z [2024-05-26 01:52:00,994: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:52:01.014000167Z [2024-05-26 01:52:01,008: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:52:01.015996417Z [2024-05-26 01:52:01,009: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:52:01.145232159Z [2024-05-26 01:52:01,144: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:52:01.153792817Z [2024-05-26 01:52:01,153: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:52:01.197064104Z [2024-05-26 01:52:01,196: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:52:01.204530852Z [2024-05-26 01:52:01,204: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:52:01.204571668Z [2024-05-26 01:52:01,204: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:52:01.204576328Z [2024-05-26 01:52:01,204: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:52:01.204838589Z [2024-05-26 01:52:01,204: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:52:01.382285843Z [2024-05-26 01:52:01,381: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:52:01.404000230Z [2024-05-26 01:52:01,403: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:52:02.031049642Z [2024-05-26 01:52:02,029: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e12c1e77-d446-4ea3-a8af-872458a0a63d] succeeded in 1.4173651640012395s: None 2024-05-26T01:52:02.098535174Z [2024-05-26 01:52:02,096: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6f69a60-a8f7-451b-bb0b-dc7b91858de0] succeeded in 1.4857034899996506s: None 2024-05-26T01:52:02.405738032Z [2024-05-26 01:52:02,405: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:52:02.409376327Z [2024-05-26 01:52:02,408: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:52:02.443026856Z [2024-05-26 01:52:02,442: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:52:02.444687560Z [2024-05-26 01:52:02,444: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:52:02.444861177Z [2024-05-26 01:52:02,444: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:52:02.445116483Z [2024-05-26 01:52:02,444: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:52:02.445322983Z [2024-05-26 01:52:02,445: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:52:02.445670670Z [2024-05-26 01:52:02,445: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:52:02.445901502Z [2024-05-26 01:52:02,445: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:52:02.507779197Z [2024-05-26 01:52:02,507: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:52:02.511450811Z [2024-05-26 01:52:02,510: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:52:02.532025706Z [2024-05-26 01:52:02,531: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:52:02.536316552Z [2024-05-26 01:52:02,536: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:52:02.537756426Z [2024-05-26 01:52:02,537: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:52:02.537908663Z [2024-05-26 01:52:02,537: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:52:02.538145020Z [2024-05-26 01:52:02,537: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:52:02.538284085Z [2024-05-26 01:52:02,538: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:52:02.538734693Z [2024-05-26 01:52:02,538: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:52:02.538854786Z [2024-05-26 01:52:02,538: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:52:02.653119993Z [2024-05-26 01:52:02,652: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:52:04.285153248Z [2024-05-26 01:52:04,284: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bebd8295-866c-4763-8859-afa4d0290c59] succeeded in 3.674992263000604s: None 2024-05-26T01:52:04.748474626Z [2024-05-26 01:52:04,748: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c0350d8b-3a5f-4c1d-ac46-5e2be2ab05e3] succeeded in 4.133372878000955s: None 2024-05-26T01:53:00.560989482Z [2024-05-26 01:53:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72bd3705-21d5-4e0d-a29b-04d7712e8ba9] received 2024-05-26T01:53:00.564158159Z [2024-05-26 01:53:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[438fbe04-3851-49b8-81cd-fe6190e20cc1] received 2024-05-26T01:53:00.565717919Z [2024-05-26 01:53:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc901abb-14af-48c9-85b8-028cc60a5ec4] received 2024-05-26T01:53:00.569101212Z [2024-05-26 01:53:00,568: INFO/ForkPoolWorker-15] [72bd3705-21d5-4e0d-a29b-04d7712e8ba9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:53:00.590806827Z [2024-05-26 01:53:00,590: INFO/ForkPoolWorker-1] [fc901abb-14af-48c9-85b8-028cc60a5ec4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:53:00.591703792Z [2024-05-26 01:53:00,591: INFO/ForkPoolWorker-16] [438fbe04-3851-49b8-81cd-fe6190e20cc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:53:00.899029014Z [2024-05-26 01:53:00,893: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:53:00.906458572Z [2024-05-26 01:53:00,902: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:53:00.910817202Z [2024-05-26 01:53:00,907: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:53:01.076717273Z [2024-05-26 01:53:01,076: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:53:01.080985492Z [2024-05-26 01:53:01,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:53:01.132715255Z [2024-05-26 01:53:01,132: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:53:01.134295431Z [2024-05-26 01:53:01,133: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:53:01.134685066Z [2024-05-26 01:53:01,134: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:53:01.134966169Z [2024-05-26 01:53:01,134: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:53:01.135561344Z [2024-05-26 01:53:01,135: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:53:01.243421660Z [2024-05-26 01:53:01,243: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:53:01.844903175Z [2024-05-26 01:53:01,844: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc901abb-14af-48c9-85b8-028cc60a5ec4] succeeded in 1.274911919999795s: None 2024-05-26T01:53:02.030544210Z [2024-05-26 01:53:02,030: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:53:02.033822802Z [2024-05-26 01:53:02,033: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:53:02.053285162Z [2024-05-26 01:53:02,053: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:53:02.054670217Z [2024-05-26 01:53:02,054: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:53:02.054826694Z [2024-05-26 01:53:02,054: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:53:02.055014845Z [2024-05-26 01:53:02,054: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:53:02.055085408Z [2024-05-26 01:53:02,055: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:53:02.055404890Z [2024-05-26 01:53:02,055: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:53:02.055881175Z [2024-05-26 01:53:02,055: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:53:02.139345535Z [2024-05-26 01:53:02,139: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:53:02.212740306Z [2024-05-26 01:53:02,212: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:53:02.216008468Z [2024-05-26 01:53:02,215: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:53:02.241176430Z [2024-05-26 01:53:02,240: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:53:02.242906050Z [2024-05-26 01:53:02,242: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:53:02.242919920Z [2024-05-26 01:53:02,242: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:53:02.243166937Z [2024-05-26 01:53:02,242: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:53:02.243184744Z [2024-05-26 01:53:02,243: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:53:02.243609247Z [2024-05-26 01:53:02,243: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:53:02.244174891Z [2024-05-26 01:53:02,243: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:53:02.321021996Z [2024-05-26 01:53:02,320: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:53:03.697049706Z [2024-05-26 01:53:03,695: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[438fbe04-3851-49b8-81cd-fe6190e20cc1] succeeded in 3.1247252129996923s: None 2024-05-26T01:53:04.409352781Z [2024-05-26 01:53:04,408: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72bd3705-21d5-4e0d-a29b-04d7712e8ba9] succeeded in 3.8465905120010575s: None 2024-05-26T01:54:00.423790886Z [2024-05-26 01:54:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c79afae7-c5c4-477c-bf9f-bb841c961feb] received 2024-05-26T01:54:00.429364972Z [2024-05-26 01:54:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4eec52a3-6036-4ecf-842d-790e16afedce] received 2024-05-26T01:54:00.435351637Z [2024-05-26 01:54:00,434: INFO/ForkPoolWorker-15] [c79afae7-c5c4-477c-bf9f-bb841c961feb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:54:00.435711567Z [2024-05-26 01:54:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f69f08d-51af-4024-b927-bb500fb351d2] received 2024-05-26T01:54:00.438677468Z [2024-05-26 01:54:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5de1458d-3f14-4351-868e-ffea861eb434] received 2024-05-26T01:54:00.439171316Z [2024-05-26 01:54:00,438: INFO/ForkPoolWorker-16] [4eec52a3-6036-4ecf-842d-790e16afedce] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:54:00.469480981Z [2024-05-26 01:54:00,469: INFO/ForkPoolWorker-1] [2f69f08d-51af-4024-b927-bb500fb351d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:54:00.472506959Z [2024-05-26 01:54:00,472: INFO/ForkPoolWorker-2] [5de1458d-3f14-4351-868e-ffea861eb434] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:54:00.870533440Z [2024-05-26 01:54:00,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:54:00.887177267Z [2024-05-26 01:54:00,880: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:54:00.921548524Z [2024-05-26 01:54:00,917: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:54:00.993991345Z [2024-05-26 01:54:00,990: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:54:01.072933001Z [2024-05-26 01:54:01,072: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:54:01.076672759Z [2024-05-26 01:54:01,076: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:54:01.116165267Z [2024-05-26 01:54:01,115: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:54:01.118721043Z [2024-05-26 01:54:01,118: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:54:01.120891633Z [2024-05-26 01:54:01,120: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:54:01.121418988Z [2024-05-26 01:54:01,121: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:54:01.121458165Z [2024-05-26 01:54:01,121: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:54:01.121749704Z [2024-05-26 01:54:01,121: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:54:01.211788246Z [2024-05-26 01:54:01,211: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:54:01.629522660Z [2024-05-26 01:54:01,629: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f69f08d-51af-4024-b927-bb500fb351d2] succeeded in 1.1904127790003258s: None 2024-05-26T01:54:01.867237658Z [2024-05-26 01:54:01,866: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4eec52a3-6036-4ecf-842d-790e16afedce] succeeded in 1.43542329200136s: None 2024-05-26T01:54:02.223152722Z [2024-05-26 01:54:02,222: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:54:02.226331790Z [2024-05-26 01:54:02,225: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:54:02.249707332Z [2024-05-26 01:54:02,249: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:54:02.252169962Z [2024-05-26 01:54:02,251: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:54:02.252483007Z [2024-05-26 01:54:02,252: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:54:02.253678619Z [2024-05-26 01:54:02,252: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:54:02.253921326Z [2024-05-26 01:54:02,253: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:54:02.254387305Z [2024-05-26 01:54:02,254: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:54:02.254483120Z [2024-05-26 01:54:02,254: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:54:02.337849324Z [2024-05-26 01:54:02,337: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T01:54:02.341324263Z [2024-05-26 01:54:02,340: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:54:02.364128219Z [2024-05-26 01:54:02,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:54:02.367766437Z [2024-05-26 01:54:02,367: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:54:02.369136647Z [2024-05-26 01:54:02,368: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:54:02.369188994Z [2024-05-26 01:54:02,369: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:54:02.369309703Z [2024-05-26 01:54:02,369: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:54:02.369350090Z [2024-05-26 01:54:02,369: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T01:54:02.369618959Z [2024-05-26 01:54:02,369: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:54:02.369646378Z [2024-05-26 01:54:02,369: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:54:02.458339488Z [2024-05-26 01:54:02,458: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:54:03.937898197Z [2024-05-26 01:54:03,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c79afae7-c5c4-477c-bf9f-bb841c961feb] succeeded in 3.51082498300093s: None 2024-05-26T01:54:04.484088221Z [2024-05-26 01:54:04,482: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5de1458d-3f14-4351-868e-ffea861eb434] succeeded in 4.040685857999051s: None 2024-05-26T01:55:00.655891815Z [2024-05-26 01:55:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f64b74a-d50e-4ecc-af6a-2173a806f6b6] received 2024-05-26T01:55:00.657411270Z [2024-05-26 01:55:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d34711ec-93b1-4fdf-9cc6-1d622c2ea34d] received 2024-05-26T01:55:00.668802893Z [2024-05-26 01:55:00,668: INFO/ForkPoolWorker-15] [2f64b74a-d50e-4ecc-af6a-2173a806f6b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:55:00.672186195Z [2024-05-26 01:55:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8085643a-bff7-47ef-9fa4-d0dac957e360] received 2024-05-26T01:55:00.676152292Z [2024-05-26 01:55:00,675: INFO/ForkPoolWorker-16] [d34711ec-93b1-4fdf-9cc6-1d622c2ea34d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:55:00.676822654Z [2024-05-26 01:55:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd82001b-7055-40f2-a6e8-9b5443f279b3] received 2024-05-26T01:55:00.686216981Z [2024-05-26 01:55:00,685: INFO/ForkPoolWorker-1] [8085643a-bff7-47ef-9fa4-d0dac957e360] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:55:00.687625231Z [2024-05-26 01:55:00,687: INFO/ForkPoolWorker-2] [fd82001b-7055-40f2-a6e8-9b5443f279b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:55:01.010621050Z [2024-05-26 01:55:01,007: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:55:01.023067816Z [2024-05-26 01:55:01,020: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:55:01.045324902Z [2024-05-26 01:55:01,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:55:01.063304831Z [2024-05-26 01:55:01,058: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:55:01.223998278Z [2024-05-26 01:55:01,223: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:55:01.227754719Z [2024-05-26 01:55:01,227: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:55:01.258097613Z [2024-05-26 01:55:01,257: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:55:01.259980228Z [2024-05-26 01:55:01,259: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:55:01.260138791Z [2024-05-26 01:55:01,259: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:55:01.260217498Z [2024-05-26 01:55:01,260: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:55:01.260541585Z [2024-05-26 01:55:01,260: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:55:01.358390757Z [2024-05-26 01:55:01,358: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:55:01.935203940Z [2024-05-26 01:55:01,934: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd82001b-7055-40f2-a6e8-9b5443f279b3] succeeded in 1.2560473789999378s: None 2024-05-26T01:55:02.305033212Z [2024-05-26 01:55:02,304: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:55:02.308214943Z [2024-05-26 01:55:02,307: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:55:02.336841858Z [2024-05-26 01:55:02,336: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:55:02.337898889Z [2024-05-26 01:55:02,337: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:55:02.338403465Z [2024-05-26 01:55:02,338: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:55:02.338613165Z [2024-05-26 01:55:02,338: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:55:02.338871300Z [2024-05-26 01:55:02,338: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:55:02.339035398Z [2024-05-26 01:55:02,338: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:55:02.339368554Z [2024-05-26 01:55:02,339: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:55:02.339598163Z [2024-05-26 01:55:02,339: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:55:02.341298442Z [2024-05-26 01:55:02,340: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:55:02.346175060Z [2024-05-26 01:55:02,345: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:55:02.349463964Z [2024-05-26 01:55:02,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:55:02.373048327Z [2024-05-26 01:55:02,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:55:02.376727588Z [2024-05-26 01:55:02,376: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:55:02.376932959Z [2024-05-26 01:55:02,376: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:55:02.377153697Z [2024-05-26 01:55:02,376: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:55:02.377423036Z [2024-05-26 01:55:02,377: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:55:02.377762822Z [2024-05-26 01:55:02,377: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:55:02.378160623Z [2024-05-26 01:55:02,377: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:55:02.379508206Z [2024-05-26 01:55:02,379: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:55:02.381459962Z [2024-05-26 01:55:02,381: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:55:02.382014199Z [2024-05-26 01:55:02,381: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:55:02.382240742Z [2024-05-26 01:55:02,381: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:55:02.382305424Z [2024-05-26 01:55:02,382: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:55:02.382655315Z [2024-05-26 01:55:02,382: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:55:02.382719930Z [2024-05-26 01:55:02,382: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:55:02.476050151Z [2024-05-26 01:55:02,475: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:55:02.521915528Z [2024-05-26 01:55:02,521: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:55:02.526213475Z [2024-05-26 01:55:02,525: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:55:03.273634390Z [2024-05-26 01:55:03,272: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f64b74a-d50e-4ecc-af6a-2173a806f6b6] succeeded in 2.6120037809996575s: None 2024-05-26T01:55:04.073207805Z [2024-05-26 01:55:04,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c298a291-e774-47e2-a20e-d77ab321bd89] received 2024-05-26T01:55:04.120208565Z [2024-05-26 01:55:04,119: INFO/ForkPoolWorker-15] [c298a291-e774-47e2-a20e-d77ab321bd89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:55:04.205517779Z [2024-05-26 01:55:04,204: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8085643a-bff7-47ef-9fa4-d0dac957e360] succeeded in 3.531479663999562s: None 2024-05-26T01:55:04.610925921Z [2024-05-26 01:55:04,607: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:55:04.628942346Z [2024-05-26 01:55:04,628: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d34711ec-93b1-4fdf-9cc6-1d622c2ea34d] succeeded in 3.9624392069999885s: None 2024-05-26T01:55:06.125033553Z [2024-05-26 01:55:06,124: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:55:06.128539669Z [2024-05-26 01:55:06,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:55:06.170701543Z [2024-05-26 01:55:06,170: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:55:06.173436455Z [2024-05-26 01:55:06,173: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:55:06.173832955Z [2024-05-26 01:55:06,173: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:55:06.174061985Z [2024-05-26 01:55:06,173: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:55:06.174095651Z [2024-05-26 01:55:06,173: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:55:06.174272671Z [2024-05-26 01:55:06,174: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:55:06.174744918Z [2024-05-26 01:55:06,174: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:55:06.269067016Z [2024-05-26 01:55:06,268: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:55:06.993841697Z [2024-05-26 01:55:06,993: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c298a291-e774-47e2-a20e-d77ab321bd89] succeeded in 2.9048795599992445s: None 2024-05-26T01:55:07.599726361Z [2024-05-26 01:55:07,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed7dda42-0ff4-4b4e-aac7-6a240a3fb197] received 2024-05-26T01:55:07.614256407Z [2024-05-26 01:55:07,613: INFO/ForkPoolWorker-15] [ed7dda42-0ff4-4b4e-aac7-6a240a3fb197] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:55:07.968978073Z [2024-05-26 01:55:07,961: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:55:09.170375026Z [2024-05-26 01:55:09,169: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:55:09.174695081Z [2024-05-26 01:55:09,174: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:55:09.204954787Z [2024-05-26 01:55:09,204: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:55:09.206593165Z [2024-05-26 01:55:09,206: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:55:09.206733374Z [2024-05-26 01:55:09,206: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:55:09.206979606Z [2024-05-26 01:55:09,206: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:55:09.207113193Z [2024-05-26 01:55:09,206: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:55:09.207429100Z [2024-05-26 01:55:09,207: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:55:09.207655033Z [2024-05-26 01:55:09,207: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:55:09.313784319Z [2024-05-26 01:55:09,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:55:09.951149915Z [2024-05-26 01:55:09,950: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed7dda42-0ff4-4b4e-aac7-6a240a3fb197] succeeded in 2.347184539999944s: None 2024-05-26T01:55:10.230147908Z [2024-05-26 01:55:10,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5263e190-dc3d-4ed5-9fd2-a0fab15176d4] received 2024-05-26T01:55:10.247627860Z [2024-05-26 01:55:10,247: INFO/ForkPoolWorker-15] [5263e190-dc3d-4ed5-9fd2-a0fab15176d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:55:10.512790874Z [2024-05-26 01:55:10,509: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T01:55:11.718719290Z [2024-05-26 01:55:11,718: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:55:11.721717757Z [2024-05-26 01:55:11,721: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:55:11.745591876Z [2024-05-26 01:55:11,745: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:55:11.747035240Z [2024-05-26 01:55:11,746: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:55:11.747199544Z [2024-05-26 01:55:11,746: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:55:11.747276489Z [2024-05-26 01:55:11,746: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:55:11.747299960Z [2024-05-26 01:55:11,747: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:55:11.747501899Z [2024-05-26 01:55:11,747: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T01:55:11.747564637Z [2024-05-26 01:55:11,747: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:55:11.866413358Z [2024-05-26 01:55:11,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:55:12.507938059Z [2024-05-26 01:55:12,507: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5263e190-dc3d-4ed5-9fd2-a0fab15176d4] succeeded in 2.275258285999371s: None 2024-05-26T01:56:00.973371976Z [2024-05-26 01:56:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d492a786-44c7-411a-94f7-c738f37746f6] received 2024-05-26T01:56:00.980412277Z [2024-05-26 01:56:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1522e3df-9620-4a94-b0e7-ed01138f65fe] received 2024-05-26T01:56:00.982800692Z [2024-05-26 01:56:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c07981ba-4b98-4a17-abaf-c2ac17e8d5aa] received 2024-05-26T01:56:00.987731503Z [2024-05-26 01:56:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e436454-9e4a-4b05-a7bb-667d7bbb9fcf] received 2024-05-26T01:56:01.009364294Z [2024-05-26 01:56:01,008: INFO/ForkPoolWorker-1] [c07981ba-4b98-4a17-abaf-c2ac17e8d5aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:56:01.013115737Z [2024-05-26 01:56:01,012: INFO/ForkPoolWorker-15] [d492a786-44c7-411a-94f7-c738f37746f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:56:01.015771389Z [2024-05-26 01:56:01,013: INFO/ForkPoolWorker-2] [0e436454-9e4a-4b05-a7bb-667d7bbb9fcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:56:01.017383184Z [2024-05-26 01:56:01,017: INFO/ForkPoolWorker-16] [1522e3df-9620-4a94-b0e7-ed01138f65fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:56:01.396687577Z [2024-05-26 01:56:01,392: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:56:01.401816569Z [2024-05-26 01:56:01,398: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:56:01.590827626Z [2024-05-26 01:56:01,586: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:56:01.697545777Z [2024-05-26 01:56:01,692: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:56:01.714739689Z [2024-05-26 01:56:01,714: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:56:01.731258990Z [2024-05-26 01:56:01,730: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:56:01.735384842Z [2024-05-26 01:56:01,734: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:56:01.774546574Z [2024-05-26 01:56:01,774: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:56:01.776075159Z [2024-05-26 01:56:01,775: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:56:01.776210565Z [2024-05-26 01:56:01,776: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:56:01.776323044Z [2024-05-26 01:56:01,776: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:56:01.776529480Z [2024-05-26 01:56:01,776: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:56:01.921912882Z [2024-05-26 01:56:01,921: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:56:02.417965232Z [2024-05-26 01:56:02,417: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d492a786-44c7-411a-94f7-c738f37746f6] succeeded in 1.4322541839992482s: None 2024-05-26T01:56:02.548767274Z [2024-05-26 01:56:02,548: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e436454-9e4a-4b05-a7bb-667d7bbb9fcf] succeeded in 1.5579586559997551s: None 2024-05-26T01:56:03.241359977Z [2024-05-26 01:56:03,240: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:56:03.245564502Z [2024-05-26 01:56:03,244: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:56:03.262574003Z [2024-05-26 01:56:03,262: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:56:03.265692342Z [2024-05-26 01:56:03,265: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:56:03.287476674Z [2024-05-26 01:56:03,287: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:56:03.312696248Z [2024-05-26 01:56:03,312: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:56:03.312774464Z [2024-05-26 01:56:03,299: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:56:03.314325033Z [2024-05-26 01:56:03,314: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:56:03.315000452Z [2024-05-26 01:56:03,314: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:56:03.315793313Z [2024-05-26 01:56:03,314: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:56:03.318739085Z [2024-05-26 01:56:03,314: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:56:03.319200126Z [2024-05-26 01:56:03,318: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:56:03.319544560Z [2024-05-26 01:56:03,319: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:56:03.319763292Z [2024-05-26 01:56:03,315: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:56:03.320175034Z [2024-05-26 01:56:03,319: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:56:03.320188877Z [2024-05-26 01:56:03,320: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:56:03.320539757Z [2024-05-26 01:56:03,320: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:56:03.322072390Z [2024-05-26 01:56:03,320: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:56:03.431937621Z [2024-05-26 01:56:03,429: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:56:03.538403048Z [2024-05-26 01:56:03,538: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:56:05.643288709Z [2024-05-26 01:56:05,642: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1522e3df-9620-4a94-b0e7-ed01138f65fe] succeeded in 4.658592986999793s: None 2024-05-26T01:56:05.690425635Z [2024-05-26 01:56:05,690: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c07981ba-4b98-4a17-abaf-c2ac17e8d5aa] succeeded in 4.702666847999353s: None 2024-05-26T01:57:00.291634735Z [2024-05-26 01:57:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b40db6a7-34ff-4952-93f2-f8ad4cf0471f] received 2024-05-26T01:57:00.293185840Z [2024-05-26 01:57:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6eab50a5-f3b2-4474-bada-b534189f909a] received 2024-05-26T01:57:00.300607642Z [2024-05-26 01:57:00,300: INFO/ForkPoolWorker-15] [b40db6a7-34ff-4952-93f2-f8ad4cf0471f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:57:00.311973223Z [2024-05-26 01:57:00,311: INFO/ForkPoolWorker-16] [6eab50a5-f3b2-4474-bada-b534189f909a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:57:00.320315785Z [2024-05-26 01:57:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0f04219-c4a0-4e30-ab85-9099100fe853] received 2024-05-26T01:57:00.329148695Z [2024-05-26 01:57:00,328: INFO/ForkPoolWorker-1] [a0f04219-c4a0-4e30-ab85-9099100fe853] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:57:00.683289009Z [2024-05-26 01:57:00,679: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:57:00.690934973Z [2024-05-26 01:57:00,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:57:00.858396793Z [2024-05-26 01:57:00,854: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:57:01.141330606Z [2024-05-26 01:57:01,140: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T01:57:01.149327028Z [2024-05-26 01:57:01,148: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:57:01.201627182Z [2024-05-26 01:57:01,201: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:57:01.202579128Z [2024-05-26 01:57:01,202: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:57:01.202654007Z [2024-05-26 01:57:01,202: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:57:01.202662513Z [2024-05-26 01:57:01,202: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T01:57:01.202856422Z [2024-05-26 01:57:01,202: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:57:01.311854322Z [2024-05-26 01:57:01,309: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:57:01.956541626Z [2024-05-26 01:57:01,956: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a0f04219-c4a0-4e30-ab85-9099100fe853] succeeded in 1.6342370990005293s: None 2024-05-26T01:57:02.076967939Z [2024-05-26 01:57:02,076: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:57:02.079936052Z [2024-05-26 01:57:02,079: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:57:02.108097489Z [2024-05-26 01:57:02,107: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:57:02.109591805Z [2024-05-26 01:57:02,109: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:57:02.109606838Z [2024-05-26 01:57:02,109: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:57:02.109680636Z [2024-05-26 01:57:02,109: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:57:02.109710359Z [2024-05-26 01:57:02,109: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:57:02.110006923Z [2024-05-26 01:57:02,109: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:57:02.110021575Z [2024-05-26 01:57:02,109: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:57:02.192809604Z [2024-05-26 01:57:02,192: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:57:02.286103446Z [2024-05-26 01:57:02,285: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:57:02.289238757Z [2024-05-26 01:57:02,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:57:02.315352456Z [2024-05-26 01:57:02,314: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:57:02.317645477Z [2024-05-26 01:57:02,317: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:57:02.317714117Z [2024-05-26 01:57:02,317: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:57:02.317986134Z [2024-05-26 01:57:02,317: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:57:02.318055542Z [2024-05-26 01:57:02,317: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:57:02.318551577Z [2024-05-26 01:57:02,318: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:57:02.318573998Z [2024-05-26 01:57:02,318: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:57:02.423827055Z [2024-05-26 01:57:02,419: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:57:04.029542682Z [2024-05-26 01:57:04,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b40db6a7-34ff-4952-93f2-f8ad4cf0471f] succeeded in 3.7349243959997693s: None 2024-05-26T01:57:04.241379228Z [2024-05-26 01:57:04,240: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6eab50a5-f3b2-4474-bada-b534189f909a] succeeded in 3.943223735999709s: None 2024-05-26T01:58:00.241796813Z [2024-05-26 01:58:00,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ddf463e-8285-4a8c-8fc2-279ade5b1de4] received 2024-05-26T01:58:00.247292689Z [2024-05-26 01:58:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e642b3d0-dd18-4b5d-89f4-288ee7ec20de] received 2024-05-26T01:58:00.252971987Z [2024-05-26 01:58:00,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[062f807d-5d6f-4413-a1e4-bc1a1efae7f1] received 2024-05-26T01:58:00.255231476Z [2024-05-26 01:58:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c75e4a3-4f42-4e9c-825e-34cc51800a32] received 2024-05-26T01:58:00.269701705Z [2024-05-26 01:58:00,269: INFO/ForkPoolWorker-15] [2ddf463e-8285-4a8c-8fc2-279ade5b1de4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:58:00.271012342Z [2024-05-26 01:58:00,270: INFO/ForkPoolWorker-16] [e642b3d0-dd18-4b5d-89f4-288ee7ec20de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:58:00.283983687Z [2024-05-26 01:58:00,282: INFO/ForkPoolWorker-2] [2c75e4a3-4f42-4e9c-825e-34cc51800a32] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:58:00.291802241Z [2024-05-26 01:58:00,291: INFO/ForkPoolWorker-1] [062f807d-5d6f-4413-a1e4-bc1a1efae7f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:58:00.605807482Z [2024-05-26 01:58:00,602: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:58:00.616014719Z [2024-05-26 01:58:00,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T01:58:00.637847041Z [2024-05-26 01:58:00,634: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:58:00.808965223Z [2024-05-26 01:58:00,797: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:58:00.828560992Z [2024-05-26 01:58:00,828: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T01:58:00.832960733Z [2024-05-26 01:58:00,832: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:58:00.868558906Z [2024-05-26 01:58:00,868: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T01:58:00.872216268Z [2024-05-26 01:58:00,872: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:58:00.872504295Z [2024-05-26 01:58:00,872: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:58:00.872625946Z [2024-05-26 01:58:00,872: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T01:58:00.872865212Z [2024-05-26 01:58:00,872: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:58:00.897723220Z [2024-05-26 01:58:00,897: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:58:01.005013821Z [2024-05-26 01:58:01,004: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:58:01.660405288Z [2024-05-26 01:58:01,660: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2c75e4a3-4f42-4e9c-825e-34cc51800a32] succeeded in 1.4024683549996553s: None 2024-05-26T01:58:01.717398044Z [2024-05-26 01:58:01,716: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ddf463e-8285-4a8c-8fc2-279ade5b1de4] succeeded in 1.4727620699995896s: None 2024-05-26T01:58:01.963545998Z [2024-05-26 01:58:01,963: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T01:58:01.966701364Z [2024-05-26 01:58:01,966: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:58:01.983871230Z [2024-05-26 01:58:01,983: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:58:01.984907334Z [2024-05-26 01:58:01,984: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:58:01.984923173Z [2024-05-26 01:58:01,984: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:58:01.985038245Z [2024-05-26 01:58:01,984: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:58:01.985063712Z [2024-05-26 01:58:01,985: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T01:58:01.985343858Z [2024-05-26 01:58:01,985: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:58:01.985383469Z [2024-05-26 01:58:01,985: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:58:02.083706528Z [2024-05-26 01:58:02,083: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:58:02.171067026Z [2024-05-26 01:58:02,170: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:58:02.176719053Z [2024-05-26 01:58:02,175: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:58:02.217225295Z [2024-05-26 01:58:02,217: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:58:02.220588562Z [2024-05-26 01:58:02,220: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:58:02.220775330Z [2024-05-26 01:58:02,220: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:58:02.221019866Z [2024-05-26 01:58:02,220: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:58:02.221166579Z [2024-05-26 01:58:02,221: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:58:02.221704824Z [2024-05-26 01:58:02,221: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:58:02.221815025Z [2024-05-26 01:58:02,221: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:58:02.298608336Z [2024-05-26 01:58:02,298: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:58:04.107804607Z [2024-05-26 01:58:04,107: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[062f807d-5d6f-4413-a1e4-bc1a1efae7f1] succeeded in 3.8348298000000796s: None 2024-05-26T01:58:04.112474794Z [2024-05-26 01:58:04,112: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e642b3d0-dd18-4b5d-89f4-288ee7ec20de] succeeded in 3.862382704000993s: None 2024-05-26T01:59:00.648610575Z [2024-05-26 01:59:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a00302d6-aa41-4630-893e-099a1fb13aaa] received 2024-05-26T01:59:00.650826002Z [2024-05-26 01:59:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0719d947-2143-4978-9754-7b1f81bccf38] received 2024-05-26T01:59:00.661611137Z [2024-05-26 01:59:00,661: INFO/ForkPoolWorker-15] [a00302d6-aa41-4630-893e-099a1fb13aaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:59:00.662227657Z [2024-05-26 01:59:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fce5a0de-58cc-4fb7-8541-def3bcece7de] received 2024-05-26T01:59:00.663261603Z [2024-05-26 01:59:00,662: INFO/ForkPoolWorker-16] [0719d947-2143-4978-9754-7b1f81bccf38] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:59:00.675803661Z [2024-05-26 01:59:00,675: INFO/ForkPoolWorker-1] [fce5a0de-58cc-4fb7-8541-def3bcece7de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:59:01.003392458Z [2024-05-26 01:59:01,000: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T01:59:01.030796637Z [2024-05-26 01:59:01,027: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T01:59:01.154486791Z [2024-05-26 01:59:01,151: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T01:59:01.190083037Z [2024-05-26 01:59:01,189: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T01:59:01.193790286Z [2024-05-26 01:59:01,193: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:59:01.212559890Z [2024-05-26 01:59:01,212: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T01:59:01.216379378Z [2024-05-26 01:59:01,216: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T01:59:01.216558827Z [2024-05-26 01:59:01,216: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T01:59:01.216686234Z [2024-05-26 01:59:01,216: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T01:59:01.217000148Z [2024-05-26 01:59:01,216: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T01:59:01.319438947Z [2024-05-26 01:59:01,319: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:59:01.920170243Z [2024-05-26 01:59:01,919: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0719d947-2143-4978-9754-7b1f81bccf38] succeeded in 1.2668571260001045s: None 2024-05-26T01:59:02.225406662Z [2024-05-26 01:59:02,224: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T01:59:02.228421022Z [2024-05-26 01:59:02,228: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:59:02.234160823Z [2024-05-26 01:59:02,233: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T01:59:02.237401843Z [2024-05-26 01:59:02,237: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T01:59:02.251012339Z [2024-05-26 01:59:02,250: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T01:59:02.252823951Z [2024-05-26 01:59:02,252: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:59:02.252941802Z [2024-05-26 01:59:02,252: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:59:02.253104962Z [2024-05-26 01:59:02,252: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:59:02.253196642Z [2024-05-26 01:59:02,253: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T01:59:02.253806299Z [2024-05-26 01:59:02,253: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T01:59:02.253921856Z [2024-05-26 01:59:02,253: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:59:02.259567326Z [2024-05-26 01:59:02,259: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T01:59:02.261530118Z [2024-05-26 01:59:02,261: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T01:59:02.261809307Z [2024-05-26 01:59:02,261: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T01:59:02.262206468Z [2024-05-26 01:59:02,261: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T01:59:02.262453872Z [2024-05-26 01:59:02,262: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T01:59:02.263126463Z [2024-05-26 01:59:02,262: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T01:59:02.263420772Z [2024-05-26 01:59:02,263: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T01:59:02.326567084Z [2024-05-26 01:59:02,326: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:59:02.364231441Z [2024-05-26 01:59:02,363: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T01:59:03.894706887Z [2024-05-26 01:59:03,894: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a00302d6-aa41-4630-893e-099a1fb13aaa] succeeded in 3.2422288239995396s: None 2024-05-26T01:59:04.353616544Z [2024-05-26 01:59:04,353: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fce5a0de-58cc-4fb7-8541-def3bcece7de] succeeded in 3.6884062370008905s: None 2024-05-26T02:00:01.153191499Z [2024-05-26 02:00:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52021101-d496-49ea-8c38-7c62f11c5d04] received 2024-05-26T02:00:01.154753217Z [2024-05-26 02:00:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5cce100-d2a6-42b5-89a3-a6d07c8fe9bd] received 2024-05-26T02:00:01.158898666Z [2024-05-26 02:00:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b36112d8-7895-4ed2-853f-777b44bd5ee5] received 2024-05-26T02:00:01.164930813Z [2024-05-26 02:00:01,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06274c5f-7249-4a7d-8853-f4ec0990d1e4] received 2024-05-26T02:00:01.169373500Z [2024-05-26 02:00:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fdcd94e-1240-4154-a312-84669b17d26c] received 2024-05-26T02:00:01.178681716Z [2024-05-26 02:00:01,178: INFO/ForkPoolWorker-15] [52021101-d496-49ea-8c38-7c62f11c5d04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:00:01.183341814Z [2024-05-26 02:00:01,180: INFO/ForkPoolWorker-1] [b36112d8-7895-4ed2-853f-777b44bd5ee5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:00:01.185995962Z [2024-05-26 02:00:01,185: INFO/ForkPoolWorker-16] [b5cce100-d2a6-42b5-89a3-a6d07c8fe9bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:00:01.188712014Z [2024-05-26 02:00:01,188: INFO/ForkPoolWorker-3] [2fdcd94e-1240-4154-a312-84669b17d26c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:00:01.198215457Z [2024-05-26 02:00:01,197: INFO/ForkPoolWorker-2] [06274c5f-7249-4a7d-8853-f4ec0990d1e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:00:01.518820274Z [2024-05-26 02:00:01,515: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:00:01.542362314Z [2024-05-26 02:00:01,537: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:00:01.808318676Z [2024-05-26 02:00:01,804: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:00:01.894820722Z [2024-05-26 02:00:01,879: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:00:01.943488507Z [2024-05-26 02:00:01,893: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:00:02.022729426Z [2024-05-26 02:00:02,022: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:00:02.029299938Z [2024-05-26 02:00:02,028: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:00:02.075415794Z [2024-05-26 02:00:02,075: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:00:02.078864952Z [2024-05-26 02:00:02,078: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:00:02.079097884Z [2024-05-26 02:00:02,078: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:00:02.079232378Z [2024-05-26 02:00:02,079: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:00:02.079549626Z [2024-05-26 02:00:02,079: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:00:02.228683446Z [2024-05-26 02:00:02,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:00:02.300461323Z [2024-05-26 02:00:02,300: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:00:02.957030233Z [2024-05-26 02:00:02,956: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b5cce100-d2a6-42b5-89a3-a6d07c8fe9bd] succeeded in 1.7982039340004121s: None 2024-05-26T02:00:03.088184361Z [2024-05-26 02:00:03,087: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[06274c5f-7249-4a7d-8853-f4ec0990d1e4] succeeded in 1.9164647319994401s: None 2024-05-26T02:00:03.190375628Z [2024-05-26 02:00:03,189: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T02:00:03.194534925Z [2024-05-26 02:00:03,193: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:00:03.244013611Z [2024-05-26 02:00:03,243: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T02:00:03.246015680Z [2024-05-26 02:00:03,245: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:00:03.246187326Z [2024-05-26 02:00:03,246: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:00:03.246401857Z [2024-05-26 02:00:03,246: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:00:03.246634829Z [2024-05-26 02:00:03,246: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T02:00:03.246949117Z [2024-05-26 02:00:03,246: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:00:03.247413741Z [2024-05-26 02:00:03,247: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:00:03.330454691Z [2024-05-26 02:00:03,330: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:00:03.334891349Z [2024-05-26 02:00:03,334: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:00:03.345356679Z [2024-05-26 02:00:03,345: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:00:03.400282350Z [2024-05-26 02:00:03,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:00:03.403031467Z [2024-05-26 02:00:03,402: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:00:03.403038023Z [2024-05-26 02:00:03,402: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:00:03.403041741Z [2024-05-26 02:00:03,402: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:00:03.403045462Z [2024-05-26 02:00:03,402: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:00:03.403048551Z [2024-05-26 02:00:03,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:00:03.403056299Z [2024-05-26 02:00:03,402: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:00:03.490940044Z [2024-05-26 02:00:03,488: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:00:03.493681669Z [2024-05-26 02:00:03,492: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:00:03.528548049Z [2024-05-26 02:00:03,528: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:00:03.529982009Z [2024-05-26 02:00:03,529: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:00:03.530131056Z [2024-05-26 02:00:03,529: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:00:03.530323771Z [2024-05-26 02:00:03,530: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:00:03.530388295Z [2024-05-26 02:00:03,530: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:00:03.530712831Z [2024-05-26 02:00:03,530: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:00:03.530840948Z [2024-05-26 02:00:03,530: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:00:03.624522075Z [2024-05-26 02:00:03,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:00:03.643445359Z [2024-05-26 02:00:03,643: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:00:04.673917143Z [2024-05-26 02:00:04,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e46b8232-4742-4776-b96a-271de9c5bf2b] received 2024-05-26T02:00:04.688671232Z [2024-05-26 02:00:04,688: INFO/ForkPoolWorker-16] [e46b8232-4742-4776-b96a-271de9c5bf2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:00:04.799386316Z [2024-05-26 02:00:04,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52021101-d496-49ea-8c38-7c62f11c5d04] succeeded in 3.6427748240002984s: None 2024-05-26T02:00:05.031244141Z [2024-05-26 02:00:05,028: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:00:05.740754310Z [2024-05-26 02:00:05,740: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2fdcd94e-1240-4154-a312-84669b17d26c] succeeded in 4.568779363000431s: None 2024-05-26T02:00:05.803829867Z [2024-05-26 02:00:05,803: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b36112d8-7895-4ed2-853f-777b44bd5ee5] succeeded in 4.6358691030000045s: None 2024-05-26T02:00:06.533682296Z [2024-05-26 02:00:06,533: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:00:06.537716508Z [2024-05-26 02:00:06,537: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:00:06.573003959Z [2024-05-26 02:00:06,572: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:00:06.574583119Z [2024-05-26 02:00:06,574: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:00:06.574621469Z [2024-05-26 02:00:06,574: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:00:06.574775041Z [2024-05-26 02:00:06,574: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:00:06.574819554Z [2024-05-26 02:00:06,574: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:00:06.575192421Z [2024-05-26 02:00:06,575: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:00:06.575365244Z [2024-05-26 02:00:06,575: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:00:06.706550488Z [2024-05-26 02:00:06,706: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:00:07.474378126Z [2024-05-26 02:00:07,473: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e46b8232-4742-4776-b96a-271de9c5bf2b] succeeded in 2.7988013150006736s: None 2024-05-26T02:00:08.328065490Z [2024-05-26 02:00:08,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f274fca-33cf-4b5e-b11c-4c3c76e07414] received 2024-05-26T02:00:08.336742097Z [2024-05-26 02:00:08,336: INFO/ForkPoolWorker-15] [8f274fca-33cf-4b5e-b11c-4c3c76e07414] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:00:08.637539210Z [2024-05-26 02:00:08,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:00:09.775978939Z [2024-05-26 02:00:09,775: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:00:09.779257577Z [2024-05-26 02:00:09,778: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:00:09.814935973Z [2024-05-26 02:00:09,814: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:00:09.817515246Z [2024-05-26 02:00:09,817: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:00:09.817721487Z [2024-05-26 02:00:09,817: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:00:09.818022186Z [2024-05-26 02:00:09,817: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:00:09.818822138Z [2024-05-26 02:00:09,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:00:09.819554692Z [2024-05-26 02:00:09,819: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:00:09.820142808Z [2024-05-26 02:00:09,819: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:00:09.915900305Z [2024-05-26 02:00:09,915: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:00:10.448181014Z [2024-05-26 02:00:10,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f274fca-33cf-4b5e-b11c-4c3c76e07414] succeeded in 2.1176438279999275s: None 2024-05-26T02:00:11.080212850Z [2024-05-26 02:00:11,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3584926-5727-40b4-944c-4ff82b6f6bab] received 2024-05-26T02:00:11.097395911Z [2024-05-26 02:00:11,094: INFO/ForkPoolWorker-15] [b3584926-5727-40b4-944c-4ff82b6f6bab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:00:11.368261726Z [2024-05-26 02:00:11,365: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:00:12.569373251Z [2024-05-26 02:00:12,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:00:12.572684003Z [2024-05-26 02:00:12,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:00:12.590049118Z [2024-05-26 02:00:12,589: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:00:12.591269944Z [2024-05-26 02:00:12,591: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:00:12.591445118Z [2024-05-26 02:00:12,591: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:00:12.591709622Z [2024-05-26 02:00:12,591: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:00:12.591865578Z [2024-05-26 02:00:12,591: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:00:12.592286433Z [2024-05-26 02:00:12,592: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:00:12.592423317Z [2024-05-26 02:00:12,592: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:00:12.681448548Z [2024-05-26 02:00:12,681: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:00:13.313358421Z [2024-05-26 02:00:13,312: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3584926-5727-40b4-944c-4ff82b6f6bab] succeeded in 2.2304233859995293s: None 2024-05-26T02:01:00.487350888Z [2024-05-26 02:01:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a732de0-c703-4d11-a8f9-74f7136b7bed] received 2024-05-26T02:01:00.501501344Z [2024-05-26 02:01:00,501: INFO/ForkPoolWorker-15] [2a732de0-c703-4d11-a8f9-74f7136b7bed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:01:00.510680969Z [2024-05-26 02:01:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9da1f68a-3357-448a-9771-32e8fb600b12] received 2024-05-26T02:01:00.513276863Z [2024-05-26 02:01:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79be5567-0609-42a4-a433-13d8f98eee03] received 2024-05-26T02:01:00.535621083Z [2024-05-26 02:01:00,535: INFO/ForkPoolWorker-1] [79be5567-0609-42a4-a433-13d8f98eee03] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:01:00.552582141Z [2024-05-26 02:01:00,552: INFO/ForkPoolWorker-16] [9da1f68a-3357-448a-9771-32e8fb600b12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:01:00.859291787Z [2024-05-26 02:01:00,844: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:01:00.874976314Z [2024-05-26 02:01:00,872: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:01:01.005087387Z [2024-05-26 02:01:01,002: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:01:01.174035521Z [2024-05-26 02:01:01,173: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:01:01.178222544Z [2024-05-26 02:01:01,177: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:01:01.206513408Z [2024-05-26 02:01:01,206: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:01:01.216613805Z [2024-05-26 02:01:01,216: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:01:01.216774866Z [2024-05-26 02:01:01,216: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:01:01.216837295Z [2024-05-26 02:01:01,216: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:01:01.217083691Z [2024-05-26 02:01:01,216: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:01:01.373966301Z [2024-05-26 02:01:01,373: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:01:02.003425970Z [2024-05-26 02:01:02,002: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[79be5567-0609-42a4-a433-13d8f98eee03] succeeded in 1.4848844040006952s: None 2024-05-26T02:01:02.258888970Z [2024-05-26 02:01:02,258: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:01:02.262080174Z [2024-05-26 02:01:02,261: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:01:02.267187944Z [2024-05-26 02:01:02,266: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:01:02.270495293Z [2024-05-26 02:01:02,270: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:01:02.288896393Z [2024-05-26 02:01:02,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:01:02.289310410Z [2024-05-26 02:01:02,289: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:01:02.289920970Z [2024-05-26 02:01:02,289: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:01:02.289936069Z [2024-05-26 02:01:02,289: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:01:02.290047829Z [2024-05-26 02:01:02,289: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:01:02.290072149Z [2024-05-26 02:01:02,290: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:01:02.290289002Z [2024-05-26 02:01:02,290: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:01:02.290312858Z [2024-05-26 02:01:02,290: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:01:02.290523573Z [2024-05-26 02:01:02,290: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:01:02.290613665Z [2024-05-26 02:01:02,290: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:01:02.290735079Z [2024-05-26 02:01:02,290: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:01:02.290795036Z [2024-05-26 02:01:02,290: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:01:02.291074851Z [2024-05-26 02:01:02,290: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:01:02.291195435Z [2024-05-26 02:01:02,291: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:01:02.373802079Z [2024-05-26 02:01:02,373: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:01:02.404239787Z [2024-05-26 02:01:02,403: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:01:04.247464191Z [2024-05-26 02:01:04,247: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9da1f68a-3357-448a-9771-32e8fb600b12] succeeded in 3.7320339719990443s: None 2024-05-26T02:01:05.683798325Z [2024-05-26 02:01:05,683: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2a732de0-c703-4d11-a8f9-74f7136b7bed] succeeded in 5.1910342700011824s: None 2024-05-26T02:02:00.383663410Z [2024-05-26 02:02:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15c503ec-c4da-446a-8779-45d660c00c5b] received 2024-05-26T02:02:00.387451408Z [2024-05-26 02:02:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b62fafc-6eba-40af-9ced-ea767511ad95] received 2024-05-26T02:02:00.395180185Z [2024-05-26 02:02:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4b8c742-ef20-49fa-8951-05542ab49e9b] received 2024-05-26T02:02:00.405697325Z [2024-05-26 02:02:00,405: INFO/ForkPoolWorker-15] [15c503ec-c4da-446a-8779-45d660c00c5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:02:00.406684548Z [2024-05-26 02:02:00,406: INFO/ForkPoolWorker-16] [9b62fafc-6eba-40af-9ced-ea767511ad95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:02:00.412282302Z [2024-05-26 02:02:00,411: INFO/ForkPoolWorker-1] [e4b8c742-ef20-49fa-8951-05542ab49e9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:02:00.419343252Z [2024-05-26 02:02:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b1d86f5-4c41-4eea-a62c-b5380063472e] received 2024-05-26T02:02:00.440185284Z [2024-05-26 02:02:00,439: INFO/ForkPoolWorker-2] [8b1d86f5-4c41-4eea-a62c-b5380063472e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:02:00.799760672Z [2024-05-26 02:02:00,786: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:02:00.882927446Z [2024-05-26 02:02:00,875: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:02:00.989129382Z [2024-05-26 02:02:00,983: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:02:01.004730639Z [2024-05-26 02:02:01,001: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:02:01.175007303Z [2024-05-26 02:02:01,174: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:02:01.179034332Z [2024-05-26 02:02:01,178: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:02:01.191577896Z [2024-05-26 02:02:01,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:02:01.205564078Z [2024-05-26 02:02:01,205: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:02:01.206754527Z [2024-05-26 02:02:01,206: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:02:01.206977261Z [2024-05-26 02:02:01,206: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:02:01.207088815Z [2024-05-26 02:02:01,206: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:02:01.207357278Z [2024-05-26 02:02:01,207: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:02:01.305265796Z [2024-05-26 02:02:01,305: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:02:01.782385190Z [2024-05-26 02:02:01,782: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15c503ec-c4da-446a-8779-45d660c00c5b] succeeded in 1.3927396470007807s: None 2024-05-26T02:02:01.896479407Z [2024-05-26 02:02:01,896: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8b1d86f5-4c41-4eea-a62c-b5380063472e] succeeded in 1.4702943430002051s: None 2024-05-26T02:02:02.396129386Z [2024-05-26 02:02:02,395: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:02:02.399447139Z [2024-05-26 02:02:02,399: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:02:02.419920621Z [2024-05-26 02:02:02,419: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:02:02.420935741Z [2024-05-26 02:02:02,420: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:02:02.421551318Z [2024-05-26 02:02:02,421: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:02:02.421830771Z [2024-05-26 02:02:02,421: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:02:02.422080832Z [2024-05-26 02:02:02,421: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:02:02.422421414Z [2024-05-26 02:02:02,422: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:02:02.422981933Z [2024-05-26 02:02:02,422: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:02:02.423152482Z [2024-05-26 02:02:02,423: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:02:02.425492879Z [2024-05-26 02:02:02,425: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:02:02.444512484Z [2024-05-26 02:02:02,444: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:02:02.446648516Z [2024-05-26 02:02:02,446: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:02:02.447105313Z [2024-05-26 02:02:02,446: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:02:02.447258391Z [2024-05-26 02:02:02,447: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:02:02.447273495Z [2024-05-26 02:02:02,447: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:02:02.447565389Z [2024-05-26 02:02:02,447: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:02:02.447580828Z [2024-05-26 02:02:02,447: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:02:02.516934445Z [2024-05-26 02:02:02,516: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:02:02.527589157Z [2024-05-26 02:02:02,527: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:02:04.548079209Z [2024-05-26 02:02:04,547: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e4b8c742-ef20-49fa-8951-05542ab49e9b] succeeded in 4.149725175999265s: None 2024-05-26T02:02:04.974307581Z [2024-05-26 02:02:04,973: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b62fafc-6eba-40af-9ced-ea767511ad95] succeeded in 4.58344055499947s: None 2024-05-26T02:03:00.311797252Z [2024-05-26 02:03:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a219c110-f6d8-4755-af2b-49f701f287c9] received 2024-05-26T02:03:00.317255379Z [2024-05-26 02:03:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6dc1751c-90ea-4f16-93e1-e0c674f474ad] received 2024-05-26T02:03:00.318767086Z [2024-05-26 02:03:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93b750d6-e94a-4720-8e6a-d042bd3cb416] received 2024-05-26T02:03:00.328579383Z [2024-05-26 02:03:00,328: INFO/ForkPoolWorker-1] [93b750d6-e94a-4720-8e6a-d042bd3cb416] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:03:00.330307707Z [2024-05-26 02:03:00,329: INFO/ForkPoolWorker-16] [6dc1751c-90ea-4f16-93e1-e0c674f474ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:03:00.336015825Z [2024-05-26 02:03:00,333: INFO/ForkPoolWorker-15] [a219c110-f6d8-4755-af2b-49f701f287c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:03:00.602952740Z [2024-05-26 02:03:00,599: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:03:00.701526920Z [2024-05-26 02:03:00,697: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:03:00.711122613Z [2024-05-26 02:03:00,708: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:03:00.883189902Z [2024-05-26 02:03:00,882: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:03:00.887435975Z [2024-05-26 02:03:00,886: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:03:00.918520265Z [2024-05-26 02:03:00,918: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:03:00.920035697Z [2024-05-26 02:03:00,919: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:03:00.921257339Z [2024-05-26 02:03:00,921: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:03:00.921406562Z [2024-05-26 02:03:00,921: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:03:00.921669702Z [2024-05-26 02:03:00,921: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:03:01.022093507Z [2024-05-26 02:03:01,021: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:03:01.603071458Z [2024-05-26 02:03:01,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6dc1751c-90ea-4f16-93e1-e0c674f474ad] succeeded in 1.283123830000477s: None 2024-05-26T02:03:01.897955007Z [2024-05-26 02:03:01,897: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:03:01.903142185Z [2024-05-26 02:03:01,902: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:03:01.923929971Z [2024-05-26 02:03:01,923: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:03:01.925676628Z [2024-05-26 02:03:01,925: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:03:01.925802492Z [2024-05-26 02:03:01,925: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:03:01.925984654Z [2024-05-26 02:03:01,925: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:03:01.926121425Z [2024-05-26 02:03:01,925: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:03:01.926598219Z [2024-05-26 02:03:01,926: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:03:01.926770906Z [2024-05-26 02:03:01,926: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:03:01.982697825Z [2024-05-26 02:03:01,982: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:03:01.985860050Z [2024-05-26 02:03:01,985: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:03:02.008283092Z [2024-05-26 02:03:02,008: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:03:02.009830145Z [2024-05-26 02:03:02,009: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:03:02.009921107Z [2024-05-26 02:03:02,009: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:03:02.010099489Z [2024-05-26 02:03:02,009: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:03:02.010208336Z [2024-05-26 02:03:02,010: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:03:02.010528212Z [2024-05-26 02:03:02,010: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:03:02.010662471Z [2024-05-26 02:03:02,010: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:03:02.017126038Z [2024-05-26 02:03:02,016: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:03:02.100189713Z [2024-05-26 02:03:02,099: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:03:03.724493062Z [2024-05-26 02:03:03,724: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a219c110-f6d8-4755-af2b-49f701f287c9] succeeded in 3.410204687001169s: None 2024-05-26T02:03:04.112746433Z [2024-05-26 02:03:04,111: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[93b750d6-e94a-4720-8e6a-d042bd3cb416] succeeded in 3.7914144130008935s: None 2024-05-26T02:04:01.210210139Z [2024-05-26 02:04:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e732d5ae-20b8-405d-b851-3869bf9a21ef] received 2024-05-26T02:04:01.216256787Z [2024-05-26 02:04:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03a32495-a188-4e78-9da0-6987baf9a9e6] received 2024-05-26T02:04:01.227264660Z [2024-05-26 02:04:01,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf2054cb-2827-4436-a3cc-c2d0ed4c6397] received 2024-05-26T02:04:01.230219459Z [2024-05-26 02:04:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0280bba5-4882-4ded-80b7-8a0ea2fff50a] received 2024-05-26T02:04:01.230528761Z [2024-05-26 02:04:01,230: INFO/ForkPoolWorker-15] [e732d5ae-20b8-405d-b851-3869bf9a21ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:04:01.234334974Z [2024-05-26 02:04:01,233: INFO/ForkPoolWorker-16] [03a32495-a188-4e78-9da0-6987baf9a9e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:04:01.256455572Z [2024-05-26 02:04:01,255: INFO/ForkPoolWorker-2] [0280bba5-4882-4ded-80b7-8a0ea2fff50a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:04:01.259345525Z [2024-05-26 02:04:01,258: INFO/ForkPoolWorker-1] [bf2054cb-2827-4436-a3cc-c2d0ed4c6397] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:04:01.640071555Z [2024-05-26 02:04:01,636: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:04:01.655577694Z [2024-05-26 02:04:01,651: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:04:01.693506892Z [2024-05-26 02:04:01,686: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:04:01.779670449Z [2024-05-26 02:04:01,763: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:04:01.930898849Z [2024-05-26 02:04:01,930: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:04:01.992969257Z [2024-05-26 02:04:01,992: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:04:02.005464923Z [2024-05-26 02:04:02,003: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:04:02.052672324Z [2024-05-26 02:04:02,052: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:04:02.056214419Z [2024-05-26 02:04:02,055: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:04:02.056283347Z [2024-05-26 02:04:02,056: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:04:02.056391579Z [2024-05-26 02:04:02,056: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:04:02.056557334Z [2024-05-26 02:04:02,056: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:04:02.200787677Z [2024-05-26 02:04:02,200: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:04:02.629860940Z [2024-05-26 02:04:02,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e732d5ae-20b8-405d-b851-3869bf9a21ef] succeeded in 1.4117121130002488s: None 2024-05-26T02:04:03.006111260Z [2024-05-26 02:04:03,005: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0280bba5-4882-4ded-80b7-8a0ea2fff50a] succeeded in 1.7714259049989778s: None 2024-05-26T02:04:03.254233030Z [2024-05-26 02:04:03,253: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:04:03.258204050Z [2024-05-26 02:04:03,257: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:04:03.287153559Z [2024-05-26 02:04:03,286: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:04:03.295505588Z [2024-05-26 02:04:03,295: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:04:03.296150738Z [2024-05-26 02:04:03,295: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:04:03.296164503Z [2024-05-26 02:04:03,295: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:04:03.297078455Z [2024-05-26 02:04:03,296: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:04:03.297601161Z [2024-05-26 02:04:03,297: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:04:03.297609312Z [2024-05-26 02:04:03,297: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:04:03.457763571Z [2024-05-26 02:04:03,455: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:04:03.513878519Z [2024-05-26 02:04:03,513: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:04:03.517157762Z [2024-05-26 02:04:03,516: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:04:03.563829678Z [2024-05-26 02:04:03,563: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:04:03.568318314Z [2024-05-26 02:04:03,568: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:04:03.568379683Z [2024-05-26 02:04:03,568: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:04:03.568451352Z [2024-05-26 02:04:03,568: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:04:03.568496489Z [2024-05-26 02:04:03,568: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:04:03.571744414Z [2024-05-26 02:04:03,568: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:04:03.571854883Z [2024-05-26 02:04:03,571: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:04:03.768246798Z [2024-05-26 02:04:03,767: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:04:05.690347141Z [2024-05-26 02:04:05,689: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bf2054cb-2827-4436-a3cc-c2d0ed4c6397] succeeded in 4.456418654999652s: None 2024-05-26T02:04:05.848932951Z [2024-05-26 02:04:05,848: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[03a32495-a188-4e78-9da0-6987baf9a9e6] succeeded in 4.630711241999961s: None 2024-05-26T02:05:01.076350429Z [2024-05-26 02:05:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a61f4dd-89b9-4839-99c4-983c179320bc] received 2024-05-26T02:05:01.082408169Z [2024-05-26 02:05:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05b8a521-9c14-426b-8baa-bd3d47eee09c] received 2024-05-26T02:05:01.098961906Z [2024-05-26 02:05:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[360c9083-c059-4cfa-9d6e-fdeb9ef28fc8] received 2024-05-26T02:05:01.098985409Z [2024-05-26 02:05:01,087: INFO/ForkPoolWorker-15] [8a61f4dd-89b9-4839-99c4-983c179320bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:05:01.098988652Z [2024-05-26 02:05:01,088: INFO/ForkPoolWorker-16] [05b8a521-9c14-426b-8baa-bd3d47eee09c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:05:01.098991587Z [2024-05-26 02:05:01,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fea58099-7b50-46e5-913d-1ae8962c2acf] received 2024-05-26T02:05:01.103874554Z [2024-05-26 02:05:01,103: INFO/ForkPoolWorker-1] [360c9083-c059-4cfa-9d6e-fdeb9ef28fc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:05:01.104574585Z [2024-05-26 02:05:01,104: INFO/ForkPoolWorker-2] [fea58099-7b50-46e5-913d-1ae8962c2acf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:05:01.498311766Z [2024-05-26 02:05:01,494: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:05:01.502711356Z [2024-05-26 02:05:01,499: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:05:01.505260596Z [2024-05-26 02:05:01,501: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:05:01.650016801Z [2024-05-26 02:05:01,646: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:05:01.688050046Z [2024-05-26 02:05:01,687: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:05:01.693160424Z [2024-05-26 02:05:01,692: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:05:01.722783143Z [2024-05-26 02:05:01,722: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:05:01.725449855Z [2024-05-26 02:05:01,725: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:05:01.725575109Z [2024-05-26 02:05:01,725: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:05:01.725641719Z [2024-05-26 02:05:01,725: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:05:01.725854701Z [2024-05-26 02:05:01,725: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:05:01.853525820Z [2024-05-26 02:05:01,853: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:05:02.468745452Z [2024-05-26 02:05:02,468: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fea58099-7b50-46e5-913d-1ae8962c2acf] succeeded in 1.370757409998987s: None 2024-05-26T02:05:02.780810883Z [2024-05-26 02:05:02,780: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:05:02.784030673Z [2024-05-26 02:05:02,783: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:05:02.814894936Z [2024-05-26 02:05:02,814: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:05:02.816832856Z [2024-05-26 02:05:02,816: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:05:02.817006020Z [2024-05-26 02:05:02,816: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:05:02.817812600Z [2024-05-26 02:05:02,817: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:05:02.818613236Z [2024-05-26 02:05:02,818: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:05:02.818999675Z [2024-05-26 02:05:02,818: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:05:02.819652462Z [2024-05-26 02:05:02,819: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:05:02.896315366Z [2024-05-26 02:05:02,895: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:05:02.899612974Z [2024-05-26 02:05:02,899: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:05:02.901607543Z [2024-05-26 02:05:02,901: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:05:02.936424897Z [2024-05-26 02:05:02,936: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:05:02.940918784Z [2024-05-26 02:05:02,940: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:05:02.940940424Z [2024-05-26 02:05:02,940: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:05:02.941121740Z [2024-05-26 02:05:02,940: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:05:02.941176369Z [2024-05-26 02:05:02,941: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:05:02.941478677Z [2024-05-26 02:05:02,941: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:05:02.941515713Z [2024-05-26 02:05:02,941: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:05:02.949453423Z [2024-05-26 02:05:02,949: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:05:02.952613051Z [2024-05-26 02:05:02,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:05:02.979397918Z [2024-05-26 02:05:02,979: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:05:02.982489322Z [2024-05-26 02:05:02,982: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:05:02.982631689Z [2024-05-26 02:05:02,982: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:05:02.982811934Z [2024-05-26 02:05:02,982: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:05:02.982943515Z [2024-05-26 02:05:02,982: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:05:02.983234160Z [2024-05-26 02:05:02,983: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:05:02.983345776Z [2024-05-26 02:05:02,983: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:05:03.050227247Z [2024-05-26 02:05:03,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:05:03.078548029Z [2024-05-26 02:05:03,078: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:05:03.733508978Z [2024-05-26 02:05:03,733: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[05b8a521-9c14-426b-8baa-bd3d47eee09c] succeeded in 2.6501506670010713s: None 2024-05-26T02:05:03.841780503Z [2024-05-26 02:05:03,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b68f7c4-8645-4a88-aca5-cb2f9eb5ca60] received 2024-05-26T02:05:03.872329294Z [2024-05-26 02:05:03,869: INFO/ForkPoolWorker-16] [9b68f7c4-8645-4a88-aca5-cb2f9eb5ca60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:05:04.293255623Z [2024-05-26 02:05:04,290: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:05:05.275644349Z [2024-05-26 02:05:05,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a61f4dd-89b9-4839-99c4-983c179320bc] succeeded in 4.1971694250005385s: None 2024-05-26T02:05:05.510209256Z [2024-05-26 02:05:05,508: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[360c9083-c059-4cfa-9d6e-fdeb9ef28fc8] succeeded in 4.416694527999425s: None 2024-05-26T02:05:05.572492953Z [2024-05-26 02:05:05,572: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:05:05.575732286Z [2024-05-26 02:05:05,575: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:05:05.674657490Z [2024-05-26 02:05:05,674: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:05:05.679609213Z [2024-05-26 02:05:05,676: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:05:05.680053597Z [2024-05-26 02:05:05,676: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:05:05.680075251Z [2024-05-26 02:05:05,676: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:05:05.680080355Z [2024-05-26 02:05:05,676: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:05:05.680083799Z [2024-05-26 02:05:05,676: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:05:05.680087271Z [2024-05-26 02:05:05,676: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:05:05.795493348Z [2024-05-26 02:05:05,795: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:05:06.381885297Z [2024-05-26 02:05:06,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97f87e84-1f27-4ae0-898a-55169db8abb7] received 2024-05-26T02:05:06.391802346Z [2024-05-26 02:05:06,391: INFO/ForkPoolWorker-15] [97f87e84-1f27-4ae0-898a-55169db8abb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:05:06.435035113Z [2024-05-26 02:05:06,434: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b68f7c4-8645-4a88-aca5-cb2f9eb5ca60] succeeded in 2.588791348000086s: None 2024-05-26T02:05:06.678282183Z [2024-05-26 02:05:06,675: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:05:07.758308742Z [2024-05-26 02:05:07,757: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:05:07.761674966Z [2024-05-26 02:05:07,761: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:05:07.783620314Z [2024-05-26 02:05:07,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:05:07.785583892Z [2024-05-26 02:05:07,785: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:05:07.785769486Z [2024-05-26 02:05:07,785: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:05:07.785949763Z [2024-05-26 02:05:07,785: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:05:07.786010242Z [2024-05-26 02:05:07,785: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:05:07.786060909Z [2024-05-26 02:05:07,785: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:05:07.786077773Z [2024-05-26 02:05:07,785: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:05:07.880153514Z [2024-05-26 02:05:07,879: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:05:08.595141101Z [2024-05-26 02:05:08,594: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97f87e84-1f27-4ae0-898a-55169db8abb7] succeeded in 2.2116224429992144s: None 2024-05-26T02:05:08.757769860Z [2024-05-26 02:05:08,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5ec338f-06ce-42b0-8994-68d7a5094817] received 2024-05-26T02:05:08.767427215Z [2024-05-26 02:05:08,767: INFO/ForkPoolWorker-15] [f5ec338f-06ce-42b0-8994-68d7a5094817] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:05:09.028123693Z [2024-05-26 02:05:09,024: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:05:10.112413340Z [2024-05-26 02:05:10,111: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:05:10.117931700Z [2024-05-26 02:05:10,117: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:05:10.140993924Z [2024-05-26 02:05:10,140: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:05:10.142756238Z [2024-05-26 02:05:10,142: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:05:10.142916180Z [2024-05-26 02:05:10,142: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:05:10.143229054Z [2024-05-26 02:05:10,142: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:05:10.143454076Z [2024-05-26 02:05:10,143: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:05:10.144023542Z [2024-05-26 02:05:10,143: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:05:10.144190661Z [2024-05-26 02:05:10,143: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:05:10.256089995Z [2024-05-26 02:05:10,255: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:05:10.926372594Z [2024-05-26 02:05:10,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5ec338f-06ce-42b0-8994-68d7a5094817] succeeded in 2.1655981819985755s: None 2024-05-26T02:06:01.063618017Z [2024-05-26 02:06:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce751f6c-db2d-41bb-aa64-74f2bfe21e50] received 2024-05-26T02:06:01.065140374Z [2024-05-26 02:06:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fde7d13d-5ba1-4905-ba17-2d60fd6b9db7] received 2024-05-26T02:06:01.066323761Z [2024-05-26 02:06:01,066: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5c8639a-1749-4119-8681-b4b99c733a39] received 2024-05-26T02:06:01.077594980Z [2024-05-26 02:06:01,077: INFO/ForkPoolWorker-15] [ce751f6c-db2d-41bb-aa64-74f2bfe21e50] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:06:01.077912492Z [2024-05-26 02:06:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e203e6c2-d50a-4ae9-a519-d9db83faff92] received 2024-05-26T02:06:01.078586149Z [2024-05-26 02:06:01,078: INFO/ForkPoolWorker-1] [d5c8639a-1749-4119-8681-b4b99c733a39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:06:01.097612707Z [2024-05-26 02:06:01,097: INFO/ForkPoolWorker-16] [fde7d13d-5ba1-4905-ba17-2d60fd6b9db7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:06:01.098703163Z [2024-05-26 02:06:01,098: INFO/ForkPoolWorker-2] [e203e6c2-d50a-4ae9-a519-d9db83faff92] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:06:01.375694204Z [2024-05-26 02:06:01,372: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:06:01.399787873Z [2024-05-26 02:06:01,396: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:06:01.442106071Z [2024-05-26 02:06:01,436: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:06:01.445442186Z [2024-05-26 02:06:01,440: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:06:01.652747509Z [2024-05-26 02:06:01,652: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:06:01.693549956Z [2024-05-26 02:06:01,693: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:06:01.702880598Z [2024-05-26 02:06:01,702: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:06:01.749252235Z [2024-05-26 02:06:01,749: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:06:01.757387966Z [2024-05-26 02:06:01,757: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:06:01.757439553Z [2024-05-26 02:06:01,757: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:06:01.757470494Z [2024-05-26 02:06:01,757: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:06:01.757681792Z [2024-05-26 02:06:01,757: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:06:01.954821212Z [2024-05-26 02:06:01,954: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:06:02.246004066Z [2024-05-26 02:06:02,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce751f6c-db2d-41bb-aa64-74f2bfe21e50] succeeded in 1.1776961069990648s: None 2024-05-26T02:06:02.716063065Z [2024-05-26 02:06:02,715: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e203e6c2-d50a-4ae9-a519-d9db83faff92] succeeded in 1.6269463630014798s: None 2024-05-26T02:06:02.928330838Z [2024-05-26 02:06:02,927: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:06:02.931279331Z [2024-05-26 02:06:02,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:06:02.935673168Z [2024-05-26 02:06:02,935: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:06:02.938691772Z [2024-05-26 02:06:02,938: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:06:02.951675708Z [2024-05-26 02:06:02,951: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:06:02.953201346Z [2024-05-26 02:06:02,952: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:06:02.953214375Z [2024-05-26 02:06:02,953: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:06:02.953362313Z [2024-05-26 02:06:02,953: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:06:02.953470087Z [2024-05-26 02:06:02,953: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:06:02.953734969Z [2024-05-26 02:06:02,953: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:06:02.953878179Z [2024-05-26 02:06:02,953: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:06:02.957685964Z [2024-05-26 02:06:02,957: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:06:02.964817688Z [2024-05-26 02:06:02,964: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:06:02.964868318Z [2024-05-26 02:06:02,964: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:06:02.964879896Z [2024-05-26 02:06:02,964: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:06:02.964889494Z [2024-05-26 02:06:02,964: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:06:02.965202040Z [2024-05-26 02:06:02,964: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:06:02.965216234Z [2024-05-26 02:06:02,964: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:06:03.031467900Z [2024-05-26 02:06:03,031: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:06:03.042475456Z [2024-05-26 02:06:03,042: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:06:04.690646002Z [2024-05-26 02:06:04,689: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d5c8639a-1749-4119-8681-b4b99c733a39] succeeded in 3.622269686000436s: None 2024-05-26T02:06:05.039858347Z [2024-05-26 02:06:05,039: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fde7d13d-5ba1-4905-ba17-2d60fd6b9db7] succeeded in 3.9715861360000417s: None 2024-05-26T02:07:01.008709928Z [2024-05-26 02:07:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[230d5352-6089-44ed-8ecd-078c81c52300] received 2024-05-26T02:07:01.012314236Z [2024-05-26 02:07:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40604e3e-8aaa-4d31-a967-d2d6e419402d] received 2024-05-26T02:07:01.017725673Z [2024-05-26 02:07:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a815c5e3-9d05-4a4a-8e10-9c4cfd5982d4] received 2024-05-26T02:07:01.023259582Z [2024-05-26 02:07:01,022: INFO/ForkPoolWorker-16] [40604e3e-8aaa-4d31-a967-d2d6e419402d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:07:01.025376276Z [2024-05-26 02:07:01,025: INFO/ForkPoolWorker-15] [230d5352-6089-44ed-8ecd-078c81c52300] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:07:01.027204259Z [2024-05-26 02:07:01,026: INFO/ForkPoolWorker-1] [a815c5e3-9d05-4a4a-8e10-9c4cfd5982d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:07:01.322575632Z [2024-05-26 02:07:01,318: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:07:01.338503564Z [2024-05-26 02:07:01,334: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:07:01.341111022Z [2024-05-26 02:07:01,337: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:07:01.516806037Z [2024-05-26 02:07:01,516: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:07:01.520561218Z [2024-05-26 02:07:01,520: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:07:01.544753708Z [2024-05-26 02:07:01,544: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:07:01.546097466Z [2024-05-26 02:07:01,545: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:07:01.546263209Z [2024-05-26 02:07:01,546: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:07:01.546395549Z [2024-05-26 02:07:01,546: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:07:01.546770982Z [2024-05-26 02:07:01,546: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:07:01.636912480Z [2024-05-26 02:07:01,636: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:07:02.296918765Z [2024-05-26 02:07:02,296: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[40604e3e-8aaa-4d31-a967-d2d6e419402d] succeeded in 1.2820752640000137s: None 2024-05-26T02:07:02.610930183Z [2024-05-26 02:07:02,610: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:07:02.614237172Z [2024-05-26 02:07:02,613: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:07:02.642055354Z [2024-05-26 02:07:02,641: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:07:02.645865845Z [2024-05-26 02:07:02,645: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:07:02.656237721Z [2024-05-26 02:07:02,655: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:07:02.657918750Z [2024-05-26 02:07:02,657: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:07:02.658493114Z [2024-05-26 02:07:02,658: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:07:02.658696540Z [2024-05-26 02:07:02,658: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:07:02.658873013Z [2024-05-26 02:07:02,658: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:07:02.659203207Z [2024-05-26 02:07:02,659: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:07:02.659349993Z [2024-05-26 02:07:02,659: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:07:02.676821761Z [2024-05-26 02:07:02,676: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:07:02.678214215Z [2024-05-26 02:07:02,677: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:07:02.678427470Z [2024-05-26 02:07:02,678: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:07:02.678676037Z [2024-05-26 02:07:02,678: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:07:02.678823236Z [2024-05-26 02:07:02,678: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:07:02.679269139Z [2024-05-26 02:07:02,679: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:07:02.679395822Z [2024-05-26 02:07:02,679: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:07:02.756194852Z [2024-05-26 02:07:02,755: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:07:02.764571466Z [2024-05-26 02:07:02,764: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:07:04.544647435Z [2024-05-26 02:07:04,541: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a815c5e3-9d05-4a4a-8e10-9c4cfd5982d4] succeeded in 3.5221852350005065s: None 2024-05-26T02:07:05.060627415Z [2024-05-26 02:07:05,060: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[230d5352-6089-44ed-8ecd-078c81c52300] succeeded in 4.048886978000155s: None 2024-05-26T02:08:00.423200536Z [2024-05-26 02:08:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a7c6f43-de5c-4d40-9d98-ebfccf01ada0] received 2024-05-26T02:08:00.425622517Z [2024-05-26 02:08:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d4bc6e8-4cae-4a22-ab97-82b01d22ba09] received 2024-05-26T02:08:00.428612936Z [2024-05-26 02:08:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f07a35b-1cff-4be7-a56c-2fc9694d4726] received 2024-05-26T02:08:00.434973296Z [2024-05-26 02:08:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ad2bf9a-9f89-48d7-9b3d-84c14af1bf0d] received 2024-05-26T02:08:00.437489560Z [2024-05-26 02:08:00,437: INFO/ForkPoolWorker-15] [8a7c6f43-de5c-4d40-9d98-ebfccf01ada0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:08:00.440273613Z [2024-05-26 02:08:00,439: INFO/ForkPoolWorker-1] [7f07a35b-1cff-4be7-a56c-2fc9694d4726] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:08:00.448301844Z [2024-05-26 02:08:00,448: INFO/ForkPoolWorker-16] [3d4bc6e8-4cae-4a22-ab97-82b01d22ba09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:08:00.458862725Z [2024-05-26 02:08:00,458: INFO/ForkPoolWorker-2] [1ad2bf9a-9f89-48d7-9b3d-84c14af1bf0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:08:00.746362143Z [2024-05-26 02:08:00,740: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:08:00.864324316Z [2024-05-26 02:08:00,861: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:08:00.898228580Z [2024-05-26 02:08:00,894: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:08:00.959238113Z [2024-05-26 02:08:00,935: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:08:01.283479698Z [2024-05-26 02:08:01,282: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:08:01.287796063Z [2024-05-26 02:08:01,287: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:08:01.313329430Z [2024-05-26 02:08:01,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:08:01.327968755Z [2024-05-26 02:08:01,327: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:08:01.331310833Z [2024-05-26 02:08:01,331: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:08:01.331339800Z [2024-05-26 02:08:01,331: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:08:01.331408522Z [2024-05-26 02:08:01,331: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:08:01.331620138Z [2024-05-26 02:08:01,331: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:08:01.443127923Z [2024-05-26 02:08:01,442: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:08:01.933028861Z [2024-05-26 02:08:01,932: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a7c6f43-de5c-4d40-9d98-ebfccf01ada0] succeeded in 1.5057526689997758s: None 2024-05-26T02:08:02.085410936Z [2024-05-26 02:08:02,085: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1ad2bf9a-9f89-48d7-9b3d-84c14af1bf0d] succeeded in 1.6462938980002946s: None 2024-05-26T02:08:02.242014865Z [2024-05-26 02:08:02,241: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:08:02.245380090Z [2024-05-26 02:08:02,244: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:08:02.254307705Z [2024-05-26 02:08:02,253: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:08:02.257427532Z [2024-05-26 02:08:02,256: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:08:02.277610738Z [2024-05-26 02:08:02,277: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:08:02.279582227Z [2024-05-26 02:08:02,279: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:08:02.279821750Z [2024-05-26 02:08:02,279: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:08:02.280216586Z [2024-05-26 02:08:02,279: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:08:02.280462976Z [2024-05-26 02:08:02,280: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:08:02.280749498Z [2024-05-26 02:08:02,280: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:08:02.281250639Z [2024-05-26 02:08:02,281: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:08:02.282321078Z [2024-05-26 02:08:02,282: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:08:02.283830190Z [2024-05-26 02:08:02,283: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:08:02.283867744Z [2024-05-26 02:08:02,283: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:08:02.284030230Z [2024-05-26 02:08:02,283: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:08:02.284117732Z [2024-05-26 02:08:02,283: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:08:02.284330044Z [2024-05-26 02:08:02,284: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:08:02.284354141Z [2024-05-26 02:08:02,284: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:08:02.392148906Z [2024-05-26 02:08:02,391: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:08:02.419363116Z [2024-05-26 02:08:02,419: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:08:03.878838622Z [2024-05-26 02:08:03,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7f07a35b-1cff-4be7-a56c-2fc9694d4726] succeeded in 3.448065980001047s: None 2024-05-26T02:08:04.646375331Z [2024-05-26 02:08:04,645: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d4bc6e8-4cae-4a22-ab97-82b01d22ba09] succeeded in 4.2181441970005835s: None 2024-05-26T02:09:00.357219130Z [2024-05-26 02:09:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0600f6a-ebb9-4248-8670-b12e334cbe40] received 2024-05-26T02:09:00.364148860Z [2024-05-26 02:09:00,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e122f81b-c216-472b-8f8a-9ded4272d4b0] received 2024-05-26T02:09:00.370619535Z [2024-05-26 02:09:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9118c2f7-2ef3-472c-9728-d9aa4e903ec5] received 2024-05-26T02:09:00.374787946Z [2024-05-26 02:09:00,374: INFO/ForkPoolWorker-16] [e122f81b-c216-472b-8f8a-9ded4272d4b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:09:00.377953555Z [2024-05-26 02:09:00,377: INFO/ForkPoolWorker-15] [f0600f6a-ebb9-4248-8670-b12e334cbe40] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:09:00.388764121Z [2024-05-26 02:09:00,388: INFO/ForkPoolWorker-1] [9118c2f7-2ef3-472c-9728-d9aa4e903ec5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:09:00.684908097Z [2024-05-26 02:09:00,681: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:09:00.822687525Z [2024-05-26 02:09:00,815: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:09:00.845032398Z [2024-05-26 02:09:00,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:09:01.163209127Z [2024-05-26 02:09:01,161: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T02:09:01.167762863Z [2024-05-26 02:09:01,166: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:09:01.249038100Z [2024-05-26 02:09:01,248: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:09:01.252565281Z [2024-05-26 02:09:01,252: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:09:01.252681176Z [2024-05-26 02:09:01,252: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:09:01.252746305Z [2024-05-26 02:09:01,252: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T02:09:01.252964430Z [2024-05-26 02:09:01,252: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:09:01.397921524Z [2024-05-26 02:09:01,397: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:09:02.119121107Z [2024-05-26 02:09:02,118: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0600f6a-ebb9-4248-8670-b12e334cbe40] succeeded in 1.7528046560000803s: None 2024-05-26T02:09:02.255977078Z [2024-05-26 02:09:02,255: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:09:02.259040576Z [2024-05-26 02:09:02,258: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:09:02.283449661Z [2024-05-26 02:09:02,283: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:09:02.284835271Z [2024-05-26 02:09:02,284: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:09:02.284888213Z [2024-05-26 02:09:02,284: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:09:02.285020784Z [2024-05-26 02:09:02,284: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:09:02.285061992Z [2024-05-26 02:09:02,284: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:09:02.285293249Z [2024-05-26 02:09:02,285: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:09:02.285338885Z [2024-05-26 02:09:02,285: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:09:02.360403684Z [2024-05-26 02:09:02,360: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:09:02.394851222Z [2024-05-26 02:09:02,394: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:09:02.398175688Z [2024-05-26 02:09:02,397: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:09:02.428023459Z [2024-05-26 02:09:02,427: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:09:02.432614719Z [2024-05-26 02:09:02,432: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:09:02.432717476Z [2024-05-26 02:09:02,432: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:09:02.432883158Z [2024-05-26 02:09:02,432: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:09:02.433031222Z [2024-05-26 02:09:02,432: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:09:02.433363768Z [2024-05-26 02:09:02,433: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:09:02.433417534Z [2024-05-26 02:09:02,433: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:09:02.539351886Z [2024-05-26 02:09:02,539: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:09:04.195059483Z [2024-05-26 02:09:04,194: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9118c2f7-2ef3-472c-9728-d9aa4e903ec5] succeeded in 3.8205227029993694s: None 2024-05-26T02:09:05.016875458Z [2024-05-26 02:09:05,016: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e122f81b-c216-472b-8f8a-9ded4272d4b0] succeeded in 4.649141843001416s: None 2024-05-26T02:10:00.393833322Z [2024-05-26 02:10:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de89aaf0-443a-4ecd-bc25-cbff2fa9c0e5] received 2024-05-26T02:10:00.397048531Z [2024-05-26 02:10:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42517242-a8f0-4eae-a0ed-06a4d571ae05] received 2024-05-26T02:10:00.411369796Z [2024-05-26 02:10:00,410: INFO/ForkPoolWorker-16] [42517242-a8f0-4eae-a0ed-06a4d571ae05] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:10:00.411826744Z [2024-05-26 02:10:00,411: INFO/ForkPoolWorker-15] [de89aaf0-443a-4ecd-bc25-cbff2fa9c0e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:10:00.415850448Z [2024-05-26 02:10:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce6823bf-b8d5-4728-bc0b-2101551cff31] received 2024-05-26T02:10:00.430761422Z [2024-05-26 02:10:00,430: INFO/ForkPoolWorker-1] [ce6823bf-b8d5-4728-bc0b-2101551cff31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:10:00.437564015Z [2024-05-26 02:10:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b9e0455-3a1b-4b15-85ee-553f110d6795] received 2024-05-26T02:10:00.449642555Z [2024-05-26 02:10:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fa1ddb9-3acc-4da7-a17c-cefd6e6a154f] received 2024-05-26T02:10:00.457273006Z [2024-05-26 02:10:00,456: INFO/ForkPoolWorker-2] [9b9e0455-3a1b-4b15-85ee-553f110d6795] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:10:00.474230240Z [2024-05-26 02:10:00,473: INFO/ForkPoolWorker-3] [7fa1ddb9-3acc-4da7-a17c-cefd6e6a154f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:10:00.800895333Z [2024-05-26 02:10:00,795: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:10:00.847528941Z [2024-05-26 02:10:00,843: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:10:00.922725368Z [2024-05-26 02:10:00,919: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:10:00.929435171Z [2024-05-26 02:10:00,926: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:10:00.959463037Z [2024-05-26 02:10:00,944: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:10:01.304662035Z [2024-05-26 02:10:01,304: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:10:01.330675632Z [2024-05-26 02:10:01,330: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:10:01.335184238Z [2024-05-26 02:10:01,334: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:10:01.394436487Z [2024-05-26 02:10:01,394: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:10:01.395412174Z [2024-05-26 02:10:01,395: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:10:01.395469315Z [2024-05-26 02:10:01,395: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:10:01.395532922Z [2024-05-26 02:10:01,395: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:10:01.395819207Z [2024-05-26 02:10:01,395: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:10:01.520333727Z [2024-05-26 02:10:01,520: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:10:01.927594067Z [2024-05-26 02:10:01,927: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42517242-a8f0-4eae-a0ed-06a4d571ae05] succeeded in 1.5268686399995204s: None 2024-05-26T02:10:02.349896246Z [2024-05-26 02:10:02,349: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9b9e0455-3a1b-4b15-85ee-553f110d6795] succeeded in 1.90813453300143s: None 2024-05-26T02:10:02.483729309Z [2024-05-26 02:10:02,483: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:10:02.486901374Z [2024-05-26 02:10:02,486: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:10:02.510155090Z [2024-05-26 02:10:02,509: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:10:02.511575080Z [2024-05-26 02:10:02,511: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:10:02.511640443Z [2024-05-26 02:10:02,511: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:10:02.511802035Z [2024-05-26 02:10:02,511: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:10:02.511871477Z [2024-05-26 02:10:02,511: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:10:02.512187844Z [2024-05-26 02:10:02,512: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:10:02.512220351Z [2024-05-26 02:10:02,512: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:10:02.551058492Z [2024-05-26 02:10:02,550: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T02:10:02.554536850Z [2024-05-26 02:10:02,554: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:10:02.606914458Z [2024-05-26 02:10:02,606: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:10:02.607593775Z [2024-05-26 02:10:02,607: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T02:10:02.616549164Z [2024-05-26 02:10:02,616: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:10:02.616598894Z [2024-05-26 02:10:02,616: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:10:02.616862661Z [2024-05-26 02:10:02,616: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:10:02.616950392Z [2024-05-26 02:10:02,616: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T02:10:02.619478512Z [2024-05-26 02:10:02,619: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:10:02.619883206Z [2024-05-26 02:10:02,619: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:10:02.720297539Z [2024-05-26 02:10:02,720: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:10:02.763998084Z [2024-05-26 02:10:02,763: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:10:02.767107874Z [2024-05-26 02:10:02,766: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:10:02.807890737Z [2024-05-26 02:10:02,807: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:10:02.812615391Z [2024-05-26 02:10:02,812: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:10:02.812740982Z [2024-05-26 02:10:02,812: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:10:02.813280144Z [2024-05-26 02:10:02,812: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:10:02.813433554Z [2024-05-26 02:10:02,813: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:10:02.813733293Z [2024-05-26 02:10:02,813: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:10:02.813967275Z [2024-05-26 02:10:02,813: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:10:02.966758373Z [2024-05-26 02:10:02,966: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:10:03.792565444Z [2024-05-26 02:10:03,792: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de89aaf0-443a-4ecd-bc25-cbff2fa9c0e5] succeeded in 3.3937043960013398s: None 2024-05-26T02:10:04.200996419Z [2024-05-26 02:10:04,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43f2e62b-c6d1-4049-b56e-b40e3b56be05] received 2024-05-26T02:10:04.230255586Z [2024-05-26 02:10:04,229: INFO/ForkPoolWorker-15] [43f2e62b-c6d1-4049-b56e-b40e3b56be05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:10:04.301887946Z [2024-05-26 02:10:04,301: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7fa1ddb9-3acc-4da7-a17c-cefd6e6a154f] succeeded in 3.8486439360003715s: None 2024-05-26T02:10:04.645715259Z [2024-05-26 02:10:04,645: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ce6823bf-b8d5-4728-bc0b-2101551cff31] succeeded in 4.225088634999338s: None 2024-05-26T02:10:04.692226110Z [2024-05-26 02:10:04,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:10:05.956052751Z [2024-05-26 02:10:05,955: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:10:05.959230922Z [2024-05-26 02:10:05,958: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:10:05.983116284Z [2024-05-26 02:10:05,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:10:05.985393886Z [2024-05-26 02:10:05,985: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:10:05.985574731Z [2024-05-26 02:10:05,985: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:10:05.985803483Z [2024-05-26 02:10:05,985: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:10:05.986029144Z [2024-05-26 02:10:05,985: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:10:05.986529447Z [2024-05-26 02:10:05,986: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:10:05.986681617Z [2024-05-26 02:10:05,986: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:10:06.106133097Z [2024-05-26 02:10:06,105: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:10:06.770802337Z [2024-05-26 02:10:06,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43f2e62b-c6d1-4049-b56e-b40e3b56be05] succeeded in 2.567848070999389s: None 2024-05-26T02:10:06.942071892Z [2024-05-26 02:10:06,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7905b2a6-40f1-477d-bca7-c4f491d800df] received 2024-05-26T02:10:06.955384098Z [2024-05-26 02:10:06,954: INFO/ForkPoolWorker-15] [7905b2a6-40f1-477d-bca7-c4f491d800df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:10:07.258482912Z [2024-05-26 02:10:07,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:10:08.478859872Z [2024-05-26 02:10:08,478: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:10:08.483205790Z [2024-05-26 02:10:08,482: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:10:08.520160306Z [2024-05-26 02:10:08,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:10:08.521519715Z [2024-05-26 02:10:08,521: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:10:08.521536295Z [2024-05-26 02:10:08,521: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:10:08.521629970Z [2024-05-26 02:10:08,521: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:10:08.521652377Z [2024-05-26 02:10:08,521: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:10:08.522008846Z [2024-05-26 02:10:08,521: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:10:08.522019767Z [2024-05-26 02:10:08,521: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:10:08.625543780Z [2024-05-26 02:10:08,625: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:10:10.298581787Z [2024-05-26 02:10:10,297: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7905b2a6-40f1-477d-bca7-c4f491d800df] succeeded in 3.3520868020004855s: None 2024-05-26T02:10:10.445990420Z [2024-05-26 02:10:10,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bd4ba75-68ea-4d7d-aef3-6f8dd550857a] received 2024-05-26T02:10:10.452787678Z [2024-05-26 02:10:10,452: INFO/ForkPoolWorker-15] [8bd4ba75-68ea-4d7d-aef3-6f8dd550857a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:10:10.768350573Z [2024-05-26 02:10:10,764: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:10:11.815941759Z [2024-05-26 02:10:11,815: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:10:11.819027556Z [2024-05-26 02:10:11,818: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:10:11.843358677Z [2024-05-26 02:10:11,843: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:10:11.844778665Z [2024-05-26 02:10:11,844: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:10:11.844942727Z [2024-05-26 02:10:11,844: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:10:11.844990213Z [2024-05-26 02:10:11,844: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:10:11.845004729Z [2024-05-26 02:10:11,844: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:10:11.845246044Z [2024-05-26 02:10:11,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:10:11.845272873Z [2024-05-26 02:10:11,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:10:11.956105629Z [2024-05-26 02:10:11,954: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:10:12.684158048Z [2024-05-26 02:10:12,683: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8bd4ba75-68ea-4d7d-aef3-6f8dd550857a] succeeded in 2.2361499360013113s: None 2024-05-26T02:11:00.326874057Z [2024-05-26 02:11:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64ddc7b2-608e-4189-b59d-a0e7df380f28] received 2024-05-26T02:11:00.330426042Z [2024-05-26 02:11:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f50dcbe4-5944-47de-8b45-ff597c088a9d] received 2024-05-26T02:11:00.332619390Z [2024-05-26 02:11:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c791f0c8-cd04-408b-a929-d900763f386d] received 2024-05-26T02:11:00.343096307Z [2024-05-26 02:11:00,342: INFO/ForkPoolWorker-1] [c791f0c8-cd04-408b-a929-d900763f386d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:11:00.349059056Z [2024-05-26 02:11:00,348: INFO/ForkPoolWorker-16] [f50dcbe4-5944-47de-8b45-ff597c088a9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:11:00.352109606Z [2024-05-26 02:11:00,351: INFO/ForkPoolWorker-15] [64ddc7b2-608e-4189-b59d-a0e7df380f28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:11:00.663300967Z [2024-05-26 02:11:00,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:11:00.664319835Z [2024-05-26 02:11:00,660: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:11:00.673838608Z [2024-05-26 02:11:00,669: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:11:00.835583950Z [2024-05-26 02:11:00,835: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:11:00.839339410Z [2024-05-26 02:11:00,838: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:11:00.869781195Z [2024-05-26 02:11:00,869: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:11:00.874995296Z [2024-05-26 02:11:00,874: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:11:00.875211284Z [2024-05-26 02:11:00,874: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:11:00.875399408Z [2024-05-26 02:11:00,875: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:11:00.875740481Z [2024-05-26 02:11:00,875: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:11:00.969460521Z [2024-05-26 02:11:00,969: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:11:01.546651323Z [2024-05-26 02:11:01,545: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f50dcbe4-5944-47de-8b45-ff597c088a9d] succeeded in 1.2130314840014762s: None 2024-05-26T02:11:01.766644722Z [2024-05-26 02:11:01,766: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:11:01.769848796Z [2024-05-26 02:11:01,769: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:11:01.797024266Z [2024-05-26 02:11:01,796: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:11:01.798912103Z [2024-05-26 02:11:01,798: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:11:01.798996292Z [2024-05-26 02:11:01,798: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:11:01.799209085Z [2024-05-26 02:11:01,799: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:11:01.799329246Z [2024-05-26 02:11:01,799: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:11:01.799727808Z [2024-05-26 02:11:01,799: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:11:01.800391566Z [2024-05-26 02:11:01,800: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:11:01.880864749Z [2024-05-26 02:11:01,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:11:01.902813026Z [2024-05-26 02:11:01,902: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:11:01.905855255Z [2024-05-26 02:11:01,905: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:11:01.929761010Z [2024-05-26 02:11:01,929: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:11:01.931424413Z [2024-05-26 02:11:01,931: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:11:01.931699175Z [2024-05-26 02:11:01,931: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:11:01.932017099Z [2024-05-26 02:11:01,931: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:11:01.932166169Z [2024-05-26 02:11:01,931: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:11:01.932928824Z [2024-05-26 02:11:01,932: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:11:01.934654062Z [2024-05-26 02:11:01,934: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:11:02.021512005Z [2024-05-26 02:11:02,021: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:11:03.493651762Z [2024-05-26 02:11:03,493: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c791f0c8-cd04-408b-a929-d900763f386d] succeeded in 3.158028451000064s: None 2024-05-26T02:11:03.804294356Z [2024-05-26 02:11:03,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64ddc7b2-608e-4189-b59d-a0e7df380f28] succeeded in 3.471031581000716s: None 2024-05-26T02:12:00.823644940Z [2024-05-26 02:12:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd155c37-d256-4de7-8bf2-4b8f78c0c589] received 2024-05-26T02:12:00.829932395Z [2024-05-26 02:12:00,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bafb59e5-f6a7-49d7-8453-0b3a9b18d266] received 2024-05-26T02:12:00.838758464Z [2024-05-26 02:12:00,838: INFO/ForkPoolWorker-15] [bd155c37-d256-4de7-8bf2-4b8f78c0c589] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:12:00.840897967Z [2024-05-26 02:12:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b046d72-7a0a-43d5-a6dc-2810702a9d34] received 2024-05-26T02:12:00.843736421Z [2024-05-26 02:12:00,843: INFO/ForkPoolWorker-16] [bafb59e5-f6a7-49d7-8453-0b3a9b18d266] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:12:00.844330267Z [2024-05-26 02:12:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca9fb403-bbb0-4d44-a55a-77b37f134587] received 2024-05-26T02:12:00.859677722Z [2024-05-26 02:12:00,857: INFO/ForkPoolWorker-1] [5b046d72-7a0a-43d5-a6dc-2810702a9d34] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:12:00.874762281Z [2024-05-26 02:12:00,874: INFO/ForkPoolWorker-2] [ca9fb403-bbb0-4d44-a55a-77b37f134587] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:12:01.173306051Z [2024-05-26 02:12:01,169: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:12:01.225473283Z [2024-05-26 02:12:01,222: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:12:01.291193632Z [2024-05-26 02:12:01,283: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:12:01.311879269Z [2024-05-26 02:12:01,308: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:12:01.511848872Z [2024-05-26 02:12:01,511: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:12:01.520875084Z [2024-05-26 02:12:01,520: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:12:01.566955658Z [2024-05-26 02:12:01,566: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:12:01.569163985Z [2024-05-26 02:12:01,568: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:12:01.569820543Z [2024-05-26 02:12:01,569: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:12:01.570464971Z [2024-05-26 02:12:01,570: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:12:01.571634180Z [2024-05-26 02:12:01,571: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:12:01.698710430Z [2024-05-26 02:12:01,698: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:12:01.704578409Z [2024-05-26 02:12:01,704: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:12:02.336593010Z [2024-05-26 02:12:02,336: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5b046d72-7a0a-43d5-a6dc-2810702a9d34] succeeded in 1.4885541330004344s: None 2024-05-26T02:12:02.457211535Z [2024-05-26 02:12:02,456: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bafb59e5-f6a7-49d7-8453-0b3a9b18d266] succeeded in 1.6234910909988685s: None 2024-05-26T02:12:02.640801303Z [2024-05-26 02:12:02,640: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:12:02.643939878Z [2024-05-26 02:12:02,643: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:12:02.687391537Z [2024-05-26 02:12:02,687: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:12:02.688644081Z [2024-05-26 02:12:02,688: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:12:02.688683629Z [2024-05-26 02:12:02,688: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:12:02.688784899Z [2024-05-26 02:12:02,688: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:12:02.688836123Z [2024-05-26 02:12:02,688: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:12:02.689070972Z [2024-05-26 02:12:02,688: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:12:02.689094553Z [2024-05-26 02:12:02,689: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:12:02.791150822Z [2024-05-26 02:12:02,790: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:12:02.791709139Z [2024-05-26 02:12:02,791: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:12:02.795271713Z [2024-05-26 02:12:02,794: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:12:02.825739520Z [2024-05-26 02:12:02,825: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:12:02.826958991Z [2024-05-26 02:12:02,826: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:12:02.826973032Z [2024-05-26 02:12:02,826: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:12:02.827183482Z [2024-05-26 02:12:02,826: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:12:02.827207904Z [2024-05-26 02:12:02,827: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:12:02.827501657Z [2024-05-26 02:12:02,827: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:12:02.827568243Z [2024-05-26 02:12:02,827: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:12:02.946989158Z [2024-05-26 02:12:02,946: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:12:04.897419032Z [2024-05-26 02:12:04,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd155c37-d256-4de7-8bf2-4b8f78c0c589] succeeded in 4.065973763999864s: None 2024-05-26T02:12:05.343601648Z [2024-05-26 02:12:05,343: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ca9fb403-bbb0-4d44-a55a-77b37f134587] succeeded in 4.477598412999214s: None 2024-05-26T02:13:00.758808625Z [2024-05-26 02:13:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b25a68f-5baa-4a47-bd56-3b78ca5beb31] received 2024-05-26T02:13:00.771159080Z [2024-05-26 02:13:00,770: INFO/ForkPoolWorker-15] [5b25a68f-5baa-4a47-bd56-3b78ca5beb31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:13:00.771553200Z [2024-05-26 02:13:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56a3c1f8-4a23-4ed6-ac8f-7b37af8a3d27] received 2024-05-26T02:13:00.774273716Z [2024-05-26 02:13:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9b0eba3-7e71-4b61-aa44-76aa4af7400a] received 2024-05-26T02:13:00.786665393Z [2024-05-26 02:13:00,782: INFO/ForkPoolWorker-16] [56a3c1f8-4a23-4ed6-ac8f-7b37af8a3d27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:13:00.787190003Z [2024-05-26 02:13:00,786: INFO/ForkPoolWorker-1] [b9b0eba3-7e71-4b61-aa44-76aa4af7400a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:13:01.081468266Z [2024-05-26 02:13:01,077: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:13:01.107076975Z [2024-05-26 02:13:01,103: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:13:01.161369656Z [2024-05-26 02:13:01,155: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:13:01.384421842Z [2024-05-26 02:13:01,383: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:13:01.388733029Z [2024-05-26 02:13:01,388: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:13:01.418549116Z [2024-05-26 02:13:01,418: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:13:01.431690961Z [2024-05-26 02:13:01,428: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:13:01.431721165Z [2024-05-26 02:13:01,428: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:13:01.431725195Z [2024-05-26 02:13:01,428: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:13:01.431728725Z [2024-05-26 02:13:01,428: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:13:01.532197763Z [2024-05-26 02:13:01,531: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:13:02.101546218Z [2024-05-26 02:13:02,101: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b9b0eba3-7e71-4b61-aa44-76aa4af7400a] succeeded in 1.3246794940005202s: None 2024-05-26T02:13:02.290712322Z [2024-05-26 02:13:02,290: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:13:02.294289869Z [2024-05-26 02:13:02,293: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:13:02.300522098Z [2024-05-26 02:13:02,300: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:13:02.303683480Z [2024-05-26 02:13:02,303: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:13:02.312338617Z [2024-05-26 02:13:02,312: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:13:02.313578377Z [2024-05-26 02:13:02,313: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:13:02.313605595Z [2024-05-26 02:13:02,313: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:13:02.313731339Z [2024-05-26 02:13:02,313: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:13:02.313750338Z [2024-05-26 02:13:02,313: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:13:02.313978082Z [2024-05-26 02:13:02,313: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:13:02.314003328Z [2024-05-26 02:13:02,313: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:13:02.338019279Z [2024-05-26 02:13:02,337: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:13:02.341392078Z [2024-05-26 02:13:02,341: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:13:02.341882065Z [2024-05-26 02:13:02,341: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:13:02.342287470Z [2024-05-26 02:13:02,341: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:13:02.342602418Z [2024-05-26 02:13:02,342: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:13:02.343302207Z [2024-05-26 02:13:02,342: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:13:02.343615217Z [2024-05-26 02:13:02,343: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:13:02.398767247Z [2024-05-26 02:13:02,398: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:13:02.461278918Z [2024-05-26 02:13:02,461: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:13:04.277413167Z [2024-05-26 02:13:04,276: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[56a3c1f8-4a23-4ed6-ac8f-7b37af8a3d27] succeeded in 3.503210394001144s: None 2024-05-26T02:13:04.726197675Z [2024-05-26 02:13:04,725: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b25a68f-5baa-4a47-bd56-3b78ca5beb31] succeeded in 3.9648831270005758s: None 2024-05-26T02:14:00.671679734Z [2024-05-26 02:14:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b900cff2-6ba7-4944-baac-87dc10ece01e] received 2024-05-26T02:14:00.677455171Z [2024-05-26 02:14:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4363466-30e2-4b4c-86ca-c676634bbd81] received 2024-05-26T02:14:00.684218634Z [2024-05-26 02:14:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25f87488-5e9d-43ba-8517-a4719ee62e35] received 2024-05-26T02:14:00.684709862Z [2024-05-26 02:14:00,684: INFO/ForkPoolWorker-15] [b900cff2-6ba7-4944-baac-87dc10ece01e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:14:00.692419824Z [2024-05-26 02:14:00,692: INFO/ForkPoolWorker-16] [d4363466-30e2-4b4c-86ca-c676634bbd81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:14:00.701243196Z [2024-05-26 02:14:00,700: INFO/ForkPoolWorker-1] [25f87488-5e9d-43ba-8517-a4719ee62e35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:14:00.712897584Z [2024-05-26 02:14:00,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c9f579f-c427-4736-b41a-cc2367a4e121] received 2024-05-26T02:14:00.745404983Z [2024-05-26 02:14:00,736: INFO/ForkPoolWorker-2] [6c9f579f-c427-4736-b41a-cc2367a4e121] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:14:01.066251106Z [2024-05-26 02:14:01,062: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:14:01.081273840Z [2024-05-26 02:14:01,075: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:14:01.107080759Z [2024-05-26 02:14:01,104: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:14:01.231339545Z [2024-05-26 02:14:01,227: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:14:01.448934028Z [2024-05-26 02:14:01,448: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:14:01.453142996Z [2024-05-26 02:14:01,452: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:14:01.460263397Z [2024-05-26 02:14:01,459: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:14:01.484123144Z [2024-05-26 02:14:01,483: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:14:01.487304528Z [2024-05-26 02:14:01,487: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:14:01.487351066Z [2024-05-26 02:14:01,487: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:14:01.487425129Z [2024-05-26 02:14:01,487: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:14:01.488310866Z [2024-05-26 02:14:01,487: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:14:01.600407449Z [2024-05-26 02:14:01,600: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:14:02.085672307Z [2024-05-26 02:14:02,085: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b900cff2-6ba7-4944-baac-87dc10ece01e] succeeded in 1.411643383999035s: None 2024-05-26T02:14:02.341377939Z [2024-05-26 02:14:02,340: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6c9f579f-c427-4736-b41a-cc2367a4e121] succeeded in 1.6157968429997709s: None 2024-05-26T02:14:02.429547244Z [2024-05-26 02:14:02,429: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:14:02.432769688Z [2024-05-26 02:14:02,432: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:14:02.468213838Z [2024-05-26 02:14:02,467: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:14:02.469679790Z [2024-05-26 02:14:02,469: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:14:02.471033941Z [2024-05-26 02:14:02,470: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:14:02.472174417Z [2024-05-26 02:14:02,470: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:14:02.472563516Z [2024-05-26 02:14:02,472: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:14:02.472674906Z [2024-05-26 02:14:02,472: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:14:02.473005107Z [2024-05-26 02:14:02,472: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:14:02.473791764Z [2024-05-26 02:14:02,473: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:14:02.474028673Z [2024-05-26 02:14:02,473: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:14:02.496134249Z [2024-05-26 02:14:02,495: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:14:02.497515619Z [2024-05-26 02:14:02,497: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:14:02.497722662Z [2024-05-26 02:14:02,497: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:14:02.497962720Z [2024-05-26 02:14:02,497: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:14:02.498114404Z [2024-05-26 02:14:02,498: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:14:02.498500925Z [2024-05-26 02:14:02,498: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:14:02.498659500Z [2024-05-26 02:14:02,498: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:14:02.593922780Z [2024-05-26 02:14:02,593: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:14:02.595763248Z [2024-05-26 02:14:02,595: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:14:04.689233073Z [2024-05-26 02:14:04,688: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25f87488-5e9d-43ba-8517-a4719ee62e35] succeeded in 4.003068595000514s: None 2024-05-26T02:14:05.033670378Z [2024-05-26 02:14:05,033: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d4363466-30e2-4b4c-86ca-c676634bbd81] succeeded in 4.353725135999412s: None 2024-05-26T02:15:00.935020061Z [2024-05-26 02:15:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff17595d-4aba-435e-9d30-e408df4e77a0] received 2024-05-26T02:15:00.940679697Z [2024-05-26 02:15:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[093d601e-6515-45f2-82d0-bae1aa4df9e6] received 2024-05-26T02:15:00.951490924Z [2024-05-26 02:15:00,951: INFO/ForkPoolWorker-16] [093d601e-6515-45f2-82d0-bae1aa4df9e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:15:00.952653924Z [2024-05-26 02:15:00,952: INFO/ForkPoolWorker-15] [ff17595d-4aba-435e-9d30-e408df4e77a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:15:00.960375708Z [2024-05-26 02:15:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d96fe6d0-5d62-4f9c-a6b7-c961b8a88fab] received 2024-05-26T02:15:00.963512809Z [2024-05-26 02:15:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0869f7b6-d94e-463c-bf39-7de4aade5c03] received 2024-05-26T02:15:00.980575764Z [2024-05-26 02:15:00,975: INFO/ForkPoolWorker-2] [0869f7b6-d94e-463c-bf39-7de4aade5c03] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:15:00.984575535Z [2024-05-26 02:15:00,984: INFO/ForkPoolWorker-1] [d96fe6d0-5d62-4f9c-a6b7-c961b8a88fab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:15:01.295605888Z [2024-05-26 02:15:01,291: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:15:01.365724602Z [2024-05-26 02:15:01,362: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:15:01.597337547Z [2024-05-26 02:15:01,587: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:15:01.685222727Z [2024-05-26 02:15:01,671: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:15:01.879125337Z [2024-05-26 02:15:01,878: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:15:01.883176030Z [2024-05-26 02:15:01,882: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:15:01.928984985Z [2024-05-26 02:15:01,928: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:15:01.932382448Z [2024-05-26 02:15:01,932: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:15:01.932408271Z [2024-05-26 02:15:01,932: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:15:01.932412632Z [2024-05-26 02:15:01,932: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:15:01.932717929Z [2024-05-26 02:15:01,932: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:15:02.070007116Z [2024-05-26 02:15:02,069: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:15:02.670595021Z [2024-05-26 02:15:02,670: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0869f7b6-d94e-463c-bf39-7de4aade5c03] succeeded in 1.7047900340003252s: None 2024-05-26T02:15:02.742697097Z [2024-05-26 02:15:02,741: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:15:02.747638629Z [2024-05-26 02:15:02,747: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:15:02.775160872Z [2024-05-26 02:15:02,774: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:15:02.780169400Z [2024-05-26 02:15:02,779: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:15:02.798767982Z [2024-05-26 02:15:02,798: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:15:02.800450813Z [2024-05-26 02:15:02,800: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:15:02.800477872Z [2024-05-26 02:15:02,800: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:15:02.801825252Z [2024-05-26 02:15:02,800: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:15:02.801944591Z [2024-05-26 02:15:02,801: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:15:02.802260024Z [2024-05-26 02:15:02,802: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:15:02.802475395Z [2024-05-26 02:15:02,802: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:15:02.821638281Z [2024-05-26 02:15:02,821: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:15:02.824576153Z [2024-05-26 02:15:02,824: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:15:02.824630628Z [2024-05-26 02:15:02,824: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:15:02.824859442Z [2024-05-26 02:15:02,824: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:15:02.824873073Z [2024-05-26 02:15:02,824: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:15:02.825263919Z [2024-05-26 02:15:02,825: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:15:02.825411332Z [2024-05-26 02:15:02,825: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:15:02.923751772Z [2024-05-26 02:15:02,923: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:15:02.925205487Z [2024-05-26 02:15:02,924: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:15:03.230998147Z [2024-05-26 02:15:03,230: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:15:03.234685128Z [2024-05-26 02:15:03,234: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:15:03.282180121Z [2024-05-26 02:15:03,281: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:15:03.286575057Z [2024-05-26 02:15:03,286: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:15:03.286594829Z [2024-05-26 02:15:03,286: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:15:03.286821939Z [2024-05-26 02:15:03,286: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:15:03.286881000Z [2024-05-26 02:15:03,286: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:15:03.287263904Z [2024-05-26 02:15:03,287: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:15:03.287318738Z [2024-05-26 02:15:03,287: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:15:03.561730390Z [2024-05-26 02:15:03,561: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:15:03.764528695Z [2024-05-26 02:15:03,764: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff17595d-4aba-435e-9d30-e408df4e77a0] succeeded in 2.8263640590012074s: None 2024-05-26T02:15:03.991440559Z [2024-05-26 02:15:03,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[788ca12e-f4f8-474e-9496-2e5cbb32804f] received 2024-05-26T02:15:04.018333937Z [2024-05-26 02:15:04,017: INFO/ForkPoolWorker-15] [788ca12e-f4f8-474e-9496-2e5cbb32804f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:15:04.401255974Z [2024-05-26 02:15:04,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:15:05.172066207Z [2024-05-26 02:15:05,168: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[093d601e-6515-45f2-82d0-bae1aa4df9e6] succeeded in 4.2263215980001405s: None 2024-05-26T02:15:05.338987130Z [2024-05-26 02:15:05,338: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d96fe6d0-5d62-4f9c-a6b7-c961b8a88fab] succeeded in 4.373694190999231s: None 2024-05-26T02:15:05.844728326Z [2024-05-26 02:15:05,844: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:15:05.848126096Z [2024-05-26 02:15:05,847: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:15:05.872317005Z [2024-05-26 02:15:05,872: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:15:05.873717106Z [2024-05-26 02:15:05,873: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:15:05.873846496Z [2024-05-26 02:15:05,873: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:15:05.874149244Z [2024-05-26 02:15:05,873: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:15:05.874293020Z [2024-05-26 02:15:05,874: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:15:05.874644279Z [2024-05-26 02:15:05,874: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:15:05.874810672Z [2024-05-26 02:15:05,874: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:15:05.975885850Z [2024-05-26 02:15:05,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:15:06.638062778Z [2024-05-26 02:15:06,637: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[788ca12e-f4f8-474e-9496-2e5cbb32804f] succeeded in 2.6406996339992475s: None 2024-05-26T02:15:06.690679648Z [2024-05-26 02:15:06,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cf27352-aebb-4fa4-b372-2e0510de0025] received 2024-05-26T02:15:06.718739618Z [2024-05-26 02:15:06,718: INFO/ForkPoolWorker-15] [2cf27352-aebb-4fa4-b372-2e0510de0025] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:15:07.025560872Z [2024-05-26 02:15:07,021: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:15:08.155915999Z [2024-05-26 02:15:08,155: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:15:08.159116149Z [2024-05-26 02:15:08,158: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:15:08.176113674Z [2024-05-26 02:15:08,175: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:15:08.177206364Z [2024-05-26 02:15:08,176: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:15:08.177263743Z [2024-05-26 02:15:08,177: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:15:08.177324785Z [2024-05-26 02:15:08,177: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:15:08.177343952Z [2024-05-26 02:15:08,177: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:15:08.177663074Z [2024-05-26 02:15:08,177: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:15:08.177731858Z [2024-05-26 02:15:08,177: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:15:08.262300643Z [2024-05-26 02:15:08,261: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:15:09.793949951Z [2024-05-26 02:15:09,793: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cf27352-aebb-4fa4-b372-2e0510de0025] succeeded in 3.099783278999894s: None 2024-05-26T02:15:10.837366604Z [2024-05-26 02:15:10,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d71fa87-7170-4e2e-aad2-cbbf20a9a3f1] received 2024-05-26T02:15:10.849933724Z [2024-05-26 02:15:10,849: INFO/ForkPoolWorker-15] [7d71fa87-7170-4e2e-aad2-cbbf20a9a3f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:15:11.131146170Z [2024-05-26 02:15:11,128: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:15:12.245626647Z [2024-05-26 02:15:12,245: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:15:12.249318377Z [2024-05-26 02:15:12,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:15:12.272124644Z [2024-05-26 02:15:12,271: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:15:12.273602684Z [2024-05-26 02:15:12,273: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:15:12.273753339Z [2024-05-26 02:15:12,273: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:15:12.274084999Z [2024-05-26 02:15:12,273: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:15:12.274281575Z [2024-05-26 02:15:12,274: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:15:12.274617811Z [2024-05-26 02:15:12,274: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:15:12.274827381Z [2024-05-26 02:15:12,274: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:15:12.372675242Z [2024-05-26 02:15:12,372: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:15:13.039778063Z [2024-05-26 02:15:13,038: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d71fa87-7170-4e2e-aad2-cbbf20a9a3f1] succeeded in 2.198582963001172s: None 2024-05-26T02:16:00.524012362Z [2024-05-26 02:16:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba2333f9-d0bc-48ef-9ccd-4d38b38d04b7] received 2024-05-26T02:16:00.529736011Z [2024-05-26 02:16:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8650c63-813c-4c53-88a2-fa1a3029f099] received 2024-05-26T02:16:00.537838413Z [2024-05-26 02:16:00,537: INFO/ForkPoolWorker-15] [ba2333f9-d0bc-48ef-9ccd-4d38b38d04b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:16:00.546494677Z [2024-05-26 02:16:00,545: INFO/ForkPoolWorker-16] [e8650c63-813c-4c53-88a2-fa1a3029f099] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:16:00.547351256Z [2024-05-26 02:16:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff2f1cc0-c539-4f55-a8e5-a4b4a46810c8] received 2024-05-26T02:16:00.554753259Z [2024-05-26 02:16:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[753e089b-285d-4a2f-bed0-d144220706de] received 2024-05-26T02:16:00.564351183Z [2024-05-26 02:16:00,563: INFO/ForkPoolWorker-1] [ff2f1cc0-c539-4f55-a8e5-a4b4a46810c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:16:00.567940596Z [2024-05-26 02:16:00,567: INFO/ForkPoolWorker-2] [753e089b-285d-4a2f-bed0-d144220706de] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:16:00.900131006Z [2024-05-26 02:16:00,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:16:00.946612775Z [2024-05-26 02:16:00,943: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:16:00.978132846Z [2024-05-26 02:16:00,974: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:16:00.983206758Z [2024-05-26 02:16:00,979: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:16:01.102858272Z [2024-05-26 02:16:01,102: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:16:01.106796648Z [2024-05-26 02:16:01,106: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:16:01.132306767Z [2024-05-26 02:16:01,132: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:16:01.138293026Z [2024-05-26 02:16:01,138: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:16:01.138735735Z [2024-05-26 02:16:01,138: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:16:01.138925089Z [2024-05-26 02:16:01,138: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:16:01.139739548Z [2024-05-26 02:16:01,139: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:16:01.223650179Z [2024-05-26 02:16:01,223: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:16:01.246462419Z [2024-05-26 02:16:01,246: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:16:01.857197636Z [2024-05-26 02:16:01,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba2333f9-d0bc-48ef-9ccd-4d38b38d04b7] succeeded in 1.330861870001172s: None 2024-05-26T02:16:01.858097356Z [2024-05-26 02:16:01,857: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[753e089b-285d-4a2f-bed0-d144220706de] succeeded in 1.3000660309990053s: None 2024-05-26T02:16:02.354495757Z [2024-05-26 02:16:02,353: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:16:02.358046764Z [2024-05-26 02:16:02,357: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:16:02.378637308Z [2024-05-26 02:16:02,378: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:16:02.388510358Z [2024-05-26 02:16:02,388: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:16:02.388554132Z [2024-05-26 02:16:02,388: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:16:02.388854189Z [2024-05-26 02:16:02,388: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:16:02.388949181Z [2024-05-26 02:16:02,388: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:16:02.389436315Z [2024-05-26 02:16:02,389: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:16:02.389554513Z [2024-05-26 02:16:02,389: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:16:02.405325278Z [2024-05-26 02:16:02,404: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:16:02.408448066Z [2024-05-26 02:16:02,407: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:16:02.430001366Z [2024-05-26 02:16:02,429: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:16:02.432186130Z [2024-05-26 02:16:02,431: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:16:02.432583944Z [2024-05-26 02:16:02,432: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:16:02.432742561Z [2024-05-26 02:16:02,432: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:16:02.433237195Z [2024-05-26 02:16:02,433: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:16:02.433587111Z [2024-05-26 02:16:02,433: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:16:02.433612483Z [2024-05-26 02:16:02,433: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:16:02.496436843Z [2024-05-26 02:16:02,496: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:16:02.516417978Z [2024-05-26 02:16:02,516: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:16:04.058430485Z [2024-05-26 02:16:04,057: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff2f1cc0-c539-4f55-a8e5-a4b4a46810c8] succeeded in 3.506791058998715s: None 2024-05-26T02:16:04.416679277Z [2024-05-26 02:16:04,416: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e8650c63-813c-4c53-88a2-fa1a3029f099] succeeded in 3.880253077000816s: None 2024-05-26T02:17:01.027076662Z [2024-05-26 02:17:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8441823e-b0d1-427a-9284-f2e4b57e32de] received 2024-05-26T02:17:01.033094281Z [2024-05-26 02:17:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c78e165-5772-4fa5-87bc-ae8bd817a125] received 2024-05-26T02:17:01.034633101Z [2024-05-26 02:17:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[784f0dad-54c7-4115-9308-9f7232841a9f] received 2024-05-26T02:17:01.042440209Z [2024-05-26 02:17:01,042: INFO/ForkPoolWorker-15] [8441823e-b0d1-427a-9284-f2e4b57e32de] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:17:01.051631108Z [2024-05-26 02:17:01,051: INFO/ForkPoolWorker-16] [8c78e165-5772-4fa5-87bc-ae8bd817a125] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:17:01.052228992Z [2024-05-26 02:17:01,051: INFO/ForkPoolWorker-1] [784f0dad-54c7-4115-9308-9f7232841a9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:17:01.350923820Z [2024-05-26 02:17:01,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:17:01.403241051Z [2024-05-26 02:17:01,398: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:17:01.406922092Z [2024-05-26 02:17:01,403: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:17:01.566576814Z [2024-05-26 02:17:01,565: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T02:17:01.571868873Z [2024-05-26 02:17:01,570: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:17:01.602273078Z [2024-05-26 02:17:01,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:17:01.603728762Z [2024-05-26 02:17:01,603: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:17:01.603939297Z [2024-05-26 02:17:01,603: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:17:01.604126058Z [2024-05-26 02:17:01,603: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T02:17:01.604547142Z [2024-05-26 02:17:01,604: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:17:01.735360328Z [2024-05-26 02:17:01,735: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:17:02.381839493Z [2024-05-26 02:17:02,381: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8441823e-b0d1-427a-9284-f2e4b57e32de] succeeded in 1.3515700620009738s: None 2024-05-26T02:17:02.697257891Z [2024-05-26 02:17:02,696: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:17:02.700517661Z [2024-05-26 02:17:02,700: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:17:02.726963655Z [2024-05-26 02:17:02,726: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:17:02.728834165Z [2024-05-26 02:17:02,728: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:17:02.729060923Z [2024-05-26 02:17:02,728: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:17:02.729327587Z [2024-05-26 02:17:02,729: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:17:02.729491875Z [2024-05-26 02:17:02,729: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:17:02.730333732Z [2024-05-26 02:17:02,730: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:17:02.730482440Z [2024-05-26 02:17:02,730: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:17:02.751502071Z [2024-05-26 02:17:02,751: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:17:02.755170819Z [2024-05-26 02:17:02,754: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:17:02.784524077Z [2024-05-26 02:17:02,784: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:17:02.786095990Z [2024-05-26 02:17:02,785: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:17:02.786239442Z [2024-05-26 02:17:02,786: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:17:02.786447024Z [2024-05-26 02:17:02,786: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:17:02.786571603Z [2024-05-26 02:17:02,786: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:17:02.786889623Z [2024-05-26 02:17:02,786: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:17:02.787027555Z [2024-05-26 02:17:02,786: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:17:02.819625140Z [2024-05-26 02:17:02,819: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:17:02.873289500Z [2024-05-26 02:17:02,872: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:17:04.548794685Z [2024-05-26 02:17:04,548: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[784f0dad-54c7-4115-9308-9f7232841a9f] succeeded in 3.5115358349994494s: None 2024-05-26T02:17:04.838466635Z [2024-05-26 02:17:04,838: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c78e165-5772-4fa5-87bc-ae8bd817a125] succeeded in 3.8029349530006584s: None 2024-05-26T02:18:00.437757648Z [2024-05-26 02:18:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[253be491-6af1-43ed-b18b-1cc9c4664ee3] received 2024-05-26T02:18:00.440972251Z [2024-05-26 02:18:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31c2eb44-575a-4615-88be-d6dc21fd3009] received 2024-05-26T02:18:00.452129352Z [2024-05-26 02:18:00,451: INFO/ForkPoolWorker-15] [253be491-6af1-43ed-b18b-1cc9c4664ee3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:18:00.453407531Z [2024-05-26 02:18:00,452: INFO/ForkPoolWorker-16] [31c2eb44-575a-4615-88be-d6dc21fd3009] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:18:00.454280786Z [2024-05-26 02:18:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[192536af-ff0f-407c-b0df-5e1c4bdc0fae] received 2024-05-26T02:18:00.473017502Z [2024-05-26 02:18:00,472: INFO/ForkPoolWorker-1] [192536af-ff0f-407c-b0df-5e1c4bdc0fae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:18:00.476778030Z [2024-05-26 02:18:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc9bfb79-9207-43d9-96b6-686e6221c6f9] received 2024-05-26T02:18:00.495143324Z [2024-05-26 02:18:00,494: INFO/ForkPoolWorker-2] [fc9bfb79-9207-43d9-96b6-686e6221c6f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:18:00.793746770Z [2024-05-26 02:18:00,777: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:18:00.875935747Z [2024-05-26 02:18:00,872: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:18:00.892164912Z [2024-05-26 02:18:00,888: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:18:01.083616950Z [2024-05-26 02:18:01,083: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:18:01.087492094Z [2024-05-26 02:18:01,087: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:18:01.101616600Z [2024-05-26 02:18:01,096: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:18:01.108256565Z [2024-05-26 02:18:01,108: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:18:01.109652549Z [2024-05-26 02:18:01,109: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:18:01.109813372Z [2024-05-26 02:18:01,109: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:18:01.109931357Z [2024-05-26 02:18:01,109: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:18:01.110179072Z [2024-05-26 02:18:01,110: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:18:01.206621489Z [2024-05-26 02:18:01,206: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:18:01.215904145Z [2024-05-26 02:18:01,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:18:01.797203235Z [2024-05-26 02:18:01,796: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[253be491-6af1-43ed-b18b-1cc9c4664ee3] succeeded in 1.3557571199999074s: None 2024-05-26T02:18:01.941158363Z [2024-05-26 02:18:01,940: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc9bfb79-9207-43d9-96b6-686e6221c6f9] succeeded in 1.4606290920000902s: None 2024-05-26T02:18:02.194080462Z [2024-05-26 02:18:02,193: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:18:02.197398118Z [2024-05-26 02:18:02,196: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:18:02.221897518Z [2024-05-26 02:18:02,221: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:18:02.223769356Z [2024-05-26 02:18:02,223: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:18:02.223970546Z [2024-05-26 02:18:02,223: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:18:02.224378513Z [2024-05-26 02:18:02,224: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:18:02.224531943Z [2024-05-26 02:18:02,224: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:18:02.224886077Z [2024-05-26 02:18:02,224: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:18:02.225034599Z [2024-05-26 02:18:02,224: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:18:02.312778953Z [2024-05-26 02:18:02,312: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:18:02.355460284Z [2024-05-26 02:18:02,355: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:18:02.358743951Z [2024-05-26 02:18:02,358: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:18:02.380529505Z [2024-05-26 02:18:02,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:18:02.381989581Z [2024-05-26 02:18:02,381: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:18:02.382131683Z [2024-05-26 02:18:02,381: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:18:02.382348609Z [2024-05-26 02:18:02,382: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:18:02.382479101Z [2024-05-26 02:18:02,382: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:18:02.382817754Z [2024-05-26 02:18:02,382: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:18:02.382960139Z [2024-05-26 02:18:02,382: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:18:02.457120570Z [2024-05-26 02:18:02,456: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:18:04.276179559Z [2024-05-26 02:18:04,275: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[192536af-ff0f-407c-b0df-5e1c4bdc0fae] succeeded in 3.8194266270002117s: None 2024-05-26T02:18:04.277941936Z [2024-05-26 02:18:04,277: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31c2eb44-575a-4615-88be-d6dc21fd3009] succeeded in 3.8331472809986735s: None 2024-05-26T02:19:01.073371830Z [2024-05-26 02:19:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abccb1d8-128d-47e3-bf25-b96154766897] received 2024-05-26T02:19:01.088586679Z [2024-05-26 02:19:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d89622da-3225-48ee-984a-7e836323d092] received 2024-05-26T02:19:01.093657074Z [2024-05-26 02:19:01,093: INFO/ForkPoolWorker-15] [abccb1d8-128d-47e3-bf25-b96154766897] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:19:01.101949524Z [2024-05-26 02:19:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3db91b5f-d24b-4040-b837-d3e2bd40af07] received 2024-05-26T02:19:01.117886497Z [2024-05-26 02:19:01,117: INFO/ForkPoolWorker-1] [3db91b5f-d24b-4040-b837-d3e2bd40af07] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:19:01.124243332Z [2024-05-26 02:19:01,123: INFO/ForkPoolWorker-16] [d89622da-3225-48ee-984a-7e836323d092] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:19:01.431157439Z [2024-05-26 02:19:01,427: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:19:01.453462557Z [2024-05-26 02:19:01,449: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:19:01.516875895Z [2024-05-26 02:19:01,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:19:01.633436359Z [2024-05-26 02:19:01,632: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:19:01.638642772Z [2024-05-26 02:19:01,638: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:19:01.682700951Z [2024-05-26 02:19:01,681: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:19:01.683456387Z [2024-05-26 02:19:01,683: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:19:01.683802386Z [2024-05-26 02:19:01,683: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:19:01.683972268Z [2024-05-26 02:19:01,683: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:19:01.684281176Z [2024-05-26 02:19:01,684: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:19:01.779446870Z [2024-05-26 02:19:01,779: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:19:02.482220764Z [2024-05-26 02:19:02,481: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3db91b5f-d24b-4040-b837-d3e2bd40af07] succeeded in 1.3774635329991725s: None 2024-05-26T02:19:02.648543530Z [2024-05-26 02:19:02,648: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:19:02.651760061Z [2024-05-26 02:19:02,651: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:19:02.705981649Z [2024-05-26 02:19:02,705: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:19:02.708012683Z [2024-05-26 02:19:02,707: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:19:02.708173201Z [2024-05-26 02:19:02,707: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:19:02.708365480Z [2024-05-26 02:19:02,708: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:19:02.708466517Z [2024-05-26 02:19:02,708: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:19:02.709082132Z [2024-05-26 02:19:02,708: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:19:02.709282048Z [2024-05-26 02:19:02,709: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:19:02.713759354Z [2024-05-26 02:19:02,713: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:19:02.717052186Z [2024-05-26 02:19:02,716: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:19:02.742516429Z [2024-05-26 02:19:02,742: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:19:02.745235118Z [2024-05-26 02:19:02,744: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:19:02.747263708Z [2024-05-26 02:19:02,747: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:19:02.747470325Z [2024-05-26 02:19:02,747: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:19:02.747971893Z [2024-05-26 02:19:02,747: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:19:02.748491543Z [2024-05-26 02:19:02,748: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:19:02.748682259Z [2024-05-26 02:19:02,748: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:19:02.805001190Z [2024-05-26 02:19:02,804: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:19:02.829557226Z [2024-05-26 02:19:02,829: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:19:04.525626844Z [2024-05-26 02:19:04,525: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[abccb1d8-128d-47e3-bf25-b96154766897] succeeded in 3.446193461999428s: None 2024-05-26T02:19:04.994961957Z [2024-05-26 02:19:04,994: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d89622da-3225-48ee-984a-7e836323d092] succeeded in 3.903438270999686s: None 2024-05-26T02:20:01.134277398Z [2024-05-26 02:20:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00446f1a-7332-4319-b835-cc0a46987f49] received 2024-05-26T02:20:01.137256248Z [2024-05-26 02:20:01,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64685c8b-fbe8-4371-9ff3-845bfa6ab47f] received 2024-05-26T02:20:01.147354751Z [2024-05-26 02:20:01,146: INFO/ForkPoolWorker-16] [64685c8b-fbe8-4371-9ff3-845bfa6ab47f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:20:01.151632750Z [2024-05-26 02:20:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87d04b48-3c7f-4c3a-9d68-3dcaff8714a0] received 2024-05-26T02:20:01.153658730Z [2024-05-26 02:20:01,153: INFO/ForkPoolWorker-15] [00446f1a-7332-4319-b835-cc0a46987f49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:20:01.153673583Z [2024-05-26 02:20:01,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[221fe51a-a24e-4f59-93c4-a8078d1e7f04] received 2024-05-26T02:20:01.160078274Z [2024-05-26 02:20:01,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e421d0da-74eb-4ae9-8bd9-e74a3a7c9356] received 2024-05-26T02:20:01.162465974Z [2024-05-26 02:20:01,162: INFO/ForkPoolWorker-1] [87d04b48-3c7f-4c3a-9d68-3dcaff8714a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:20:01.170596827Z [2024-05-26 02:20:01,170: INFO/ForkPoolWorker-2] [221fe51a-a24e-4f59-93c4-a8078d1e7f04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:20:01.172643598Z [2024-05-26 02:20:01,172: INFO/ForkPoolWorker-3] [e421d0da-74eb-4ae9-8bd9-e74a3a7c9356] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:20:01.550661192Z [2024-05-26 02:20:01,545: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:20:01.615553630Z [2024-05-26 02:20:01,610: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:20:01.691399571Z [2024-05-26 02:20:01,687: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:20:01.771174281Z [2024-05-26 02:20:01,763: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:20:01.798586867Z [2024-05-26 02:20:01,794: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:20:01.886418005Z [2024-05-26 02:20:01,886: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:20:01.975380121Z [2024-05-26 02:20:01,974: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:20:01.979637169Z [2024-05-26 02:20:01,979: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:20:02.008572989Z [2024-05-26 02:20:02,008: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:20:02.010042424Z [2024-05-26 02:20:02,009: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:20:02.010393422Z [2024-05-26 02:20:02,010: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:20:02.010603134Z [2024-05-26 02:20:02,010: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:20:02.012402632Z [2024-05-26 02:20:02,012: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:20:02.124230115Z [2024-05-26 02:20:02,123: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:20:02.481191795Z [2024-05-26 02:20:02,480: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[64685c8b-fbe8-4371-9ff3-845bfa6ab47f] succeeded in 1.3424238040006458s: None 2024-05-26T02:20:02.705018985Z [2024-05-26 02:20:02,704: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[87d04b48-3c7f-4c3a-9d68-3dcaff8714a0] succeeded in 1.5506034629997885s: None 2024-05-26T02:20:02.951807984Z [2024-05-26 02:20:02,951: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:20:02.955061749Z [2024-05-26 02:20:02,954: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:20:02.977119666Z [2024-05-26 02:20:02,976: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:20:02.978415210Z [2024-05-26 02:20:02,978: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:20:02.978439331Z [2024-05-26 02:20:02,978: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:20:02.978449977Z [2024-05-26 02:20:02,978: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:20:02.978455001Z [2024-05-26 02:20:02,978: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:20:02.978844766Z [2024-05-26 02:20:02,978: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:20:02.978862042Z [2024-05-26 02:20:02,978: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:20:02.984715085Z [2024-05-26 02:20:02,984: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T02:20:02.989134082Z [2024-05-26 02:20:02,988: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:20:03.014125528Z [2024-05-26 02:20:03,013: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T02:20:03.015330901Z [2024-05-26 02:20:03,015: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:20:03.015607006Z [2024-05-26 02:20:03,015: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:20:03.015872004Z [2024-05-26 02:20:03,015: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:20:03.016036461Z [2024-05-26 02:20:03,015: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T02:20:03.016452881Z [2024-05-26 02:20:03,016: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:20:03.016483486Z [2024-05-26 02:20:03,016: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:20:03.065825122Z [2024-05-26 02:20:03,065: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:20:03.104085371Z [2024-05-26 02:20:03,103: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:20:03.618812941Z [2024-05-26 02:20:03,618: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:20:03.622957855Z [2024-05-26 02:20:03,622: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:20:03.659643650Z [2024-05-26 02:20:03,659: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:20:03.662353494Z [2024-05-26 02:20:03,662: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:20:03.662365061Z [2024-05-26 02:20:03,662: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:20:03.662456139Z [2024-05-26 02:20:03,662: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:20:03.662483571Z [2024-05-26 02:20:03,662: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:20:03.662697611Z [2024-05-26 02:20:03,662: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:20:03.662713182Z [2024-05-26 02:20:03,662: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:20:03.745538936Z [2024-05-26 02:20:03,745: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:20:03.806726178Z [2024-05-26 02:20:03,806: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00446f1a-7332-4319-b835-cc0a46987f49] succeeded in 2.6671758929987845s: None 2024-05-26T02:20:03.903440524Z [2024-05-26 02:20:03,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e995a982-c307-4c06-baee-229905d1d2d2] received 2024-05-26T02:20:03.915424346Z [2024-05-26 02:20:03,915: INFO/ForkPoolWorker-15] [e995a982-c307-4c06-baee-229905d1d2d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:20:04.292993731Z [2024-05-26 02:20:04,289: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:20:05.590552790Z [2024-05-26 02:20:05,590: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:20:05.593765401Z [2024-05-26 02:20:05,593: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:20:05.617395616Z [2024-05-26 02:20:05,617: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:20:05.618566964Z [2024-05-26 02:20:05,618: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:20:05.618580886Z [2024-05-26 02:20:05,618: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:20:05.623629086Z [2024-05-26 02:20:05,618: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:20:05.623649763Z [2024-05-26 02:20:05,618: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:20:05.623656494Z [2024-05-26 02:20:05,618: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:20:05.623670320Z [2024-05-26 02:20:05,618: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:20:05.831336794Z [2024-05-26 02:20:05,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:20:05.947007791Z [2024-05-26 02:20:05,946: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[221fe51a-a24e-4f59-93c4-a8078d1e7f04] succeeded in 4.789524604999315s: None 2024-05-26T02:20:06.256610223Z [2024-05-26 02:20:06,256: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e421d0da-74eb-4ae9-8bd9-e74a3a7c9356] succeeded in 5.0942502039997635s: None 2024-05-26T02:20:06.636939603Z [2024-05-26 02:20:06,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e995a982-c307-4c06-baee-229905d1d2d2] succeeded in 2.7311792110012902s: None 2024-05-26T02:20:07.246041024Z [2024-05-26 02:20:07,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b17752a6-8ed2-41d9-b744-9b1fd92f9b33] received 2024-05-26T02:20:07.255675856Z [2024-05-26 02:20:07,255: INFO/ForkPoolWorker-15] [b17752a6-8ed2-41d9-b744-9b1fd92f9b33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:20:07.557156539Z [2024-05-26 02:20:07,553: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:20:08.694037810Z [2024-05-26 02:20:08,693: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:20:08.697172734Z [2024-05-26 02:20:08,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:20:08.721363016Z [2024-05-26 02:20:08,720: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:20:08.723491364Z [2024-05-26 02:20:08,722: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:20:08.723504425Z [2024-05-26 02:20:08,723: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:20:08.723674571Z [2024-05-26 02:20:08,723: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:20:08.724225385Z [2024-05-26 02:20:08,723: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:20:08.724264922Z [2024-05-26 02:20:08,723: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:20:08.724274419Z [2024-05-26 02:20:08,723: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:20:08.837732361Z [2024-05-26 02:20:08,837: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:20:10.425439915Z [2024-05-26 02:20:10,424: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b17752a6-8ed2-41d9-b744-9b1fd92f9b33] succeeded in 3.177759108999453s: None 2024-05-26T02:20:11.154377802Z [2024-05-26 02:20:11,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e107b94-b5ca-43a7-aafe-86fd6a3d61f2] received 2024-05-26T02:20:11.165507097Z [2024-05-26 02:20:11,165: INFO/ForkPoolWorker-15] [2e107b94-b5ca-43a7-aafe-86fd6a3d61f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:20:11.457262705Z [2024-05-26 02:20:11,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:20:12.522559492Z [2024-05-26 02:20:12,520: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:20:12.525678353Z [2024-05-26 02:20:12,525: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:20:12.548897419Z [2024-05-26 02:20:12,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:20:12.550127487Z [2024-05-26 02:20:12,549: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:20:12.550163081Z [2024-05-26 02:20:12,550: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:20:12.550316054Z [2024-05-26 02:20:12,550: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:20:12.550338050Z [2024-05-26 02:20:12,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:20:12.551603871Z [2024-05-26 02:20:12,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:20:12.551622700Z [2024-05-26 02:20:12,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:20:12.668797867Z [2024-05-26 02:20:12,668: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:20:13.298837614Z [2024-05-26 02:20:13,296: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e107b94-b5ca-43a7-aafe-86fd6a3d61f2] succeeded in 2.1391780199992354s: None 2024-05-26T02:21:00.714246619Z [2024-05-26 02:21:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00975678-5860-4cf4-b67a-0a53bdcbdded] received 2024-05-26T02:21:00.724215440Z [2024-05-26 02:21:00,723: INFO/ForkPoolWorker-15] [00975678-5860-4cf4-b67a-0a53bdcbdded] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:21:00.738023807Z [2024-05-26 02:21:00,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[465b4f44-1ee3-4bf7-a07e-917d858221bb] received 2024-05-26T02:21:00.738039624Z [2024-05-26 02:21:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bdb5dab-9518-4a61-be36-3b95d5017790] received 2024-05-26T02:21:00.743582347Z [2024-05-26 02:21:00,738: INFO/ForkPoolWorker-1] [6bdb5dab-9518-4a61-be36-3b95d5017790] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:21:00.763023016Z [2024-05-26 02:21:00,761: INFO/ForkPoolWorker-16] [465b4f44-1ee3-4bf7-a07e-917d858221bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:21:01.027311709Z [2024-05-26 02:21:01,024: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:21:01.031198328Z [2024-05-26 02:21:01,028: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:21:01.075659358Z [2024-05-26 02:21:01,072: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:21:01.224095209Z [2024-05-26 02:21:01,223: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:21:01.228071969Z [2024-05-26 02:21:01,227: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:21:01.270171570Z [2024-05-26 02:21:01,269: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:21:01.273774279Z [2024-05-26 02:21:01,273: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:21:01.274612421Z [2024-05-26 02:21:01,274: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:21:01.275730366Z [2024-05-26 02:21:01,275: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:21:01.276749581Z [2024-05-26 02:21:01,276: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:21:01.417875690Z [2024-05-26 02:21:01,417: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:21:02.078255783Z [2024-05-26 02:21:02,077: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6bdb5dab-9518-4a61-be36-3b95d5017790] succeeded in 1.3460787450003409s: None 2024-05-26T02:21:02.111165929Z [2024-05-26 02:21:02,110: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:21:02.114525327Z [2024-05-26 02:21:02,114: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:21:02.131903983Z [2024-05-26 02:21:02,131: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:21:02.136723999Z [2024-05-26 02:21:02,136: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:21:02.136764624Z [2024-05-26 02:21:02,136: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:21:02.136875189Z [2024-05-26 02:21:02,136: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:21:02.136897415Z [2024-05-26 02:21:02,136: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:21:02.137205445Z [2024-05-26 02:21:02,137: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:21:02.137249023Z [2024-05-26 02:21:02,137: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:21:02.213378900Z [2024-05-26 02:21:02,213: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:21:02.232224491Z [2024-05-26 02:21:02,231: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:21:02.235139558Z [2024-05-26 02:21:02,234: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:21:02.257298843Z [2024-05-26 02:21:02,257: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:21:02.259804235Z [2024-05-26 02:21:02,259: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:21:02.259825129Z [2024-05-26 02:21:02,259: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:21:02.259931415Z [2024-05-26 02:21:02,259: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:21:02.260040592Z [2024-05-26 02:21:02,259: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:21:02.260487045Z [2024-05-26 02:21:02,260: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:21:02.260613699Z [2024-05-26 02:21:02,260: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:21:02.336101641Z [2024-05-26 02:21:02,335: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:21:03.806921710Z [2024-05-26 02:21:03,806: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[465b4f44-1ee3-4bf7-a07e-917d858221bb] succeeded in 3.0707090020005126s: None 2024-05-26T02:21:04.586547512Z [2024-05-26 02:21:04,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00975678-5860-4cf4-b67a-0a53bdcbdded] succeeded in 3.870039227000234s: None 2024-05-26T02:22:01.295269611Z [2024-05-26 02:22:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7be2ade7-a9ec-48a0-8023-fe76e63ff0bd] received 2024-05-26T02:22:01.306128300Z [2024-05-26 02:22:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f394c1cc-9dd2-4c47-a259-b5836b57e652] received 2024-05-26T02:22:01.308303093Z [2024-05-26 02:22:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dad967b-0504-47c7-af70-95e7614be10c] received 2024-05-26T02:22:01.314658272Z [2024-05-26 02:22:01,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[785d4276-1eca-41b4-9847-81e9b8c47a60] received 2024-05-26T02:22:01.323580719Z [2024-05-26 02:22:01,323: INFO/ForkPoolWorker-16] [f394c1cc-9dd2-4c47-a259-b5836b57e652] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:22:01.326508133Z [2024-05-26 02:22:01,326: INFO/ForkPoolWorker-15] [7be2ade7-a9ec-48a0-8023-fe76e63ff0bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:22:01.348771460Z [2024-05-26 02:22:01,348: INFO/ForkPoolWorker-2] [785d4276-1eca-41b4-9847-81e9b8c47a60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:22:01.349677872Z [2024-05-26 02:22:01,349: INFO/ForkPoolWorker-1] [5dad967b-0504-47c7-af70-95e7614be10c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:22:01.671429262Z [2024-05-26 02:22:01,668: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:22:01.677128407Z [2024-05-26 02:22:01,674: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:22:01.693070209Z [2024-05-26 02:22:01,686: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:22:01.771117749Z [2024-05-26 02:22:01,766: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:22:01.841542535Z [2024-05-26 02:22:01,841: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:22:01.845825920Z [2024-05-26 02:22:01,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:22:01.890174224Z [2024-05-26 02:22:01,889: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:22:01.897191579Z [2024-05-26 02:22:01,896: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:22:01.898219158Z [2024-05-26 02:22:01,897: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:22:01.898533043Z [2024-05-26 02:22:01,898: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:22:01.899015516Z [2024-05-26 02:22:01,898: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:22:02.003640148Z [2024-05-26 02:22:02,003: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:22:02.114771938Z [2024-05-26 02:22:02,114: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:22:02.644322286Z [2024-05-26 02:22:02,643: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5dad967b-0504-47c7-af70-95e7614be10c] succeeded in 1.3325350200011599s: None 2024-05-26T02:22:02.656643178Z [2024-05-26 02:22:02,656: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f394c1cc-9dd2-4c47-a259-b5836b57e652] succeeded in 1.347958424999888s: None 2024-05-26T02:22:02.884251729Z [2024-05-26 02:22:02,883: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:22:02.887442820Z [2024-05-26 02:22:02,886: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:22:02.917959633Z [2024-05-26 02:22:02,917: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:22:02.921164678Z [2024-05-26 02:22:02,920: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:22:02.929659270Z [2024-05-26 02:22:02,929: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:22:02.931317964Z [2024-05-26 02:22:02,931: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:22:02.931425707Z [2024-05-26 02:22:02,931: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:22:02.931642054Z [2024-05-26 02:22:02,931: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:22:02.931715664Z [2024-05-26 02:22:02,931: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:22:02.932092755Z [2024-05-26 02:22:02,931: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:22:02.932123270Z [2024-05-26 02:22:02,932: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:22:02.941932946Z [2024-05-26 02:22:02,941: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:22:02.943198748Z [2024-05-26 02:22:02,943: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:22:02.943303915Z [2024-05-26 02:22:02,943: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:22:02.943454669Z [2024-05-26 02:22:02,943: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:22:02.943586049Z [2024-05-26 02:22:02,943: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:22:02.943863860Z [2024-05-26 02:22:02,943: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:22:02.944009437Z [2024-05-26 02:22:02,943: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:22:03.016193122Z [2024-05-26 02:22:03,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b319f3d-276e-45cd-a380-44c3d5a0c001] received 2024-05-26T02:22:03.017495516Z [2024-05-26 02:22:03,017: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:22:03.026728378Z [2024-05-26 02:22:03,026: INFO/ForkPoolWorker-16] [8b319f3d-276e-45cd-a380-44c3d5a0c001] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240526022201_019869', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-26T02:22:03.043891262Z [2024-05-26 02:22:03,043: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:22:03.321499414Z [2024-05-26 02:22:03,318: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-26T02:22:03.676579026Z [2024-05-26 02:22:03,676: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:22:04.376602129Z [2024-05-26 02:22:04,376: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b319f3d-276e-45cd-a380-44c3d5a0c001] succeeded in 1.355581132000225s: None 2024-05-26T02:22:04.711959512Z [2024-05-26 02:22:04,711: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7be2ade7-a9ec-48a0-8023-fe76e63ff0bd] succeeded in 3.4122673259989824s: None 2024-05-26T02:22:05.241958101Z [2024-05-26 02:22:05,241: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[785d4276-1eca-41b4-9847-81e9b8c47a60] succeeded in 3.924562659998628s: None 2024-05-26T02:23:00.516771537Z [2024-05-26 02:23:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f36f7e5-1565-4cfc-b348-b2739dd11ec5] received 2024-05-26T02:23:00.518486732Z [2024-05-26 02:23:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee07b60c-fb3e-4e5a-adcb-6dc74cafb82e] received 2024-05-26T02:23:00.527247618Z [2024-05-26 02:23:00,526: INFO/ForkPoolWorker-16] [ee07b60c-fb3e-4e5a-adcb-6dc74cafb82e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:23:00.529259329Z [2024-05-26 02:23:00,528: INFO/ForkPoolWorker-15] [6f36f7e5-1565-4cfc-b348-b2739dd11ec5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:23:00.535945737Z [2024-05-26 02:23:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82e5d9dc-26ae-4eb4-bb01-a9074d2386a4] received 2024-05-26T02:23:00.548843113Z [2024-05-26 02:23:00,548: INFO/ForkPoolWorker-1] [82e5d9dc-26ae-4eb4-bb01-a9074d2386a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:23:00.864635272Z [2024-05-26 02:23:00,861: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:23:00.867435093Z [2024-05-26 02:23:00,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:23:00.870865315Z [2024-05-26 02:23:00,868: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:23:01.017438078Z [2024-05-26 02:23:01,017: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:23:01.021281664Z [2024-05-26 02:23:01,020: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:23:01.045938202Z [2024-05-26 02:23:01,045: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:23:01.046980822Z [2024-05-26 02:23:01,046: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:23:01.047143292Z [2024-05-26 02:23:01,046: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:23:01.047306998Z [2024-05-26 02:23:01,047: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:23:01.047899095Z [2024-05-26 02:23:01,047: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:23:01.168937538Z [2024-05-26 02:23:01,168: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:23:01.772236154Z [2024-05-26 02:23:01,771: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[82e5d9dc-26ae-4eb4-bb01-a9074d2386a4] succeeded in 1.2346403259998624s: None 2024-05-26T02:23:02.011501679Z [2024-05-26 02:23:02,011: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:23:02.014655015Z [2024-05-26 02:23:02,014: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:23:02.037826850Z [2024-05-26 02:23:02,037: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:23:02.038992278Z [2024-05-26 02:23:02,038: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:23:02.039008383Z [2024-05-26 02:23:02,038: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:23:02.039143103Z [2024-05-26 02:23:02,038: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:23:02.039153334Z [2024-05-26 02:23:02,039: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:23:02.039373569Z [2024-05-26 02:23:02,039: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:23:02.041267949Z [2024-05-26 02:23:02,041: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:23:02.042698366Z [2024-05-26 02:23:02,042: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:23:02.045884445Z [2024-05-26 02:23:02,045: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:23:02.079928218Z [2024-05-26 02:23:02,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:23:02.086514115Z [2024-05-26 02:23:02,086: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:23:02.086922533Z [2024-05-26 02:23:02,086: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:23:02.087506033Z [2024-05-26 02:23:02,086: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:23:02.088090287Z [2024-05-26 02:23:02,087: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:23:02.089311704Z [2024-05-26 02:23:02,088: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:23:02.089681746Z [2024-05-26 02:23:02,089: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:23:02.121457276Z [2024-05-26 02:23:02,121: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:23:02.195424273Z [2024-05-26 02:23:02,195: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:23:03.603318662Z [2024-05-26 02:23:03,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee07b60c-fb3e-4e5a-adcb-6dc74cafb82e] succeeded in 3.0829687339992233s: None 2024-05-26T02:23:04.070411401Z [2024-05-26 02:23:04,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f36f7e5-1565-4cfc-b348-b2739dd11ec5] succeeded in 3.549602467999648s: None 2024-05-26T02:24:01.134974854Z [2024-05-26 02:24:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82f8ac95-4407-45a3-9f4d-f7b01572761d] received 2024-05-26T02:24:01.144498633Z [2024-05-26 02:24:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78b2c932-8aaa-4c01-959b-aa82cae6f80b] received 2024-05-26T02:24:01.150256920Z [2024-05-26 02:24:01,149: INFO/ForkPoolWorker-15] [82f8ac95-4407-45a3-9f4d-f7b01572761d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:24:01.151345842Z [2024-05-26 02:24:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc21e98a-7e1c-4d64-8c0c-e6d981635f0d] received 2024-05-26T02:24:01.157396803Z [2024-05-26 02:24:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b15ea71-1549-47ed-8934-2d990ad09709] received 2024-05-26T02:24:01.169474660Z [2024-05-26 02:24:01,169: INFO/ForkPoolWorker-1] [dc21e98a-7e1c-4d64-8c0c-e6d981635f0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:24:01.170641138Z [2024-05-26 02:24:01,170: INFO/ForkPoolWorker-2] [7b15ea71-1549-47ed-8934-2d990ad09709] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:24:01.172599370Z [2024-05-26 02:24:01,172: INFO/ForkPoolWorker-16] [78b2c932-8aaa-4c01-959b-aa82cae6f80b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:24:01.683462571Z [2024-05-26 02:24:01,679: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:24:01.690117527Z [2024-05-26 02:24:01,684: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:24:01.794460149Z [2024-05-26 02:24:01,776: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:24:01.859429996Z [2024-05-26 02:24:01,855: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:24:01.865667675Z [2024-05-26 02:24:01,865: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:24:01.869803546Z [2024-05-26 02:24:01,869: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:24:01.908646057Z [2024-05-26 02:24:01,908: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:24:01.910200923Z [2024-05-26 02:24:01,909: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:24:01.910395588Z [2024-05-26 02:24:01,910: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:24:01.910558349Z [2024-05-26 02:24:01,910: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:24:01.910812876Z [2024-05-26 02:24:01,910: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:24:02.166455213Z [2024-05-26 02:24:02,166: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:24:02.305971937Z [2024-05-26 02:24:02,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:24:03.289393590Z [2024-05-26 02:24:03,288: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7b15ea71-1549-47ed-8934-2d990ad09709] succeeded in 2.128811221000433s: None 2024-05-26T02:24:03.402706722Z [2024-05-26 02:24:03,400: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82f8ac95-4407-45a3-9f4d-f7b01572761d] succeeded in 2.260182115000134s: None 2024-05-26T02:24:04.045281250Z [2024-05-26 02:24:04,044: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:24:04.049251363Z [2024-05-26 02:24:04,048: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:24:04.086813631Z [2024-05-26 02:24:04,086: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:24:04.103125647Z [2024-05-26 02:24:04,102: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:24:04.103156580Z [2024-05-26 02:24:04,102: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:24:04.103443877Z [2024-05-26 02:24:04,103: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:24:04.103736407Z [2024-05-26 02:24:04,103: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:24:04.104689591Z [2024-05-26 02:24:04,104: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:24:04.104862045Z [2024-05-26 02:24:04,104: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:24:04.142745015Z [2024-05-26 02:24:04,142: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:24:04.146315308Z [2024-05-26 02:24:04,145: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:24:04.179618566Z [2024-05-26 02:24:04,179: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:24:04.182023931Z [2024-05-26 02:24:04,181: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:24:04.182165759Z [2024-05-26 02:24:04,181: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:24:04.182364366Z [2024-05-26 02:24:04,182: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:24:04.182475024Z [2024-05-26 02:24:04,182: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:24:04.182786849Z [2024-05-26 02:24:04,182: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:24:04.182919146Z [2024-05-26 02:24:04,182: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:24:04.229168608Z [2024-05-26 02:24:04,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:24:04.364763396Z [2024-05-26 02:24:04,364: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:24:07.427185171Z [2024-05-26 02:24:07,426: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc21e98a-7e1c-4d64-8c0c-e6d981635f0d] succeeded in 6.27261717500005s: None 2024-05-26T02:24:07.553222385Z [2024-05-26 02:24:07,552: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78b2c932-8aaa-4c01-959b-aa82cae6f80b] succeeded in 6.404377787999692s: None 2024-05-26T02:25:01.157110063Z [2024-05-26 02:25:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6d0e3f4-fd16-43aa-9d7d-41aad16c9ebd] received 2024-05-26T02:25:01.160926487Z [2024-05-26 02:25:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afbc1b4c-3532-4d82-8b9c-91be84d64f09] received 2024-05-26T02:25:01.167830154Z [2024-05-26 02:25:01,167: INFO/ForkPoolWorker-15] [e6d0e3f4-fd16-43aa-9d7d-41aad16c9ebd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:25:01.173945260Z [2024-05-26 02:25:01,173: INFO/ForkPoolWorker-16] [afbc1b4c-3532-4d82-8b9c-91be84d64f09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:25:01.176287231Z [2024-05-26 02:25:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a34cd524-bb4d-4c3a-b045-7b5ace7205e4] received 2024-05-26T02:25:01.178958329Z [2024-05-26 02:25:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d642b57a-664b-4007-b918-e52c834caff0] received 2024-05-26T02:25:01.184624112Z [2024-05-26 02:25:01,184: INFO/ForkPoolWorker-1] [a34cd524-bb4d-4c3a-b045-7b5ace7205e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:25:01.197454814Z [2024-05-26 02:25:01,197: INFO/ForkPoolWorker-2] [d642b57a-664b-4007-b918-e52c834caff0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:25:01.495866590Z [2024-05-26 02:25:01,492: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:25:01.567998048Z [2024-05-26 02:25:01,563: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:25:01.605099371Z [2024-05-26 02:25:01,601: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:25:01.634247338Z [2024-05-26 02:25:01,631: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:25:01.744829757Z [2024-05-26 02:25:01,744: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:25:01.749029310Z [2024-05-26 02:25:01,748: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:25:01.776525233Z [2024-05-26 02:25:01,776: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:25:01.777968951Z [2024-05-26 02:25:01,777: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:25:01.778183399Z [2024-05-26 02:25:01,777: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:25:01.778373513Z [2024-05-26 02:25:01,778: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:25:01.778695614Z [2024-05-26 02:25:01,778: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:25:01.874628690Z [2024-05-26 02:25:01,874: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:25:02.616824921Z [2024-05-26 02:25:02,616: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d642b57a-664b-4007-b918-e52c834caff0] succeeded in 1.4348233740001888s: None 2024-05-26T02:25:02.831097224Z [2024-05-26 02:25:02,830: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:25:02.834349765Z [2024-05-26 02:25:02,833: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:25:02.866597140Z [2024-05-26 02:25:02,866: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:25:02.876703658Z [2024-05-26 02:25:02,876: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:25:02.879740431Z [2024-05-26 02:25:02,876: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:25:02.880004218Z [2024-05-26 02:25:02,879: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:25:02.880133492Z [2024-05-26 02:25:02,879: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:25:02.884021349Z [2024-05-26 02:25:02,883: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:25:02.884182446Z [2024-05-26 02:25:02,883: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:25:02.901713028Z [2024-05-26 02:25:02,901: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:25:02.907751806Z [2024-05-26 02:25:02,907: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:25:02.948685283Z [2024-05-26 02:25:02,948: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:25:02.952272649Z [2024-05-26 02:25:02,951: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:25:02.960417419Z [2024-05-26 02:25:02,960: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:25:02.960659190Z [2024-05-26 02:25:02,960: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:25:02.967634925Z [2024-05-26 02:25:02,960: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:25:02.969695312Z [2024-05-26 02:25:02,969: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:25:02.969849661Z [2024-05-26 02:25:02,969: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:25:03.020017201Z [2024-05-26 02:25:03,019: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:25:03.033284036Z [2024-05-26 02:25:03,032: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:25:03.039500132Z [2024-05-26 02:25:03,039: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:25:03.069570351Z [2024-05-26 02:25:03,069: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:25:03.071799230Z [2024-05-26 02:25:03,071: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:25:03.071982816Z [2024-05-26 02:25:03,071: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:25:03.072186975Z [2024-05-26 02:25:03,072: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:25:03.072460278Z [2024-05-26 02:25:03,072: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:25:03.072975620Z [2024-05-26 02:25:03,072: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:25:03.073173295Z [2024-05-26 02:25:03,072: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:25:03.109663010Z [2024-05-26 02:25:03,109: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:25:03.185648843Z [2024-05-26 02:25:03,176: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:25:03.993350759Z [2024-05-26 02:25:03,992: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6d0e3f4-fd16-43aa-9d7d-41aad16c9ebd] succeeded in 2.83320790200014s: None 2024-05-26T02:25:04.682400591Z [2024-05-26 02:25:04,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92450f41-d0b5-400b-9283-fe42b41dc823] received 2024-05-26T02:25:04.694408906Z [2024-05-26 02:25:04,694: INFO/ForkPoolWorker-15] [92450f41-d0b5-400b-9283-fe42b41dc823] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:25:04.807094785Z [2024-05-26 02:25:04,806: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a34cd524-bb4d-4c3a-b045-7b5ace7205e4] succeeded in 3.6285318700010976s: None 2024-05-26T02:25:05.069894153Z [2024-05-26 02:25:05,066: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:25:05.723633056Z [2024-05-26 02:25:05,720: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[afbc1b4c-3532-4d82-8b9c-91be84d64f09] succeeded in 4.555173979000756s: None 2024-05-26T02:25:06.486350849Z [2024-05-26 02:25:06,485: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:25:06.489795494Z [2024-05-26 02:25:06,489: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:25:06.517078773Z [2024-05-26 02:25:06,516: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:25:06.518196022Z [2024-05-26 02:25:06,517: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:25:06.518207321Z [2024-05-26 02:25:06,518: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:25:06.518336654Z [2024-05-26 02:25:06,518: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:25:06.518346273Z [2024-05-26 02:25:06,518: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:25:06.518731812Z [2024-05-26 02:25:06,518: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:25:06.518823914Z [2024-05-26 02:25:06,518: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:25:06.611848975Z [2024-05-26 02:25:06,611: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:25:07.200535539Z [2024-05-26 02:25:07,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e99a318-1de1-435d-8f70-6f9657dad231] received 2024-05-26T02:25:07.220087665Z [2024-05-26 02:25:07,219: INFO/ForkPoolWorker-16] [3e99a318-1de1-435d-8f70-6f9657dad231] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:25:07.279768414Z [2024-05-26 02:25:07,279: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92450f41-d0b5-400b-9283-fe42b41dc823] succeeded in 2.5957044899987523s: None 2024-05-26T02:25:07.551122471Z [2024-05-26 02:25:07,547: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:25:08.800330815Z [2024-05-26 02:25:08,799: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:25:08.805325699Z [2024-05-26 02:25:08,804: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:25:08.825020225Z [2024-05-26 02:25:08,824: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:25:08.831597046Z [2024-05-26 02:25:08,825: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:25:08.831617483Z [2024-05-26 02:25:08,826: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:25:08.831622367Z [2024-05-26 02:25:08,826: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:25:08.831626008Z [2024-05-26 02:25:08,826: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:25:08.831629524Z [2024-05-26 02:25:08,826: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:25:08.831632848Z [2024-05-26 02:25:08,826: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:25:08.919953588Z [2024-05-26 02:25:08,919: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:25:10.820589702Z [2024-05-26 02:25:10,819: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e99a318-1de1-435d-8f70-6f9657dad231] succeeded in 3.6164960369987966s: None 2024-05-26T02:25:11.158345196Z [2024-05-26 02:25:11,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50d2cd4b-0b81-481f-9292-3d9e2663534d] received 2024-05-26T02:25:11.167625641Z [2024-05-26 02:25:11,167: INFO/ForkPoolWorker-15] [50d2cd4b-0b81-481f-9292-3d9e2663534d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:25:11.486198920Z [2024-05-26 02:25:11,482: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:25:12.681168831Z [2024-05-26 02:25:12,680: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:25:12.684073416Z [2024-05-26 02:25:12,683: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:25:12.720958994Z [2024-05-26 02:25:12,720: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:25:12.722214046Z [2024-05-26 02:25:12,722: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:25:12.722242481Z [2024-05-26 02:25:12,722: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:25:12.722444723Z [2024-05-26 02:25:12,722: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:25:12.722574249Z [2024-05-26 02:25:12,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:25:12.722973519Z [2024-05-26 02:25:12,722: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:25:12.723050609Z [2024-05-26 02:25:12,722: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:25:12.836212301Z [2024-05-26 02:25:12,835: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:25:13.572062558Z [2024-05-26 02:25:13,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50d2cd4b-0b81-481f-9292-3d9e2663534d] succeeded in 2.410926594000557s: None 2024-05-26T02:26:00.999087870Z [2024-05-26 02:26:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9d794d8-f8fd-49e7-9f9c-8bee3079e9ff] received 2024-05-26T02:26:01.007178612Z [2024-05-26 02:26:01,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[405d96a5-dd8f-4344-a386-6badf3437999] received 2024-05-26T02:26:01.016230452Z [2024-05-26 02:26:01,015: INFO/ForkPoolWorker-15] [b9d794d8-f8fd-49e7-9f9c-8bee3079e9ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:26:01.022724549Z [2024-05-26 02:26:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57354baa-1434-4250-bfa9-e4ccce50b797] received 2024-05-26T02:26:01.024995283Z [2024-05-26 02:26:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11a3eac4-4cb3-4335-b0b0-28046d27a45f] received 2024-05-26T02:26:01.040574327Z [2024-05-26 02:26:01,040: INFO/ForkPoolWorker-16] [405d96a5-dd8f-4344-a386-6badf3437999] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:26:01.045419465Z [2024-05-26 02:26:01,045: INFO/ForkPoolWorker-2] [11a3eac4-4cb3-4335-b0b0-28046d27a45f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:26:01.049985434Z [2024-05-26 02:26:01,049: INFO/ForkPoolWorker-1] [57354baa-1434-4250-bfa9-e4ccce50b797] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:26:01.356837481Z [2024-05-26 02:26:01,353: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:26:01.452084383Z [2024-05-26 02:26:01,449: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:26:01.508360880Z [2024-05-26 02:26:01,504: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:26:01.561321890Z [2024-05-26 02:26:01,557: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:26:01.649703837Z [2024-05-26 02:26:01,649: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:26:01.653644550Z [2024-05-26 02:26:01,653: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:26:01.705391191Z [2024-05-26 02:26:01,705: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:26:01.706970000Z [2024-05-26 02:26:01,706: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:26:01.707173415Z [2024-05-26 02:26:01,706: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:26:01.707616463Z [2024-05-26 02:26:01,707: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:26:01.707983918Z [2024-05-26 02:26:01,707: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:26:01.798193611Z [2024-05-26 02:26:01,797: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:26:01.885770310Z [2024-05-26 02:26:01,885: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:26:02.411322290Z [2024-05-26 02:26:02,410: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[11a3eac4-4cb3-4335-b0b0-28046d27a45f] succeeded in 1.3841540280009212s: None 2024-05-26T02:26:02.479497557Z [2024-05-26 02:26:02,479: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9d794d8-f8fd-49e7-9f9c-8bee3079e9ff] succeeded in 1.4737918139999238s: None 2024-05-26T02:26:02.706670310Z [2024-05-26 02:26:02,706: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:26:02.710142664Z [2024-05-26 02:26:02,709: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:26:02.743709236Z [2024-05-26 02:26:02,743: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:26:02.746454835Z [2024-05-26 02:26:02,746: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:26:02.746776145Z [2024-05-26 02:26:02,746: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:26:02.747008961Z [2024-05-26 02:26:02,746: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:26:02.747181038Z [2024-05-26 02:26:02,747: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:26:02.747697316Z [2024-05-26 02:26:02,747: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:26:02.747877341Z [2024-05-26 02:26:02,747: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:26:02.843387625Z [2024-05-26 02:26:02,843: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:26:02.873650594Z [2024-05-26 02:26:02,873: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:26:02.876908876Z [2024-05-26 02:26:02,876: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:26:02.898209859Z [2024-05-26 02:26:02,897: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:26:02.901030795Z [2024-05-26 02:26:02,900: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:26:02.901067506Z [2024-05-26 02:26:02,900: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:26:02.901204053Z [2024-05-26 02:26:02,901: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:26:02.901242362Z [2024-05-26 02:26:02,901: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:26:02.901608545Z [2024-05-26 02:26:02,901: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:26:02.901634595Z [2024-05-26 02:26:02,901: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:26:02.978770857Z [2024-05-26 02:26:02,978: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:26:04.981987767Z [2024-05-26 02:26:04,981: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[57354baa-1434-4250-bfa9-e4ccce50b797] succeeded in 3.953355408000789s: None 2024-05-26T02:26:05.318876906Z [2024-05-26 02:26:05,318: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[405d96a5-dd8f-4344-a386-6badf3437999] succeeded in 4.29097310600082s: None 2024-05-26T02:27:00.542413585Z [2024-05-26 02:27:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef0d99a2-c0dd-471e-98ca-c630c41ada3a] received 2024-05-26T02:27:00.548584989Z [2024-05-26 02:27:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69bfed65-76da-41e2-bea4-bbb33730ad9e] received 2024-05-26T02:27:00.555282956Z [2024-05-26 02:27:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b6683b2-6e56-4ace-a85b-11e79d785f21] received 2024-05-26T02:27:00.556764967Z [2024-05-26 02:27:00,556: INFO/ForkPoolWorker-16] [69bfed65-76da-41e2-bea4-bbb33730ad9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:27:00.557607856Z [2024-05-26 02:27:00,557: INFO/ForkPoolWorker-15] [ef0d99a2-c0dd-471e-98ca-c630c41ada3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:27:00.562778138Z [2024-05-26 02:27:00,562: INFO/ForkPoolWorker-1] [8b6683b2-6e56-4ace-a85b-11e79d785f21] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:27:00.911832200Z [2024-05-26 02:27:00,908: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:27:00.932149793Z [2024-05-26 02:27:00,928: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:27:00.992752914Z [2024-05-26 02:27:00,989: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:27:01.156548830Z [2024-05-26 02:27:01,156: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:27:01.160627099Z [2024-05-26 02:27:01,160: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:27:01.187553306Z [2024-05-26 02:27:01,187: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:27:01.188500474Z [2024-05-26 02:27:01,188: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:27:01.188612064Z [2024-05-26 02:27:01,188: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:27:01.188697335Z [2024-05-26 02:27:01,188: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:27:01.188946873Z [2024-05-26 02:27:01,188: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:27:01.282217426Z [2024-05-26 02:27:01,281: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:27:01.920560603Z [2024-05-26 02:27:01,920: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b6683b2-6e56-4ace-a85b-11e79d785f21] succeeded in 1.3634640720010793s: None 2024-05-26T02:27:01.963334324Z [2024-05-26 02:27:01,962: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:27:01.966411048Z [2024-05-26 02:27:01,965: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:27:01.987868881Z [2024-05-26 02:27:01,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:27:01.988986807Z [2024-05-26 02:27:01,988: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:27:01.989098431Z [2024-05-26 02:27:01,988: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:27:01.989241818Z [2024-05-26 02:27:01,989: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:27:01.989305839Z [2024-05-26 02:27:01,989: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:27:01.989554806Z [2024-05-26 02:27:01,989: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:27:01.989893904Z [2024-05-26 02:27:01,989: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:27:02.056065252Z [2024-05-26 02:27:02,055: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:27:02.059083573Z [2024-05-26 02:27:02,058: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:27:02.076495544Z [2024-05-26 02:27:02,076: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:27:02.077525384Z [2024-05-26 02:27:02,077: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:27:02.077577311Z [2024-05-26 02:27:02,077: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:27:02.077728033Z [2024-05-26 02:27:02,077: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:27:02.077780302Z [2024-05-26 02:27:02,077: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:27:02.078005622Z [2024-05-26 02:27:02,077: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:27:02.078062751Z [2024-05-26 02:27:02,077: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:27:02.098078721Z [2024-05-26 02:27:02,097: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:27:02.153582514Z [2024-05-26 02:27:02,153: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:27:03.736282288Z [2024-05-26 02:27:03,735: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69bfed65-76da-41e2-bea4-bbb33730ad9e] succeeded in 3.184827395998582s: None 2024-05-26T02:27:03.912900409Z [2024-05-26 02:27:03,912: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef0d99a2-c0dd-471e-98ca-c630c41ada3a] succeeded in 3.3666056940001s: None 2024-05-26T02:28:00.434007658Z [2024-05-26 02:28:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d59e44a-cf47-4e29-a5d1-a2815c439f49] received 2024-05-26T02:28:00.437891312Z [2024-05-26 02:28:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0f72c99-3468-4f57-aff1-80023f5ba027] received 2024-05-26T02:28:00.441534592Z [2024-05-26 02:28:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f06ef3a-f7f6-4185-b0b1-8fabe540f8cb] received 2024-05-26T02:28:00.448633773Z [2024-05-26 02:28:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27282937-8913-4e00-8166-3f7cbfa3503e] received 2024-05-26T02:28:00.450136394Z [2024-05-26 02:28:00,449: INFO/ForkPoolWorker-15] [2d59e44a-cf47-4e29-a5d1-a2815c439f49] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:28:00.456751348Z [2024-05-26 02:28:00,456: INFO/ForkPoolWorker-1] [1f06ef3a-f7f6-4185-b0b1-8fabe540f8cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:28:00.457392720Z [2024-05-26 02:28:00,457: INFO/ForkPoolWorker-16] [e0f72c99-3468-4f57-aff1-80023f5ba027] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:28:00.466592097Z [2024-05-26 02:28:00,466: INFO/ForkPoolWorker-2] [27282937-8913-4e00-8166-3f7cbfa3503e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:28:00.800281766Z [2024-05-26 02:28:00,797: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:28:00.809817238Z [2024-05-26 02:28:00,806: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:28:00.886246731Z [2024-05-26 02:28:00,881: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:28:00.890837926Z [2024-05-26 02:28:00,887: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:28:01.029750616Z [2024-05-26 02:28:01,029: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:28:01.049370146Z [2024-05-26 02:28:01,048: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:28:01.053485191Z [2024-05-26 02:28:01,053: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:28:01.080895428Z [2024-05-26 02:28:01,080: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:28:01.081867223Z [2024-05-26 02:28:01,081: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:28:01.081979592Z [2024-05-26 02:28:01,081: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:28:01.082037872Z [2024-05-26 02:28:01,081: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:28:01.082234034Z [2024-05-26 02:28:01,082: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:28:01.211538108Z [2024-05-26 02:28:01,207: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:28:01.579758172Z [2024-05-26 02:28:01,579: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d59e44a-cf47-4e29-a5d1-a2815c439f49] succeeded in 1.1398085129985702s: None 2024-05-26T02:28:01.825620148Z [2024-05-26 02:28:01,825: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[27282937-8913-4e00-8166-3f7cbfa3503e] succeeded in 1.3709875120002835s: None 2024-05-26T02:28:02.054069245Z [2024-05-26 02:28:02,053: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:28:02.057280249Z [2024-05-26 02:28:02,056: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:28:02.082828401Z [2024-05-26 02:28:02,082: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:28:02.084394325Z [2024-05-26 02:28:02,084: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:28:02.084630622Z [2024-05-26 02:28:02,084: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:28:02.084931374Z [2024-05-26 02:28:02,084: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:28:02.085119378Z [2024-05-26 02:28:02,084: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:28:02.085754367Z [2024-05-26 02:28:02,085: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:28:02.085940770Z [2024-05-26 02:28:02,085: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:28:02.129642720Z [2024-05-26 02:28:02,129: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:28:02.132742927Z [2024-05-26 02:28:02,132: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:28:02.153836801Z [2024-05-26 02:28:02,153: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:28:02.155128244Z [2024-05-26 02:28:02,154: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:28:02.155210834Z [2024-05-26 02:28:02,155: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:28:02.155352354Z [2024-05-26 02:28:02,155: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:28:02.155422691Z [2024-05-26 02:28:02,155: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:28:02.155720153Z [2024-05-26 02:28:02,155: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:28:02.155798753Z [2024-05-26 02:28:02,155: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:28:02.176119406Z [2024-05-26 02:28:02,175: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:28:02.243301906Z [2024-05-26 02:28:02,243: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:28:03.040198463Z [2024-05-26 02:28:03,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ddeddd1-66dd-4fc6-8697-0f6887b55383] received 2024-05-26T02:28:03.050706216Z [2024-05-26 02:28:03,050: INFO/ForkPoolWorker-15] [6ddeddd1-66dd-4fc6-8697-0f6887b55383] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240526022801_284434', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-26T02:28:03.385899466Z [2024-05-26 02:28:03,382: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-26T02:28:03.609361169Z [2024-05-26 02:28:03,608: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f06ef3a-f7f6-4185-b0b1-8fabe540f8cb] succeeded in 3.165289907001352s: None 2024-05-26T02:28:03.737965098Z [2024-05-26 02:28:03,737: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:28:04.053775739Z [2024-05-26 02:28:04,052: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0f72c99-3468-4f57-aff1-80023f5ba027] succeeded in 3.612289298000178s: None 2024-05-26T02:28:04.507361350Z [2024-05-26 02:28:04,507: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ddeddd1-66dd-4fc6-8697-0f6887b55383] succeeded in 1.4647517049997987s: None 2024-05-26T02:29:00.306958263Z [2024-05-26 02:29:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c98e19ab-dd9e-429a-97d2-6b0f4ee3a44c] received 2024-05-26T02:29:00.314368334Z [2024-05-26 02:29:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be22daa7-aab5-44e5-b325-606e7092d2f0] received 2024-05-26T02:29:00.326214893Z [2024-05-26 02:29:00,325: INFO/ForkPoolWorker-15] [c98e19ab-dd9e-429a-97d2-6b0f4ee3a44c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:29:00.329911142Z [2024-05-26 02:29:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8affa407-983f-4f0f-aeae-6df0f2bb41e0] received 2024-05-26T02:29:00.331962584Z [2024-05-26 02:29:00,331: INFO/ForkPoolWorker-16] [be22daa7-aab5-44e5-b325-606e7092d2f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:29:00.342440823Z [2024-05-26 02:29:00,342: INFO/ForkPoolWorker-1] [8affa407-983f-4f0f-aeae-6df0f2bb41e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:29:00.622843074Z [2024-05-26 02:29:00,619: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:29:00.632603478Z [2024-05-26 02:29:00,628: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:29:00.642055978Z [2024-05-26 02:29:00,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:29:00.813857313Z [2024-05-26 02:29:00,813: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:29:00.818020799Z [2024-05-26 02:29:00,817: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:29:00.844564345Z [2024-05-26 02:29:00,844: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:29:00.845798190Z [2024-05-26 02:29:00,845: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:29:00.845894770Z [2024-05-26 02:29:00,845: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:29:00.846299823Z [2024-05-26 02:29:00,846: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:29:00.848037230Z [2024-05-26 02:29:00,847: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:29:00.970358317Z [2024-05-26 02:29:00,970: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:29:01.572737940Z [2024-05-26 02:29:01,571: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8affa407-983f-4f0f-aeae-6df0f2bb41e0] succeeded in 1.2378050240004086s: None 2024-05-26T02:29:01.775364363Z [2024-05-26 02:29:01,774: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:29:01.778453545Z [2024-05-26 02:29:01,778: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:29:01.778806868Z [2024-05-26 02:29:01,778: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:29:01.781954602Z [2024-05-26 02:29:01,781: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:29:01.798329008Z [2024-05-26 02:29:01,798: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:29:01.799492747Z [2024-05-26 02:29:01,799: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:29:01.799511707Z [2024-05-26 02:29:01,799: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:29:01.799682009Z [2024-05-26 02:29:01,799: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:29:01.799693498Z [2024-05-26 02:29:01,799: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:29:01.799925596Z [2024-05-26 02:29:01,799: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:29:01.799936395Z [2024-05-26 02:29:01,799: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:29:01.803509641Z [2024-05-26 02:29:01,803: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:29:01.804605082Z [2024-05-26 02:29:01,804: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:29:01.804821238Z [2024-05-26 02:29:01,804: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:29:01.804938485Z [2024-05-26 02:29:01,804: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:29:01.805176050Z [2024-05-26 02:29:01,804: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:29:01.805489694Z [2024-05-26 02:29:01,805: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:29:01.805523739Z [2024-05-26 02:29:01,805: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:29:01.875828527Z [2024-05-26 02:29:01,875: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:29:01.905017024Z [2024-05-26 02:29:01,904: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:29:03.408580949Z [2024-05-26 02:29:03,406: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be22daa7-aab5-44e5-b325-606e7092d2f0] succeeded in 3.087210163999771s: None 2024-05-26T02:29:03.786133771Z [2024-05-26 02:29:03,785: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c98e19ab-dd9e-429a-97d2-6b0f4ee3a44c] succeeded in 3.4690060670000094s: None 2024-05-26T02:30:00.276290149Z [2024-05-26 02:30:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7a11c77-329f-4421-b1a0-2a2a80ef9ce7] received 2024-05-26T02:30:00.279756728Z [2024-05-26 02:30:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[003c74f3-f9c4-4854-840e-23c8999cc825] received 2024-05-26T02:30:00.281844217Z [2024-05-26 02:30:00,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9992980-1a6a-4215-9167-4d9927b29fec] received 2024-05-26T02:30:00.290930095Z [2024-05-26 02:30:00,290: INFO/ForkPoolWorker-16] [003c74f3-f9c4-4854-840e-23c8999cc825] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:30:00.291335032Z [2024-05-26 02:30:00,291: INFO/ForkPoolWorker-1] [e9992980-1a6a-4215-9167-4d9927b29fec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:30:00.292058645Z [2024-05-26 02:30:00,291: INFO/ForkPoolWorker-15] [c7a11c77-329f-4421-b1a0-2a2a80ef9ce7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:30:00.294036406Z [2024-05-26 02:30:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f55fe186-658f-4049-adbb-67d46471a9cd] received 2024-05-26T02:30:00.303110489Z [2024-05-26 02:30:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[daaaae9e-2873-4437-b35a-7d8981aaf344] received 2024-05-26T02:30:00.305533184Z [2024-05-26 02:30:00,305: INFO/ForkPoolWorker-2] [f55fe186-658f-4049-adbb-67d46471a9cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:30:00.334432328Z [2024-05-26 02:30:00,334: INFO/ForkPoolWorker-3] [daaaae9e-2873-4437-b35a-7d8981aaf344] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:30:00.636788406Z [2024-05-26 02:30:00,633: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:30:00.655062580Z [2024-05-26 02:30:00,652: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:30:00.767248629Z [2024-05-26 02:30:00,763: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:30:00.836338009Z [2024-05-26 02:30:00,815: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:30:00.846950437Z [2024-05-26 02:30:00,830: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:30:00.854110585Z [2024-05-26 02:30:00,853: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:30:00.859177557Z [2024-05-26 02:30:00,858: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:30:00.888577700Z [2024-05-26 02:30:00,888: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:30:00.889697688Z [2024-05-26 02:30:00,889: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:30:00.889832060Z [2024-05-26 02:30:00,889: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:30:00.889938928Z [2024-05-26 02:30:00,889: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:30:00.890167693Z [2024-05-26 02:30:00,890: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:30:01.058835241Z [2024-05-26 02:30:01,058: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:30:01.258295436Z [2024-05-26 02:30:01,258: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:30:01.772480782Z [2024-05-26 02:30:01,772: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e9992980-1a6a-4215-9167-4d9927b29fec] succeeded in 1.4892756120007107s: None 2024-05-26T02:30:01.974305050Z [2024-05-26 02:30:01,973: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[003c74f3-f9c4-4854-840e-23c8999cc825] succeeded in 1.6900635239999247s: None 2024-05-26T02:30:02.271449593Z [2024-05-26 02:30:02,271: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:30:02.274597477Z [2024-05-26 02:30:02,274: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:30:02.298005676Z [2024-05-26 02:30:02,297: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:30:02.299571771Z [2024-05-26 02:30:02,299: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:30:02.299637706Z [2024-05-26 02:30:02,299: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:30:02.299903255Z [2024-05-26 02:30:02,299: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:30:02.299990126Z [2024-05-26 02:30:02,299: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:30:02.300355446Z [2024-05-26 02:30:02,300: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:30:02.300815285Z [2024-05-26 02:30:02,300: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:30:02.352352640Z [2024-05-26 02:30:02,352: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T02:30:02.355942807Z [2024-05-26 02:30:02,355: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:30:02.380197162Z [2024-05-26 02:30:02,380: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T02:30:02.383450389Z [2024-05-26 02:30:02,382: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:30:02.384068806Z [2024-05-26 02:30:02,383: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:30:02.384254551Z [2024-05-26 02:30:02,384: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:30:02.384502727Z [2024-05-26 02:30:02,384: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:30:02.384699701Z [2024-05-26 02:30:02,384: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T02:30:02.385001861Z [2024-05-26 02:30:02,384: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:30:02.385131380Z [2024-05-26 02:30:02,384: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:30:02.457579967Z [2024-05-26 02:30:02,457: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:30:02.457760236Z [2024-05-26 02:30:02,457: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:30:02.461298861Z [2024-05-26 02:30:02,460: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:30:02.483873188Z [2024-05-26 02:30:02,483: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:30:02.485210282Z [2024-05-26 02:30:02,484: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:30:02.485222876Z [2024-05-26 02:30:02,485: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:30:02.485329551Z [2024-05-26 02:30:02,485: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:30:02.485399200Z [2024-05-26 02:30:02,485: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:30:02.485614575Z [2024-05-26 02:30:02,485: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:30:02.485740890Z [2024-05-26 02:30:02,485: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:30:02.614875343Z [2024-05-26 02:30:02,614: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:30:03.068916482Z [2024-05-26 02:30:03,068: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7a11c77-329f-4421-b1a0-2a2a80ef9ce7] succeeded in 2.7877821959991707s: None 2024-05-26T02:30:03.471721383Z [2024-05-26 02:30:03,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8c1f327-5d6c-4793-b526-c748d852e25e] received 2024-05-26T02:30:03.471745765Z [2024-05-26 02:30:03,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1656f2e-bef2-4c6a-b875-ad833aceec7a] received 2024-05-26T02:30:03.477399101Z [2024-05-26 02:30:03,477: INFO/ForkPoolWorker-16] [d1656f2e-bef2-4c6a-b875-ad833aceec7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:30:03.480105186Z [2024-05-26 02:30:03,479: INFO/ForkPoolWorker-15] [a8c1f327-5d6c-4793-b526-c748d852e25e] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240526023001_586149', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-26T02:30:03.792229902Z [2024-05-26 02:30:03,789: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-26T02:30:04.049593824Z [2024-05-26 02:30:04,049: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[daaaae9e-2873-4437-b35a-7d8981aaf344] succeeded in 3.732722732998809s: None 2024-05-26T02:30:04.072567430Z [2024-05-26 02:30:04,068: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:30:04.266158220Z [2024-05-26 02:30:04,265: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:30:04.786934368Z [2024-05-26 02:30:04,786: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f55fe186-658f-4049-adbb-67d46471a9cd] succeeded in 4.490690186001302s: None 2024-05-26T02:30:05.085038426Z [2024-05-26 02:30:05,084: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8c1f327-5d6c-4793-b526-c748d852e25e] succeeded in 1.6130218640009844s: None 2024-05-26T02:30:05.497938369Z [2024-05-26 02:30:05,497: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:30:05.502567954Z [2024-05-26 02:30:05,502: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:30:05.565712657Z [2024-05-26 02:30:05,565: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:30:05.574916385Z [2024-05-26 02:30:05,574: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:30:05.574993518Z [2024-05-26 02:30:05,574: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:30:05.575172395Z [2024-05-26 02:30:05,574: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:30:05.575249012Z [2024-05-26 02:30:05,575: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:30:05.575459184Z [2024-05-26 02:30:05,575: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:30:05.580129335Z [2024-05-26 02:30:05,579: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:30:05.744915861Z [2024-05-26 02:30:05,744: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:30:06.488642946Z [2024-05-26 02:30:06,488: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1656f2e-bef2-4c6a-b875-ad833aceec7a] succeeded in 3.016346402000636s: None 2024-05-26T02:30:07.137535145Z [2024-05-26 02:30:07,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05ad07bf-8d81-4e9b-8da1-98adbd151cfb] received 2024-05-26T02:30:07.149049163Z [2024-05-26 02:30:07,148: INFO/ForkPoolWorker-15] [05ad07bf-8d81-4e9b-8da1-98adbd151cfb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:30:07.430994030Z [2024-05-26 02:30:07,427: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:30:08.499073700Z [2024-05-26 02:30:08,498: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:30:08.505766425Z [2024-05-26 02:30:08,505: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:30:08.532233263Z [2024-05-26 02:30:08,531: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:30:08.533835489Z [2024-05-26 02:30:08,533: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:30:08.533960190Z [2024-05-26 02:30:08,533: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:30:08.534199349Z [2024-05-26 02:30:08,533: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:30:08.534323218Z [2024-05-26 02:30:08,534: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:30:08.534727100Z [2024-05-26 02:30:08,534: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:30:08.534834697Z [2024-05-26 02:30:08,534: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:30:08.644124370Z [2024-05-26 02:30:08,643: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:30:10.121422138Z [2024-05-26 02:30:10,119: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05ad07bf-8d81-4e9b-8da1-98adbd151cfb] succeeded in 2.9799039970002923s: None 2024-05-26T02:30:10.461042644Z [2024-05-26 02:30:10,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e72de2f2-1f3d-489c-b4b8-4ac64cb53303] received 2024-05-26T02:30:10.470762850Z [2024-05-26 02:30:10,470: INFO/ForkPoolWorker-15] [e72de2f2-1f3d-489c-b4b8-4ac64cb53303] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:30:10.783656128Z [2024-05-26 02:30:10,779: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:30:11.830337495Z [2024-05-26 02:30:11,829: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:30:11.833380311Z [2024-05-26 02:30:11,832: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:30:11.859794346Z [2024-05-26 02:30:11,859: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:30:11.861312369Z [2024-05-26 02:30:11,861: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:30:11.861356384Z [2024-05-26 02:30:11,861: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:30:11.861610751Z [2024-05-26 02:30:11,861: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:30:11.861649600Z [2024-05-26 02:30:11,861: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:30:11.861898098Z [2024-05-26 02:30:11,861: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:30:11.862002970Z [2024-05-26 02:30:11,861: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:30:11.964899442Z [2024-05-26 02:30:11,964: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:30:12.576767362Z [2024-05-26 02:30:12,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e72de2f2-1f3d-489c-b4b8-4ac64cb53303] succeeded in 2.114300887000354s: None 2024-05-26T02:31:01.217544355Z [2024-05-26 02:31:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71abe9b4-d7a8-4f35-b626-4bae91a1ef44] received 2024-05-26T02:31:01.219860655Z [2024-05-26 02:31:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c73f12eb-b6fe-4984-b8c5-fcda53a3df21] received 2024-05-26T02:31:01.232378555Z [2024-05-26 02:31:01,232: INFO/ForkPoolWorker-15] [71abe9b4-d7a8-4f35-b626-4bae91a1ef44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:31:01.235167078Z [2024-05-26 02:31:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed635274-25de-493a-bcd9-b75dc7e488b9] received 2024-05-26T02:31:01.246724032Z [2024-05-26 02:31:01,246: INFO/ForkPoolWorker-16] [c73f12eb-b6fe-4984-b8c5-fcda53a3df21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:31:01.255601931Z [2024-05-26 02:31:01,255: INFO/ForkPoolWorker-1] [ed635274-25de-493a-bcd9-b75dc7e488b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:31:01.541785439Z [2024-05-26 02:31:01,538: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:31:01.564619718Z [2024-05-26 02:31:01,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:31:01.574807513Z [2024-05-26 02:31:01,570: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:31:01.736750353Z [2024-05-26 02:31:01,736: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:31:01.740961509Z [2024-05-26 02:31:01,740: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:31:01.773817540Z [2024-05-26 02:31:01,773: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:31:01.774926287Z [2024-05-26 02:31:01,774: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:31:01.775063436Z [2024-05-26 02:31:01,774: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:31:01.775210983Z [2024-05-26 02:31:01,775: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:31:01.775609161Z [2024-05-26 02:31:01,775: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:31:01.857132813Z [2024-05-26 02:31:01,856: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:31:02.469104509Z [2024-05-26 02:31:02,468: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed635274-25de-493a-bcd9-b75dc7e488b9] succeeded in 1.2302437890011788s: None 2024-05-26T02:31:02.657529911Z [2024-05-26 02:31:02,657: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:31:02.665800417Z [2024-05-26 02:31:02,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:31:02.685596077Z [2024-05-26 02:31:02,685: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:31:02.686438132Z [2024-05-26 02:31:02,686: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:31:02.687096381Z [2024-05-26 02:31:02,686: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:31:02.687246123Z [2024-05-26 02:31:02,687: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:31:02.687470143Z [2024-05-26 02:31:02,687: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:31:02.687669449Z [2024-05-26 02:31:02,687: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:31:02.687996710Z [2024-05-26 02:31:02,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:31:02.688144736Z [2024-05-26 02:31:02,687: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:31:02.689615995Z [2024-05-26 02:31:02,689: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:31:02.708743867Z [2024-05-26 02:31:02,708: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:31:02.710010596Z [2024-05-26 02:31:02,709: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:31:02.710026432Z [2024-05-26 02:31:02,709: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:31:02.710257771Z [2024-05-26 02:31:02,710: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:31:02.710444809Z [2024-05-26 02:31:02,710: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:31:02.710808621Z [2024-05-26 02:31:02,710: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:31:02.710962207Z [2024-05-26 02:31:02,710: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:31:02.769417291Z [2024-05-26 02:31:02,769: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:31:02.799587954Z [2024-05-26 02:31:02,799: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:31:04.737489211Z [2024-05-26 02:31:04,737: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c73f12eb-b6fe-4984-b8c5-fcda53a3df21] succeeded in 3.506906677999723s: None 2024-05-26T02:31:05.003281892Z [2024-05-26 02:31:05,000: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71abe9b4-d7a8-4f35-b626-4bae91a1ef44] succeeded in 3.780262969001342s: None 2024-05-26T02:32:01.280304378Z [2024-05-26 02:32:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[422c2b33-32ba-4bf2-be3e-3bede7cc2807] received 2024-05-26T02:32:01.282533249Z [2024-05-26 02:32:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6ad3d29-8a33-4f43-ade9-3e5553b4862f] received 2024-05-26T02:32:01.290559250Z [2024-05-26 02:32:01,290: INFO/ForkPoolWorker-15] [422c2b33-32ba-4bf2-be3e-3bede7cc2807] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:32:01.301726263Z [2024-05-26 02:32:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a69b33e-5748-43a0-861d-59d0b9331c3b] received 2024-05-26T02:32:01.306494541Z [2024-05-26 02:32:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d0dbd4d-11f1-43cd-a9c7-9d5842717e4a] received 2024-05-26T02:32:01.311928588Z [2024-05-26 02:32:01,311: INFO/ForkPoolWorker-1] [4a69b33e-5748-43a0-861d-59d0b9331c3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:32:01.316104628Z [2024-05-26 02:32:01,315: INFO/ForkPoolWorker-16] [f6ad3d29-8a33-4f43-ade9-3e5553b4862f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:32:01.326010519Z [2024-05-26 02:32:01,325: INFO/ForkPoolWorker-2] [6d0dbd4d-11f1-43cd-a9c7-9d5842717e4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:32:01.644223883Z [2024-05-26 02:32:01,641: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:32:01.732566716Z [2024-05-26 02:32:01,728: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:32:01.764991964Z [2024-05-26 02:32:01,746: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:32:01.799223651Z [2024-05-26 02:32:01,796: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:32:02.023697767Z [2024-05-26 02:32:02,023: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:32:02.027335034Z [2024-05-26 02:32:02,026: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:32:02.059641849Z [2024-05-26 02:32:02,059: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:32:02.063112532Z [2024-05-26 02:32:02,062: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:32:02.063399220Z [2024-05-26 02:32:02,063: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:32:02.063416818Z [2024-05-26 02:32:02,063: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:32:02.063429578Z [2024-05-26 02:32:02,063: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:32:02.149273060Z [2024-05-26 02:32:02,149: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:32:02.167508850Z [2024-05-26 02:32:02,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:32:02.647880463Z [2024-05-26 02:32:02,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[422c2b33-32ba-4bf2-be3e-3bede7cc2807] succeeded in 1.3634816789999604s: None 2024-05-26T02:32:02.778827555Z [2024-05-26 02:32:02,778: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6d0dbd4d-11f1-43cd-a9c7-9d5842717e4a] succeeded in 1.468471716001659s: None 2024-05-26T02:32:03.029821327Z [2024-05-26 02:32:03,029: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:32:03.041389084Z [2024-05-26 02:32:03,040: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:32:03.065471270Z [2024-05-26 02:32:03,065: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:32:03.066991707Z [2024-05-26 02:32:03,066: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:32:03.067159481Z [2024-05-26 02:32:03,067: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:32:03.067329425Z [2024-05-26 02:32:03,067: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:32:03.067430103Z [2024-05-26 02:32:03,067: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:32:03.067734670Z [2024-05-26 02:32:03,067: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:32:03.067884293Z [2024-05-26 02:32:03,067: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:32:03.172668453Z [2024-05-26 02:32:03,166: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:32:03.188337538Z [2024-05-26 02:32:03,187: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:32:03.198696751Z [2024-05-26 02:32:03,191: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:32:03.228335827Z [2024-05-26 02:32:03,228: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:32:03.232760833Z [2024-05-26 02:32:03,232: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:32:03.232887806Z [2024-05-26 02:32:03,232: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:32:03.233069838Z [2024-05-26 02:32:03,232: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:32:03.233129317Z [2024-05-26 02:32:03,233: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:32:03.233456925Z [2024-05-26 02:32:03,233: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:32:03.233659375Z [2024-05-26 02:32:03,233: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:32:03.353739385Z [2024-05-26 02:32:03,353: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:32:04.938807740Z [2024-05-26 02:32:04,938: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a69b33e-5748-43a0-861d-59d0b9331c3b] succeeded in 3.635014608000347s: None 2024-05-26T02:32:05.507613488Z [2024-05-26 02:32:05,504: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6ad3d29-8a33-4f43-ade9-3e5553b4862f] succeeded in 4.214460252000208s: None 2024-05-26T02:33:01.052432332Z [2024-05-26 02:33:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a01312b-4904-4799-9f02-8a823b04b91f] received 2024-05-26T02:33:01.061762857Z [2024-05-26 02:33:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dac5b5b-d412-4f96-8abb-112d78ffdbb0] received 2024-05-26T02:33:01.063051571Z [2024-05-26 02:33:01,062: INFO/ForkPoolWorker-15] [8a01312b-4904-4799-9f02-8a823b04b91f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:33:01.064868659Z [2024-05-26 02:33:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[034c0c63-53a1-42d1-9b0f-ddf0e3258055] received 2024-05-26T02:33:01.075338731Z [2024-05-26 02:33:01,075: INFO/ForkPoolWorker-16] [4dac5b5b-d412-4f96-8abb-112d78ffdbb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:33:01.075923571Z [2024-05-26 02:33:01,075: INFO/ForkPoolWorker-1] [034c0c63-53a1-42d1-9b0f-ddf0e3258055] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:33:01.436687331Z [2024-05-26 02:33:01,432: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:33:01.489807002Z [2024-05-26 02:33:01,486: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:33:01.526592678Z [2024-05-26 02:33:01,523: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:33:01.629390230Z [2024-05-26 02:33:01,628: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:33:01.634554471Z [2024-05-26 02:33:01,634: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:33:01.691796863Z [2024-05-26 02:33:01,691: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:33:01.695073201Z [2024-05-26 02:33:01,694: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:33:01.695117553Z [2024-05-26 02:33:01,694: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:33:01.695181897Z [2024-05-26 02:33:01,695: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:33:01.695383673Z [2024-05-26 02:33:01,695: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:33:01.823699348Z [2024-05-26 02:33:01,823: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:33:02.438093959Z [2024-05-26 02:33:02,437: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[034c0c63-53a1-42d1-9b0f-ddf0e3258055] succeeded in 1.3707481949986686s: None 2024-05-26T02:33:02.713880194Z [2024-05-26 02:33:02,713: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:33:02.717009781Z [2024-05-26 02:33:02,716: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:33:02.736387933Z [2024-05-26 02:33:02,736: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:33:02.737481849Z [2024-05-26 02:33:02,737: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:33:02.737541345Z [2024-05-26 02:33:02,737: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:33:02.737599095Z [2024-05-26 02:33:02,737: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:33:02.737638555Z [2024-05-26 02:33:02,737: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:33:02.737915226Z [2024-05-26 02:33:02,737: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:33:02.737989844Z [2024-05-26 02:33:02,737: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:33:02.785545508Z [2024-05-26 02:33:02,785: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:33:02.789119223Z [2024-05-26 02:33:02,788: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:33:02.816558743Z [2024-05-26 02:33:02,816: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:33:02.821044919Z [2024-05-26 02:33:02,820: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:33:02.821289282Z [2024-05-26 02:33:02,821: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:33:02.821557207Z [2024-05-26 02:33:02,821: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:33:02.821736292Z [2024-05-26 02:33:02,821: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:33:02.822612870Z [2024-05-26 02:33:02,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:33:02.822820431Z [2024-05-26 02:33:02,822: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:33:02.827598578Z [2024-05-26 02:33:02,827: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:33:02.912029408Z [2024-05-26 02:33:02,911: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:33:04.374856770Z [2024-05-26 02:33:04,374: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a01312b-4904-4799-9f02-8a823b04b91f] succeeded in 3.3201054519995523s: None 2024-05-26T02:33:05.501894867Z [2024-05-26 02:33:05,501: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4dac5b5b-d412-4f96-8abb-112d78ffdbb0] succeeded in 4.43850614099938s: None 2024-05-26T02:34:00.964908171Z [2024-05-26 02:34:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa008a12-2989-4b2c-a269-412e3fcf7974] received 2024-05-26T02:34:00.968137333Z [2024-05-26 02:34:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5b2a74e-4497-4d3d-b1e8-4f71155374d4] received 2024-05-26T02:34:00.971184361Z [2024-05-26 02:34:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07cca266-b1e3-4fdf-bd89-31f90ff928ad] received 2024-05-26T02:34:00.972840988Z [2024-05-26 02:34:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4730be2-a9fe-4d92-aeb0-ea2cb1b3baba] received 2024-05-26T02:34:00.977674412Z [2024-05-26 02:34:00,977: INFO/ForkPoolWorker-15] [fa008a12-2989-4b2c-a269-412e3fcf7974] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:34:00.981248841Z [2024-05-26 02:34:00,980: INFO/ForkPoolWorker-16] [e5b2a74e-4497-4d3d-b1e8-4f71155374d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:34:00.987607274Z [2024-05-26 02:34:00,987: INFO/ForkPoolWorker-1] [07cca266-b1e3-4fdf-bd89-31f90ff928ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:34:00.991160634Z [2024-05-26 02:34:00,990: INFO/ForkPoolWorker-2] [e4730be2-a9fe-4d92-aeb0-ea2cb1b3baba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:34:01.331824428Z [2024-05-26 02:34:01,319: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:34:01.339547635Z [2024-05-26 02:34:01,336: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:34:01.362411134Z [2024-05-26 02:34:01,359: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:34:01.374939435Z [2024-05-26 02:34:01,371: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:34:01.520085350Z [2024-05-26 02:34:01,519: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:34:01.523999369Z [2024-05-26 02:34:01,523: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:34:01.559005059Z [2024-05-26 02:34:01,558: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:34:01.562569112Z [2024-05-26 02:34:01,562: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:34:01.562669722Z [2024-05-26 02:34:01,562: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:34:01.562731989Z [2024-05-26 02:34:01,562: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:34:01.562987932Z [2024-05-26 02:34:01,562: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:34:01.652379603Z [2024-05-26 02:34:01,652: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:34:01.686329105Z [2024-05-26 02:34:01,686: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:34:02.288896919Z [2024-05-26 02:34:02,288: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07cca266-b1e3-4fdf-bd89-31f90ff928ad] succeeded in 1.315268719999949s: None 2024-05-26T02:34:02.334172066Z [2024-05-26 02:34:02,333: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa008a12-2989-4b2c-a269-412e3fcf7974] succeeded in 1.3660315059987624s: None 2024-05-26T02:34:02.662263004Z [2024-05-26 02:34:02,661: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:34:02.665486656Z [2024-05-26 02:34:02,665: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:34:02.679869419Z [2024-05-26 02:34:02,679: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:34:02.683637576Z [2024-05-26 02:34:02,683: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:34:02.686436302Z [2024-05-26 02:34:02,686: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:34:02.688090794Z [2024-05-26 02:34:02,687: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:34:02.688273269Z [2024-05-26 02:34:02,688: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:34:02.688564152Z [2024-05-26 02:34:02,688: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:34:02.688729657Z [2024-05-26 02:34:02,688: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:34:02.689065960Z [2024-05-26 02:34:02,688: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:34:02.689592984Z [2024-05-26 02:34:02,689: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:34:02.708171094Z [2024-05-26 02:34:02,707: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:34:02.709692506Z [2024-05-26 02:34:02,709: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:34:02.709911856Z [2024-05-26 02:34:02,709: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:34:02.710256475Z [2024-05-26 02:34:02,709: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:34:02.712257938Z [2024-05-26 02:34:02,712: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:34:02.712775894Z [2024-05-26 02:34:02,712: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:34:02.713117572Z [2024-05-26 02:34:02,712: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:34:02.782165860Z [2024-05-26 02:34:02,781: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:34:02.817295699Z [2024-05-26 02:34:02,816: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:34:04.577766442Z [2024-05-26 02:34:04,577: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5b2a74e-4497-4d3d-b1e8-4f71155374d4] succeeded in 3.6061902029996418s: None 2024-05-26T02:34:04.869135128Z [2024-05-26 02:34:04,862: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e4730be2-a9fe-4d92-aeb0-ea2cb1b3baba] succeeded in 3.8837067170006776s: None 2024-05-26T02:35:00.398961524Z [2024-05-26 02:35:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[daa56f24-f7e8-4851-8e32-7aa7dc8c294a] received 2024-05-26T02:35:00.416779498Z [2024-05-26 02:35:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc7fd087-698a-4098-8957-9dd9d5e97bf8] received 2024-05-26T02:35:00.418922230Z [2024-05-26 02:35:00,418: INFO/ForkPoolWorker-15] [daa56f24-f7e8-4851-8e32-7aa7dc8c294a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:35:00.428013285Z [2024-05-26 02:35:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[154b4a70-9329-480b-89e8-cbc14df100c6] received 2024-05-26T02:35:00.433435787Z [2024-05-26 02:35:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47479b35-4e81-4815-b984-4c75bad0b6ec] received 2024-05-26T02:35:00.438613038Z [2024-05-26 02:35:00,438: INFO/ForkPoolWorker-1] [154b4a70-9329-480b-89e8-cbc14df100c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:35:00.442326741Z [2024-05-26 02:35:00,441: INFO/ForkPoolWorker-16] [bc7fd087-698a-4098-8957-9dd9d5e97bf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:35:00.446340524Z [2024-05-26 02:35:00,445: INFO/ForkPoolWorker-2] [47479b35-4e81-4815-b984-4c75bad0b6ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:35:00.810847681Z [2024-05-26 02:35:00,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:35:00.842287840Z [2024-05-26 02:35:00,839: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:35:00.875178942Z [2024-05-26 02:35:00,871: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:35:00.900667255Z [2024-05-26 02:35:00,897: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:35:01.045883570Z [2024-05-26 02:35:01,045: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:35:01.050514256Z [2024-05-26 02:35:01,050: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:35:01.096861112Z [2024-05-26 02:35:01,096: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:35:01.098600282Z [2024-05-26 02:35:01,098: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:35:01.098852015Z [2024-05-26 02:35:01,098: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:35:01.098971528Z [2024-05-26 02:35:01,098: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:35:01.099244573Z [2024-05-26 02:35:01,099: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:35:01.211074729Z [2024-05-26 02:35:01,210: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:35:01.823274871Z [2024-05-26 02:35:01,822: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[154b4a70-9329-480b-89e8-cbc14df100c6] succeeded in 1.3931602480006404s: None 2024-05-26T02:35:01.956608064Z [2024-05-26 02:35:01,956: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:35:01.963383255Z [2024-05-26 02:35:01,962: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:35:01.994013158Z [2024-05-26 02:35:01,993: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:35:01.995738069Z [2024-05-26 02:35:01,995: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:35:01.995812072Z [2024-05-26 02:35:01,995: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:35:01.996058254Z [2024-05-26 02:35:01,995: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:35:01.996132460Z [2024-05-26 02:35:01,995: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:35:01.996592676Z [2024-05-26 02:35:01,996: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:35:01.996644164Z [2024-05-26 02:35:01,996: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:35:02.015781414Z [2024-05-26 02:35:02,015: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:35:02.018798522Z [2024-05-26 02:35:02,018: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:35:02.046562438Z [2024-05-26 02:35:02,046: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:35:02.051308334Z [2024-05-26 02:35:02,051: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:35:02.051432527Z [2024-05-26 02:35:02,051: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:35:02.051691122Z [2024-05-26 02:35:02,051: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:35:02.051893561Z [2024-05-26 02:35:02,051: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:35:02.052195283Z [2024-05-26 02:35:02,052: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:35:02.052337378Z [2024-05-26 02:35:02,052: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:35:02.073233798Z [2024-05-26 02:35:02,072: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:35:02.122503526Z [2024-05-26 02:35:02,122: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:35:02.293008118Z [2024-05-26 02:35:02,292: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:35:02.296272855Z [2024-05-26 02:35:02,295: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:35:02.328118585Z [2024-05-26 02:35:02,327: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:35:02.329321978Z [2024-05-26 02:35:02,329: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:35:02.329371003Z [2024-05-26 02:35:02,329: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:35:02.329539349Z [2024-05-26 02:35:02,329: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:35:02.329617261Z [2024-05-26 02:35:02,329: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:35:02.329914498Z [2024-05-26 02:35:02,329: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:35:02.330039123Z [2024-05-26 02:35:02,329: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:35:02.441012843Z [2024-05-26 02:35:02,440: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:35:02.667354991Z [2024-05-26 02:35:02,666: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bc7fd087-698a-4098-8957-9dd9d5e97bf8] succeeded in 2.245366234999892s: None 2024-05-26T02:35:03.015043931Z [2024-05-26 02:35:03,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65b02702-1bc9-4c10-b3ae-6ac6f1fb4676] received 2024-05-26T02:35:03.024282543Z [2024-05-26 02:35:03,023: INFO/ForkPoolWorker-16] [65b02702-1bc9-4c10-b3ae-6ac6f1fb4676] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:35:03.363043264Z [2024-05-26 02:35:03,359: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:35:04.105741859Z [2024-05-26 02:35:04,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[daa56f24-f7e8-4851-8e32-7aa7dc8c294a] succeeded in 3.702140068000517s: None 2024-05-26T02:35:04.160434332Z [2024-05-26 02:35:04,159: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[47479b35-4e81-4815-b984-4c75bad0b6ec] succeeded in 3.724740338000629s: None 2024-05-26T02:35:04.816568731Z [2024-05-26 02:35:04,816: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:35:04.821700057Z [2024-05-26 02:35:04,821: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:35:04.862933883Z [2024-05-26 02:35:04,862: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:35:04.864352573Z [2024-05-26 02:35:04,864: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:35:04.864422954Z [2024-05-26 02:35:04,864: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:35:04.864756091Z [2024-05-26 02:35:04,864: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:35:04.864880151Z [2024-05-26 02:35:04,864: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:35:04.865326851Z [2024-05-26 02:35:04,865: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:35:04.865492210Z [2024-05-26 02:35:04,865: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:35:04.961321459Z [2024-05-26 02:35:04,961: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:35:05.619268774Z [2024-05-26 02:35:05,618: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65b02702-1bc9-4c10-b3ae-6ac6f1fb4676] succeeded in 2.601876290000291s: None 2024-05-26T02:35:05.744081450Z [2024-05-26 02:35:05,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2b5129a-2951-4702-8534-f8fb508c342f] received 2024-05-26T02:35:05.760241295Z [2024-05-26 02:35:05,759: INFO/ForkPoolWorker-15] [c2b5129a-2951-4702-8534-f8fb508c342f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:35:06.105470184Z [2024-05-26 02:35:06,101: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:35:07.316455588Z [2024-05-26 02:35:07,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:35:07.319634415Z [2024-05-26 02:35:07,319: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:35:07.340005211Z [2024-05-26 02:35:07,339: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:35:07.341373052Z [2024-05-26 02:35:07,341: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:35:07.341626768Z [2024-05-26 02:35:07,341: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:35:07.341819145Z [2024-05-26 02:35:07,341: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:35:07.342076832Z [2024-05-26 02:35:07,341: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:35:07.342360200Z [2024-05-26 02:35:07,342: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:35:07.342432652Z [2024-05-26 02:35:07,342: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:35:07.448740571Z [2024-05-26 02:35:07,448: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:35:08.874146165Z [2024-05-26 02:35:08,873: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2b5129a-2951-4702-8534-f8fb508c342f] succeeded in 3.126740654999594s: None 2024-05-26T02:35:09.310258858Z [2024-05-26 02:35:09,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58c0b0df-0a94-4e00-ad01-220df9bb68ba] received 2024-05-26T02:35:09.317155858Z [2024-05-26 02:35:09,316: INFO/ForkPoolWorker-15] [58c0b0df-0a94-4e00-ad01-220df9bb68ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:35:09.670387350Z [2024-05-26 02:35:09,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:35:10.704008160Z [2024-05-26 02:35:10,703: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:35:10.707311577Z [2024-05-26 02:35:10,706: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:35:10.747646033Z [2024-05-26 02:35:10,745: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:35:10.757419800Z [2024-05-26 02:35:10,752: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:35:10.757449108Z [2024-05-26 02:35:10,753: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:35:10.757456243Z [2024-05-26 02:35:10,753: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:35:10.757463460Z [2024-05-26 02:35:10,753: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:35:10.757469240Z [2024-05-26 02:35:10,755: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:35:10.757474915Z [2024-05-26 02:35:10,755: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:35:10.858795194Z [2024-05-26 02:35:10,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:35:11.397965822Z [2024-05-26 02:35:11,397: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58c0b0df-0a94-4e00-ad01-220df9bb68ba] succeeded in 2.0856183410014637s: None 2024-05-26T02:36:00.829227650Z [2024-05-26 02:36:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9982c7f-b6eb-4d51-8760-9b9b2c688bef] received 2024-05-26T02:36:00.830950155Z [2024-05-26 02:36:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85d02155-2e4d-4c57-bc8b-e979bcf43de3] received 2024-05-26T02:36:00.838976145Z [2024-05-26 02:36:00,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25af4b29-45f8-4ab2-b4b0-750dbda6be86] received 2024-05-26T02:36:00.845699817Z [2024-05-26 02:36:00,845: INFO/ForkPoolWorker-16] [85d02155-2e4d-4c57-bc8b-e979bcf43de3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:36:00.847718442Z [2024-05-26 02:36:00,847: INFO/ForkPoolWorker-15] [a9982c7f-b6eb-4d51-8760-9b9b2c688bef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:36:00.850320246Z [2024-05-26 02:36:00,850: INFO/ForkPoolWorker-1] [25af4b29-45f8-4ab2-b4b0-750dbda6be86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:36:00.850941102Z [2024-05-26 02:36:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb686022-51b9-459d-beea-d501e1edde50] received 2024-05-26T02:36:00.875040327Z [2024-05-26 02:36:00,874: INFO/ForkPoolWorker-2] [eb686022-51b9-459d-beea-d501e1edde50] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:36:01.182844116Z [2024-05-26 02:36:01,179: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:36:01.211493849Z [2024-05-26 02:36:01,208: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:36:01.255022926Z [2024-05-26 02:36:01,250: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:36:01.278665628Z [2024-05-26 02:36:01,266: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:36:01.493809380Z [2024-05-26 02:36:01,493: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:36:01.497594371Z [2024-05-26 02:36:01,497: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:36:01.515585654Z [2024-05-26 02:36:01,515: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:36:01.540085861Z [2024-05-26 02:36:01,539: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:36:01.541055740Z [2024-05-26 02:36:01,540: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:36:01.541216187Z [2024-05-26 02:36:01,540: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:36:01.541446301Z [2024-05-26 02:36:01,541: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:36:01.541805580Z [2024-05-26 02:36:01,541: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:36:01.659028933Z [2024-05-26 02:36:01,658: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:36:02.203309627Z [2024-05-26 02:36:02,202: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85d02155-2e4d-4c57-bc8b-e979bcf43de3] succeeded in 1.3700421710000228s: None 2024-05-26T02:36:02.305611574Z [2024-05-26 02:36:02,305: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eb686022-51b9-459d-beea-d501e1edde50] succeeded in 1.4524842999999237s: None 2024-05-26T02:36:02.474954354Z [2024-05-26 02:36:02,474: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:36:02.477976357Z [2024-05-26 02:36:02,477: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:36:02.508844806Z [2024-05-26 02:36:02,508: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:36:02.511994280Z [2024-05-26 02:36:02,511: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:36:02.512073296Z [2024-05-26 02:36:02,511: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:36:02.512544697Z [2024-05-26 02:36:02,512: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:36:02.512853544Z [2024-05-26 02:36:02,512: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:36:02.513412465Z [2024-05-26 02:36:02,513: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:36:02.513552216Z [2024-05-26 02:36:02,513: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:36:02.595949666Z [2024-05-26 02:36:02,595: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:36:02.602465180Z [2024-05-26 02:36:02,601: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:36:02.611528161Z [2024-05-26 02:36:02,611: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:36:02.619328402Z [2024-05-26 02:36:02,619: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:36:02.620639005Z [2024-05-26 02:36:02,620: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:36:02.620773000Z [2024-05-26 02:36:02,620: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:36:02.620963949Z [2024-05-26 02:36:02,620: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:36:02.621045518Z [2024-05-26 02:36:02,620: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:36:02.621602196Z [2024-05-26 02:36:02,621: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:36:02.621703317Z [2024-05-26 02:36:02,621: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:36:02.710288041Z [2024-05-26 02:36:02,710: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:36:04.114084594Z [2024-05-26 02:36:04,113: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9982c7f-b6eb-4d51-8760-9b9b2c688bef] succeeded in 3.2776262469997164s: None 2024-05-26T02:36:04.690641400Z [2024-05-26 02:36:04,690: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25af4b29-45f8-4ab2-b4b0-750dbda6be86] succeeded in 3.849488752999605s: None 2024-05-26T02:36:35.594654651Z [2024-05-26 02:36:35,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d32e9f76-fb58-4754-885e-821050eae750] received 2024-05-26T02:36:35.613607501Z [2024-05-26 02:36:35,613: INFO/ForkPoolWorker-15] [d32e9f76-fb58-4754-885e-821050eae750] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240526023635_598193', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-26T02:36:35.943601627Z [2024-05-26 02:36:35,940: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-05-26T02:36:36.246403496Z [2024-05-26 02:36:36,246: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:36:36.872536620Z [2024-05-26 02:36:36,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d32e9f76-fb58-4754-885e-821050eae750] succeeded in 1.2745017540000845s: None 2024-05-26T02:37:01.286402912Z [2024-05-26 02:37:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9b928d5-b04f-4447-bfc2-7922adc71c9d] received 2024-05-26T02:37:01.290931753Z [2024-05-26 02:37:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04a0a0e0-024f-4524-8fe2-633d6d104185] received 2024-05-26T02:37:01.294849108Z [2024-05-26 02:37:01,294: INFO/ForkPoolWorker-15] [f9b928d5-b04f-4447-bfc2-7922adc71c9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:37:01.297218092Z [2024-05-26 02:37:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e513170-2625-4e8b-84e5-0b1e7ea62d5e] received 2024-05-26T02:37:01.302146712Z [2024-05-26 02:37:01,301: INFO/ForkPoolWorker-16] [04a0a0e0-024f-4524-8fe2-633d6d104185] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:37:01.309791960Z [2024-05-26 02:37:01,309: INFO/ForkPoolWorker-1] [9e513170-2625-4e8b-84e5-0b1e7ea62d5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:37:01.659159898Z [2024-05-26 02:37:01,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:37:01.676695617Z [2024-05-26 02:37:01,673: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:37:01.687088771Z [2024-05-26 02:37:01,684: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:37:01.823074686Z [2024-05-26 02:37:01,822: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T02:37:01.826968699Z [2024-05-26 02:37:01,826: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:37:01.854896967Z [2024-05-26 02:37:01,854: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:37:01.856345152Z [2024-05-26 02:37:01,856: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:37:01.856737006Z [2024-05-26 02:37:01,856: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:37:01.856879840Z [2024-05-26 02:37:01,856: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T02:37:01.857183198Z [2024-05-26 02:37:01,857: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:37:01.935689145Z [2024-05-26 02:37:01,935: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:37:02.464760595Z [2024-05-26 02:37:02,464: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9b928d5-b04f-4447-bfc2-7922adc71c9d] succeeded in 1.1754581080003845s: None 2024-05-26T02:37:02.763978150Z [2024-05-26 02:37:02,763: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:37:02.767281194Z [2024-05-26 02:37:02,766: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:37:02.788064116Z [2024-05-26 02:37:02,787: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:37:02.791444411Z [2024-05-26 02:37:02,791: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:37:02.792744237Z [2024-05-26 02:37:02,792: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:37:02.792860342Z [2024-05-26 02:37:02,792: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:37:02.792993932Z [2024-05-26 02:37:02,792: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:37:02.793012275Z [2024-05-26 02:37:02,792: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:37:02.793101249Z [2024-05-26 02:37:02,793: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:37:02.793342348Z [2024-05-26 02:37:02,793: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:37:02.793433342Z [2024-05-26 02:37:02,793: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:37:02.824683573Z [2024-05-26 02:37:02,824: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:37:02.825892614Z [2024-05-26 02:37:02,825: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:37:02.826002701Z [2024-05-26 02:37:02,825: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:37:02.826238756Z [2024-05-26 02:37:02,825: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:37:02.826262553Z [2024-05-26 02:37:02,826: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:37:02.826625413Z [2024-05-26 02:37:02,826: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:37:02.826653604Z [2024-05-26 02:37:02,826: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:37:02.916733325Z [2024-05-26 02:37:02,916: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:37:02.924307470Z [2024-05-26 02:37:02,923: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:37:05.113815029Z [2024-05-26 02:37:05,113: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9e513170-2625-4e8b-84e5-0b1e7ea62d5e] succeeded in 3.8140015529988887s: None 2024-05-26T02:37:05.404353121Z [2024-05-26 02:37:05,403: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04a0a0e0-024f-4524-8fe2-633d6d104185] succeeded in 4.111040453000896s: None 2024-05-26T02:38:01.143895456Z [2024-05-26 02:38:01,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e837080-e0c3-4d93-9490-a24a6f372fad] received 2024-05-26T02:38:01.147558610Z [2024-05-26 02:38:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f5b2212-46ef-47a3-9c6f-2dfaa9f47db1] received 2024-05-26T02:38:01.153937996Z [2024-05-26 02:38:01,153: INFO/ForkPoolWorker-15] [0e837080-e0c3-4d93-9490-a24a6f372fad] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:38:01.155968550Z [2024-05-26 02:38:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ef103d0-feb1-472d-94b1-ab31892de5a2] received 2024-05-26T02:38:01.158603444Z [2024-05-26 02:38:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a21475ef-32b7-484f-9b6a-33db0fd8479f] received 2024-05-26T02:38:01.162356798Z [2024-05-26 02:38:01,161: INFO/ForkPoolWorker-16] [3f5b2212-46ef-47a3-9c6f-2dfaa9f47db1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:38:01.173382127Z [2024-05-26 02:38:01,172: INFO/ForkPoolWorker-1] [4ef103d0-feb1-472d-94b1-ab31892de5a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:38:01.181971654Z [2024-05-26 02:38:01,181: INFO/ForkPoolWorker-2] [a21475ef-32b7-484f-9b6a-33db0fd8479f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:38:01.467915753Z [2024-05-26 02:38:01,462: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:38:01.505262760Z [2024-05-26 02:38:01,500: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:38:01.675246939Z [2024-05-26 02:38:01,671: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:38:01.778965679Z [2024-05-26 02:38:01,775: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:38:01.855419386Z [2024-05-26 02:38:01,855: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:38:02.003119178Z [2024-05-26 02:38:02,000: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:38:02.006942216Z [2024-05-26 02:38:02,006: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:38:02.024917994Z [2024-05-26 02:38:02,024: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:38:02.027271601Z [2024-05-26 02:38:02,027: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:38:02.027644538Z [2024-05-26 02:38:02,027: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:38:02.027742249Z [2024-05-26 02:38:02,027: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:38:02.028082333Z [2024-05-26 02:38:02,027: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:38:02.168835124Z [2024-05-26 02:38:02,168: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:38:02.474761605Z [2024-05-26 02:38:02,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e837080-e0c3-4d93-9490-a24a6f372fad] succeeded in 1.328218418000688s: None 2024-05-26T02:38:02.759892274Z [2024-05-26 02:38:02,759: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:38:02.763122643Z [2024-05-26 02:38:02,762: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:38:02.787732821Z [2024-05-26 02:38:02,787: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:38:02.789181794Z [2024-05-26 02:38:02,788: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:38:02.789391767Z [2024-05-26 02:38:02,789: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:38:02.789585577Z [2024-05-26 02:38:02,789: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:38:02.789673265Z [2024-05-26 02:38:02,789: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:38:02.790028782Z [2024-05-26 02:38:02,789: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:38:02.790097042Z [2024-05-26 02:38:02,790: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:38:02.882098285Z [2024-05-26 02:38:02,881: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:38:02.909565485Z [2024-05-26 02:38:02,909: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a21475ef-32b7-484f-9b6a-33db0fd8479f] succeeded in 1.746674983000048s: None 2024-05-26T02:38:03.271849094Z [2024-05-26 02:38:03,271: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:38:03.276489367Z [2024-05-26 02:38:03,276: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:38:03.309251593Z [2024-05-26 02:38:03,307: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:38:03.312320970Z [2024-05-26 02:38:03,312: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:38:03.312596731Z [2024-05-26 02:38:03,312: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:38:03.312610087Z [2024-05-26 02:38:03,312: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:38:03.312778262Z [2024-05-26 02:38:03,312: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:38:03.313346816Z [2024-05-26 02:38:03,312: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:38:03.313446283Z [2024-05-26 02:38:03,313: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:38:03.407697733Z [2024-05-26 02:38:03,406: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:38:05.605786452Z [2024-05-26 02:38:05,605: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4ef103d0-feb1-472d-94b1-ab31892de5a2] succeeded in 4.440766477999205s: None 2024-05-26T02:38:05.649582847Z [2024-05-26 02:38:05,648: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f5b2212-46ef-47a3-9c6f-2dfaa9f47db1] succeeded in 4.498972487999708s: None 2024-05-26T02:39:01.019719558Z [2024-05-26 02:39:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bb269e0-859a-479b-b109-851992e2ec73] received 2024-05-26T02:39:01.023840674Z [2024-05-26 02:39:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9929e067-e6a5-4c13-a278-8aa422384530] received 2024-05-26T02:39:01.034282640Z [2024-05-26 02:39:01,033: INFO/ForkPoolWorker-15] [8bb269e0-859a-479b-b109-851992e2ec73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:39:01.038095575Z [2024-05-26 02:39:01,037: INFO/ForkPoolWorker-16] [9929e067-e6a5-4c13-a278-8aa422384530] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:39:01.041001136Z [2024-05-26 02:39:01,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfbfd2a1-588f-48db-bdf9-0e7fc7a4cab0] received 2024-05-26T02:39:01.059756539Z [2024-05-26 02:39:01,059: INFO/ForkPoolWorker-1] [cfbfd2a1-588f-48db-bdf9-0e7fc7a4cab0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:39:01.378638975Z [2024-05-26 02:39:01,370: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:39:01.395002522Z [2024-05-26 02:39:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:39:01.461380782Z [2024-05-26 02:39:01,457: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:39:01.622990571Z [2024-05-26 02:39:01,622: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:39:01.627604715Z [2024-05-26 02:39:01,627: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:39:01.671781377Z [2024-05-26 02:39:01,671: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:39:01.676428352Z [2024-05-26 02:39:01,676: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:39:01.676579316Z [2024-05-26 02:39:01,676: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:39:01.676647120Z [2024-05-26 02:39:01,676: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:39:01.676944077Z [2024-05-26 02:39:01,676: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:39:01.783370553Z [2024-05-26 02:39:01,783: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:39:02.487991257Z [2024-05-26 02:39:02,487: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9929e067-e6a5-4c13-a278-8aa422384530] succeeded in 1.458566504999908s: None 2024-05-26T02:39:02.584588875Z [2024-05-26 02:39:02,584: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:39:02.588085363Z [2024-05-26 02:39:02,587: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:39:02.592840947Z [2024-05-26 02:39:02,592: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:39:02.596067076Z [2024-05-26 02:39:02,595: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:39:02.612390776Z [2024-05-26 02:39:02,612: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:39:02.613805183Z [2024-05-26 02:39:02,613: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:39:02.613881432Z [2024-05-26 02:39:02,613: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:39:02.614089155Z [2024-05-26 02:39:02,613: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:39:02.614315380Z [2024-05-26 02:39:02,614: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:39:02.614687493Z [2024-05-26 02:39:02,614: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:39:02.614761533Z [2024-05-26 02:39:02,614: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:39:02.629515620Z [2024-05-26 02:39:02,629: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:39:02.631175374Z [2024-05-26 02:39:02,630: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:39:02.631370430Z [2024-05-26 02:39:02,631: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:39:02.631725541Z [2024-05-26 02:39:02,631: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:39:02.631919200Z [2024-05-26 02:39:02,631: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:39:02.632419633Z [2024-05-26 02:39:02,632: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:39:02.632504162Z [2024-05-26 02:39:02,632: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:39:02.697859376Z [2024-05-26 02:39:02,697: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:39:02.708802011Z [2024-05-26 02:39:02,708: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:39:04.816429450Z [2024-05-26 02:39:04,815: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cfbfd2a1-588f-48db-bdf9-0e7fc7a4cab0] succeeded in 3.769935479000196s: None 2024-05-26T02:39:05.207482796Z [2024-05-26 02:39:05,207: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8bb269e0-859a-479b-b109-851992e2ec73] succeeded in 4.181343895001191s: None 2024-05-26T02:40:00.350460239Z [2024-05-26 02:40:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdb3da4a-b194-4d46-83ff-117839fecd09] received 2024-05-26T02:40:00.360111973Z [2024-05-26 02:40:00,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10d10852-307f-41d8-beaf-4c808f7abd18] received 2024-05-26T02:40:00.362120105Z [2024-05-26 02:40:00,361: INFO/ForkPoolWorker-15] [fdb3da4a-b194-4d46-83ff-117839fecd09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:40:00.368590867Z [2024-05-26 02:40:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd5125fa-9f15-4e7d-a9c3-58f3327fa2d8] received 2024-05-26T02:40:00.372316591Z [2024-05-26 02:40:00,372: INFO/ForkPoolWorker-16] [10d10852-307f-41d8-beaf-4c808f7abd18] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:40:00.378381617Z [2024-05-26 02:40:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[690d19dc-d23d-4867-aa18-275d719bceba] received 2024-05-26T02:40:00.382620439Z [2024-05-26 02:40:00,382: INFO/ForkPoolWorker-1] [bd5125fa-9f15-4e7d-a9c3-58f3327fa2d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:40:00.383242975Z [2024-05-26 02:40:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a947894f-409b-4a30-a96b-ea61ee92f058] received 2024-05-26T02:40:00.391291783Z [2024-05-26 02:40:00,390: INFO/ForkPoolWorker-2] [690d19dc-d23d-4867-aa18-275d719bceba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:40:00.393941737Z [2024-05-26 02:40:00,393: INFO/ForkPoolWorker-3] [a947894f-409b-4a30-a96b-ea61ee92f058] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:40:00.686126313Z [2024-05-26 02:40:00,680: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:40:00.755676047Z [2024-05-26 02:40:00,749: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:40:00.767692021Z [2024-05-26 02:40:00,759: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:40:00.878941993Z [2024-05-26 02:40:00,874: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:40:00.961511494Z [2024-05-26 02:40:00,957: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:40:01.129338126Z [2024-05-26 02:40:01,128: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:40:01.134357898Z [2024-05-26 02:40:01,133: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:40:01.199161535Z [2024-05-26 02:40:01,198: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:40:01.201298110Z [2024-05-26 02:40:01,201: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:40:01.202684510Z [2024-05-26 02:40:01,201: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:40:01.203436777Z [2024-05-26 02:40:01,203: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:40:01.203801707Z [2024-05-26 02:40:01,203: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:40:01.238318162Z [2024-05-26 02:40:01,238: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:40:01.316489346Z [2024-05-26 02:40:01,316: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:40:01.931259543Z [2024-05-26 02:40:01,929: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[10d10852-307f-41d8-beaf-4c808f7abd18] succeeded in 1.5673572659998172s: None 2024-05-26T02:40:02.007876109Z [2024-05-26 02:40:02,007: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[690d19dc-d23d-4867-aa18-275d719bceba] succeeded in 1.626570417000039s: None 2024-05-26T02:40:02.491501419Z [2024-05-26 02:40:02,491: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T02:40:02.494648834Z [2024-05-26 02:40:02,494: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:40:02.520997314Z [2024-05-26 02:40:02,520: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T02:40:02.522648898Z [2024-05-26 02:40:02,522: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:40:02.522838339Z [2024-05-26 02:40:02,522: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:40:02.523136865Z [2024-05-26 02:40:02,522: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:40:02.523164182Z [2024-05-26 02:40:02,523: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T02:40:02.523643334Z [2024-05-26 02:40:02,523: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:40:02.523995901Z [2024-05-26 02:40:02,523: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:40:02.566829869Z [2024-05-26 02:40:02,566: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:40:02.570220803Z [2024-05-26 02:40:02,569: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:40:02.598547147Z [2024-05-26 02:40:02,598: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:40:02.602286719Z [2024-05-26 02:40:02,602: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:40:02.602299594Z [2024-05-26 02:40:02,602: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:40:02.602825700Z [2024-05-26 02:40:02,602: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:40:02.603080085Z [2024-05-26 02:40:02,602: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:40:02.603427524Z [2024-05-26 02:40:02,603: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:40:02.603789454Z [2024-05-26 02:40:02,603: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:40:02.603943720Z [2024-05-26 02:40:02,603: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:40:02.608300011Z [2024-05-26 02:40:02,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:40:02.618664077Z [2024-05-26 02:40:02,618: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:40:02.627717942Z [2024-05-26 02:40:02,627: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:40:02.628945111Z [2024-05-26 02:40:02,628: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:40:02.629134974Z [2024-05-26 02:40:02,628: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:40:02.631198171Z [2024-05-26 02:40:02,630: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:40:02.631625687Z [2024-05-26 02:40:02,631: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:40:02.632093716Z [2024-05-26 02:40:02,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:40:02.632675499Z [2024-05-26 02:40:02,632: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:40:02.731045258Z [2024-05-26 02:40:02,730: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:40:02.752728720Z [2024-05-26 02:40:02,752: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:40:03.283991660Z [2024-05-26 02:40:03,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f95cb9f-0fdf-4027-b33f-988cf6ab3d19] received 2024-05-26T02:40:03.296774407Z [2024-05-26 02:40:03,296: INFO/ForkPoolWorker-16] [3f95cb9f-0fdf-4027-b33f-988cf6ab3d19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:40:03.369158505Z [2024-05-26 02:40:03,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdb3da4a-b194-4d46-83ff-117839fecd09] succeeded in 3.0159436279991496s: None 2024-05-26T02:40:03.638527137Z [2024-05-26 02:40:03,635: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:40:04.498977034Z [2024-05-26 02:40:04,498: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[a947894f-409b-4a30-a96b-ea61ee92f058] succeeded in 4.113227060999634s: None 2024-05-26T02:40:04.889509205Z [2024-05-26 02:40:04,889: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bd5125fa-9f15-4e7d-a9c3-58f3327fa2d8] succeeded in 4.5184648929989635s: None 2024-05-26T02:40:05.277567578Z [2024-05-26 02:40:05,277: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:40:05.281116272Z [2024-05-26 02:40:05,280: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:40:05.313019057Z [2024-05-26 02:40:05,312: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:40:05.316182794Z [2024-05-26 02:40:05,315: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:40:05.316305114Z [2024-05-26 02:40:05,316: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:40:05.316457521Z [2024-05-26 02:40:05,316: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:40:05.316562917Z [2024-05-26 02:40:05,316: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:40:05.317145166Z [2024-05-26 02:40:05,316: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:40:05.319163166Z [2024-05-26 02:40:05,318: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:40:05.491640671Z [2024-05-26 02:40:05,490: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:40:06.186845546Z [2024-05-26 02:40:06,185: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f95cb9f-0fdf-4027-b33f-988cf6ab3d19] succeeded in 2.899784119999822s: None 2024-05-26T02:40:07.117731739Z [2024-05-26 02:40:07,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78aa99f4-d59b-477a-81d0-3d69f26e37d4] received 2024-05-26T02:40:07.130138324Z [2024-05-26 02:40:07,129: INFO/ForkPoolWorker-15] [78aa99f4-d59b-477a-81d0-3d69f26e37d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:40:07.396084691Z [2024-05-26 02:40:07,393: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:40:08.552387643Z [2024-05-26 02:40:08,551: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:40:08.555513643Z [2024-05-26 02:40:08,555: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:40:08.579783647Z [2024-05-26 02:40:08,579: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:40:08.581190672Z [2024-05-26 02:40:08,580: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:40:08.581213041Z [2024-05-26 02:40:08,581: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:40:08.581383069Z [2024-05-26 02:40:08,581: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:40:08.581437504Z [2024-05-26 02:40:08,581: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:40:08.582414724Z [2024-05-26 02:40:08,581: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:40:08.582444573Z [2024-05-26 02:40:08,581: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:40:08.673714923Z [2024-05-26 02:40:08,673: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:40:09.329381769Z [2024-05-26 02:40:09,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78aa99f4-d59b-477a-81d0-3d69f26e37d4] succeeded in 2.207846128998426s: None 2024-05-26T02:40:10.265926403Z [2024-05-26 02:40:10,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0a39625-60b1-4ddb-a719-104f22437c85] received 2024-05-26T02:40:10.279075299Z [2024-05-26 02:40:10,278: INFO/ForkPoolWorker-15] [f0a39625-60b1-4ddb-a719-104f22437c85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:40:10.588016834Z [2024-05-26 02:40:10,584: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:40:11.792017495Z [2024-05-26 02:40:11,791: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:40:11.795173437Z [2024-05-26 02:40:11,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:40:11.818841365Z [2024-05-26 02:40:11,818: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:40:11.820339424Z [2024-05-26 02:40:11,820: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:40:11.820405172Z [2024-05-26 02:40:11,820: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:40:11.820640186Z [2024-05-26 02:40:11,820: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:40:11.820763393Z [2024-05-26 02:40:11,820: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:40:11.821103484Z [2024-05-26 02:40:11,820: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:40:11.821143232Z [2024-05-26 02:40:11,821: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:40:11.922476959Z [2024-05-26 02:40:11,922: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:40:12.667801845Z [2024-05-26 02:40:12,667: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0a39625-60b1-4ddb-a719-104f22437c85] succeeded in 2.399518611999156s: None 2024-05-26T02:40:35.708416337Z [2024-05-26 02:40:35,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf2af192-c7f1-460b-8573-eba260f1beaf] received 2024-05-26T02:40:35.719464054Z [2024-05-26 02:40:35,719: INFO/ForkPoolWorker-15] [cf2af192-c7f1-460b-8573-eba260f1beaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240526024035_023481', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-26T02:40:36.051104226Z [2024-05-26 02:40:36,047: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-05-26T02:40:36.323989824Z [2024-05-26 02:40:36,323: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:40:37.004646441Z [2024-05-26 02:40:37,003: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf2af192-c7f1-460b-8573-eba260f1beaf] succeeded in 1.2892076240004826s: None 2024-05-26T02:41:00.787671498Z [2024-05-26 02:41:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee16910c-f69b-4777-8149-3808fd56b1f6] received 2024-05-26T02:41:00.794523310Z [2024-05-26 02:41:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44a04c11-65cf-41fa-9aee-659bee22fc6f] received 2024-05-26T02:41:00.801016921Z [2024-05-26 02:41:00,800: INFO/ForkPoolWorker-15] [ee16910c-f69b-4777-8149-3808fd56b1f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:41:00.806180251Z [2024-05-26 02:41:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9bdbbe4-7a89-4be8-b11c-1b0a58e75501] received 2024-05-26T02:41:00.814218316Z [2024-05-26 02:41:00,813: INFO/ForkPoolWorker-16] [44a04c11-65cf-41fa-9aee-659bee22fc6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:41:00.814486197Z [2024-05-26 02:41:00,814: INFO/ForkPoolWorker-1] [b9bdbbe4-7a89-4be8-b11c-1b0a58e75501] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:41:01.145394798Z [2024-05-26 02:41:01,141: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:41:01.174548922Z [2024-05-26 02:41:01,170: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:41:01.320565317Z [2024-05-26 02:41:01,320: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:41:01.324421209Z [2024-05-26 02:41:01,324: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:41:01.327178678Z [2024-05-26 02:41:01,324: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:41:01.364981923Z [2024-05-26 02:41:01,364: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:41:01.369038140Z [2024-05-26 02:41:01,368: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:41:01.369069113Z [2024-05-26 02:41:01,368: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:41:01.369132527Z [2024-05-26 02:41:01,369: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:41:01.369286599Z [2024-05-26 02:41:01,369: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:41:01.462573094Z [2024-05-26 02:41:01,462: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:41:02.078565659Z [2024-05-26 02:41:02,078: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b9bdbbe4-7a89-4be8-b11c-1b0a58e75501] succeeded in 1.270620011999199s: None 2024-05-26T02:41:02.351843576Z [2024-05-26 02:41:02,351: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:41:02.354822363Z [2024-05-26 02:41:02,354: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:41:02.372997368Z [2024-05-26 02:41:02,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:41:02.374007430Z [2024-05-26 02:41:02,373: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:41:02.374032838Z [2024-05-26 02:41:02,373: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:41:02.374156676Z [2024-05-26 02:41:02,374: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:41:02.374183396Z [2024-05-26 02:41:02,374: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:41:02.374407556Z [2024-05-26 02:41:02,374: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:41:02.374411489Z [2024-05-26 02:41:02,374: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:41:02.409994515Z [2024-05-26 02:41:02,409: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:41:02.413060295Z [2024-05-26 02:41:02,412: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:41:02.435238851Z [2024-05-26 02:41:02,434: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:41:02.441332997Z [2024-05-26 02:41:02,441: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:41:02.442053758Z [2024-05-26 02:41:02,441: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:41:02.442365974Z [2024-05-26 02:41:02,441: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:41:02.443804516Z [2024-05-26 02:41:02,443: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:41:02.445048312Z [2024-05-26 02:41:02,444: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:41:02.445109121Z [2024-05-26 02:41:02,444: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:41:02.445604555Z [2024-05-26 02:41:02,445: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:41:02.524062659Z [2024-05-26 02:41:02,523: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:41:03.912128248Z [2024-05-26 02:41:03,911: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[44a04c11-65cf-41fa-9aee-659bee22fc6f] succeeded in 3.109582451999813s: None 2024-05-26T02:41:04.325297524Z [2024-05-26 02:41:04,324: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee16910c-f69b-4777-8149-3808fd56b1f6] succeeded in 3.5374399550000817s: None 2024-05-26T02:42:01.157954463Z [2024-05-26 02:42:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f496ff3c-971b-482d-b953-2ff325809327] received 2024-05-26T02:42:01.161212908Z [2024-05-26 02:42:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[baf0bf8b-a015-428e-baf2-99cd6197f205] received 2024-05-26T02:42:01.170054844Z [2024-05-26 02:42:01,169: INFO/ForkPoolWorker-15] [f496ff3c-971b-482d-b953-2ff325809327] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:42:01.170826675Z [2024-05-26 02:42:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3f477cd-bfbc-472b-8029-c37edd2a25ad] received 2024-05-26T02:42:01.174715701Z [2024-05-26 02:42:01,174: INFO/ForkPoolWorker-16] [baf0bf8b-a015-428e-baf2-99cd6197f205] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:42:01.175337322Z [2024-05-26 02:42:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e2d18db-254f-485f-ab59-1c580805a968] received 2024-05-26T02:42:01.195023016Z [2024-05-26 02:42:01,194: INFO/ForkPoolWorker-1] [b3f477cd-bfbc-472b-8029-c37edd2a25ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:42:01.205619358Z [2024-05-26 02:42:01,205: INFO/ForkPoolWorker-2] [2e2d18db-254f-485f-ab59-1c580805a968] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:42:01.562703648Z [2024-05-26 02:42:01,559: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:42:01.572084742Z [2024-05-26 02:42:01,559: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:42:01.713863467Z [2024-05-26 02:42:01,709: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:42:01.734569566Z [2024-05-26 02:42:01,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:42:01.778254640Z [2024-05-26 02:42:01,777: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:42:01.782444770Z [2024-05-26 02:42:01,782: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:42:01.804242979Z [2024-05-26 02:42:01,804: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:42:01.806162211Z [2024-05-26 02:42:01,805: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:42:01.806440692Z [2024-05-26 02:42:01,806: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:42:01.806577565Z [2024-05-26 02:42:01,806: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:42:01.806847813Z [2024-05-26 02:42:01,806: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:42:01.906392247Z [2024-05-26 02:42:01,906: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:42:02.041864606Z [2024-05-26 02:42:02,041: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:42:02.620127496Z [2024-05-26 02:42:02,619: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2e2d18db-254f-485f-ab59-1c580805a968] succeeded in 1.4345849189994624s: None 2024-05-26T02:42:02.758479745Z [2024-05-26 02:42:02,757: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f496ff3c-971b-482d-b953-2ff325809327] succeeded in 1.5965253079994s: None 2024-05-26T02:42:02.960718765Z [2024-05-26 02:42:02,960: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:42:02.964071967Z [2024-05-26 02:42:02,963: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:42:02.983938971Z [2024-05-26 02:42:02,983: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:42:02.985373253Z [2024-05-26 02:42:02,985: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:42:02.985595087Z [2024-05-26 02:42:02,985: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:42:02.985781267Z [2024-05-26 02:42:02,985: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:42:02.985894766Z [2024-05-26 02:42:02,985: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:42:02.986211903Z [2024-05-26 02:42:02,986: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:42:02.986672336Z [2024-05-26 02:42:02,986: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:42:03.068729514Z [2024-05-26 02:42:03,068: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:42:03.128589765Z [2024-05-26 02:42:03,128: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:42:03.131619349Z [2024-05-26 02:42:03,131: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:42:03.163383132Z [2024-05-26 02:42:03,163: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:42:03.173478125Z [2024-05-26 02:42:03,164: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:42:03.173498788Z [2024-05-26 02:42:03,164: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:42:03.173503020Z [2024-05-26 02:42:03,164: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:42:03.173507219Z [2024-05-26 02:42:03,165: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:42:03.173510645Z [2024-05-26 02:42:03,165: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:42:03.173514428Z [2024-05-26 02:42:03,165: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:42:03.291924225Z [2024-05-26 02:42:03,291: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:42:05.187940267Z [2024-05-26 02:42:05,187: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b3f477cd-bfbc-472b-8029-c37edd2a25ad] succeeded in 4.012394162000419s: None 2024-05-26T02:42:05.336161855Z [2024-05-26 02:42:05,335: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[baf0bf8b-a015-428e-baf2-99cd6197f205] succeeded in 4.171559944001274s: None 2024-05-26T02:43:00.334423331Z [2024-05-26 02:43:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cdd2e23-24a0-4fdb-b37c-7d7f669611e5] received 2024-05-26T02:43:00.335877369Z [2024-05-26 02:43:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e59fbbb-2ddb-493a-b54a-e3085667d53d] received 2024-05-26T02:43:00.343603478Z [2024-05-26 02:43:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7c570f6-6232-4f35-beb6-78cb9b164c01] received 2024-05-26T02:43:00.349507238Z [2024-05-26 02:43:00,349: INFO/ForkPoolWorker-15] [1cdd2e23-24a0-4fdb-b37c-7d7f669611e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:43:00.360233938Z [2024-05-26 02:43:00,359: INFO/ForkPoolWorker-1] [d7c570f6-6232-4f35-beb6-78cb9b164c01] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:43:00.363164190Z [2024-05-26 02:43:00,362: INFO/ForkPoolWorker-16] [9e59fbbb-2ddb-493a-b54a-e3085667d53d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:43:00.681346367Z [2024-05-26 02:43:00,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:43:00.728620237Z [2024-05-26 02:43:00,717: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:43:00.825129066Z [2024-05-26 02:43:00,821: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:43:01.133494318Z [2024-05-26 02:43:01,133: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:43:01.137830738Z [2024-05-26 02:43:01,137: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:43:01.191144433Z [2024-05-26 02:43:01,190: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:43:01.193282725Z [2024-05-26 02:43:01,193: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:43:01.193411447Z [2024-05-26 02:43:01,193: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:43:01.193476325Z [2024-05-26 02:43:01,193: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:43:01.193691945Z [2024-05-26 02:43:01,193: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:43:01.341811656Z [2024-05-26 02:43:01,341: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:43:02.041086384Z [2024-05-26 02:43:02,040: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d7c570f6-6232-4f35-beb6-78cb9b164c01] succeeded in 1.6922701179992146s: None 2024-05-26T02:43:02.284766835Z [2024-05-26 02:43:02,284: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:43:02.288236651Z [2024-05-26 02:43:02,287: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:43:02.321192975Z [2024-05-26 02:43:02,320: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:43:02.322986613Z [2024-05-26 02:43:02,322: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:43:02.323103740Z [2024-05-26 02:43:02,322: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:43:02.323310715Z [2024-05-26 02:43:02,323: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:43:02.323397173Z [2024-05-26 02:43:02,323: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:43:02.323761570Z [2024-05-26 02:43:02,323: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:43:02.323851970Z [2024-05-26 02:43:02,323: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:43:02.406789110Z [2024-05-26 02:43:02,406: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:43:02.410724984Z [2024-05-26 02:43:02,409: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:43:02.431817746Z [2024-05-26 02:43:02,431: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:43:02.447830754Z [2024-05-26 02:43:02,447: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:43:02.453536269Z [2024-05-26 02:43:02,453: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:43:02.453722874Z [2024-05-26 02:43:02,453: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:43:02.453980212Z [2024-05-26 02:43:02,453: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:43:02.454127169Z [2024-05-26 02:43:02,453: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:43:02.456518402Z [2024-05-26 02:43:02,456: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:43:02.456543655Z [2024-05-26 02:43:02,456: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:43:02.555399952Z [2024-05-26 02:43:02,555: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:43:04.248523039Z [2024-05-26 02:43:04,248: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cdd2e23-24a0-4fdb-b37c-7d7f669611e5] succeeded in 3.9069652739999583s: None 2024-05-26T02:43:05.150629349Z [2024-05-26 02:43:05,150: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e59fbbb-2ddb-493a-b54a-e3085667d53d] succeeded in 4.8082963099986955s: None 2024-05-26T02:44:01.027183310Z [2024-05-26 02:44:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62c1a512-e635-4f74-9330-f203b999da30] received 2024-05-26T02:44:01.030116281Z [2024-05-26 02:44:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[216e49a0-b101-450d-bf2e-57aa3591362c] received 2024-05-26T02:44:01.044513835Z [2024-05-26 02:44:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[946a43c4-4b74-49d9-adcf-1660f9884ec4] received 2024-05-26T02:44:01.046652650Z [2024-05-26 02:44:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e93f2a62-3e0d-40c7-9382-5d9a4a16da2c] received 2024-05-26T02:44:01.050035556Z [2024-05-26 02:44:01,049: INFO/ForkPoolWorker-15] [62c1a512-e635-4f74-9330-f203b999da30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:44:01.054426097Z [2024-05-26 02:44:01,054: INFO/ForkPoolWorker-16] [216e49a0-b101-450d-bf2e-57aa3591362c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:44:01.058668468Z [2024-05-26 02:44:01,058: INFO/ForkPoolWorker-1] [946a43c4-4b74-49d9-adcf-1660f9884ec4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:44:01.059610046Z [2024-05-26 02:44:01,058: INFO/ForkPoolWorker-2] [e93f2a62-3e0d-40c7-9382-5d9a4a16da2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:44:01.372436424Z [2024-05-26 02:44:01,368: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:44:01.434908011Z [2024-05-26 02:44:01,431: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:44:01.489448723Z [2024-05-26 02:44:01,486: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:44:01.539263510Z [2024-05-26 02:44:01,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:44:01.598514417Z [2024-05-26 02:44:01,598: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:44:01.602477173Z [2024-05-26 02:44:01,602: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:44:01.626042302Z [2024-05-26 02:44:01,625: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:44:01.632262381Z [2024-05-26 02:44:01,632: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:44:01.633849422Z [2024-05-26 02:44:01,633: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:44:01.633938828Z [2024-05-26 02:44:01,633: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:44:01.634027029Z [2024-05-26 02:44:01,633: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:44:01.634238229Z [2024-05-26 02:44:01,634: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:44:01.745521594Z [2024-05-26 02:44:01,745: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:44:02.203732239Z [2024-05-26 02:44:02,203: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[946a43c4-4b74-49d9-adcf-1660f9884ec4] succeeded in 1.1556059229988023s: None 2024-05-26T02:44:02.230852167Z [2024-05-26 02:44:02,230: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[216e49a0-b101-450d-bf2e-57aa3591362c] succeeded in 1.1942386990012892s: None 2024-05-26T02:44:02.734753470Z [2024-05-26 02:44:02,734: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:44:02.737961540Z [2024-05-26 02:44:02,737: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:44:02.761311714Z [2024-05-26 02:44:02,761: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:44:02.762877835Z [2024-05-26 02:44:02,762: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:44:02.763094549Z [2024-05-26 02:44:02,762: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:44:02.763362375Z [2024-05-26 02:44:02,763: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:44:02.763639298Z [2024-05-26 02:44:02,763: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:44:02.764131432Z [2024-05-26 02:44:02,763: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:44:02.764307132Z [2024-05-26 02:44:02,764: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:44:02.798232941Z [2024-05-26 02:44:02,797: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:44:02.801342019Z [2024-05-26 02:44:02,800: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:44:02.831308655Z [2024-05-26 02:44:02,831: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:44:02.832900963Z [2024-05-26 02:44:02,832: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:44:02.832916584Z [2024-05-26 02:44:02,832: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:44:02.833107354Z [2024-05-26 02:44:02,832: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:44:02.833236849Z [2024-05-26 02:44:02,833: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:44:02.833610796Z [2024-05-26 02:44:02,833: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:44:02.833801535Z [2024-05-26 02:44:02,833: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:44:02.850688305Z [2024-05-26 02:44:02,850: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:44:02.928933773Z [2024-05-26 02:44:02,928: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:44:04.972476061Z [2024-05-26 02:44:04,972: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62c1a512-e635-4f74-9330-f203b999da30] succeeded in 3.9396470289993886s: None 2024-05-26T02:44:05.298380069Z [2024-05-26 02:44:05,297: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e93f2a62-3e0d-40c7-9382-5d9a4a16da2c] succeeded in 4.249576436001007s: None 2024-05-26T02:45:00.933839534Z [2024-05-26 02:45:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39e61382-0ba6-4049-8577-5d831ea0d767] received 2024-05-26T02:45:00.938427627Z [2024-05-26 02:45:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c521da4-8b9d-4284-8d5e-94b82d2dc865] received 2024-05-26T02:45:00.949674576Z [2024-05-26 02:45:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44712868-cf60-43d0-b88d-939bfc8dbaa6] received 2024-05-26T02:45:00.958317892Z [2024-05-26 02:45:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3efecbb-6f81-4da3-a918-9b6a2e5ce51b] received 2024-05-26T02:45:00.959170751Z [2024-05-26 02:45:00,958: INFO/ForkPoolWorker-15] [39e61382-0ba6-4049-8577-5d831ea0d767] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:45:00.964238660Z [2024-05-26 02:45:00,963: INFO/ForkPoolWorker-16] [9c521da4-8b9d-4284-8d5e-94b82d2dc865] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:45:00.967954166Z [2024-05-26 02:45:00,967: INFO/ForkPoolWorker-1] [44712868-cf60-43d0-b88d-939bfc8dbaa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:45:00.975698340Z [2024-05-26 02:45:00,975: INFO/ForkPoolWorker-2] [f3efecbb-6f81-4da3-a918-9b6a2e5ce51b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:45:01.462008296Z [2024-05-26 02:45:01,457: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:45:01.496212929Z [2024-05-26 02:45:01,488: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:45:01.551056086Z [2024-05-26 02:45:01,540: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:45:01.592202405Z [2024-05-26 02:45:01,589: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:45:01.641884261Z [2024-05-26 02:45:01,641: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:45:01.645833326Z [2024-05-26 02:45:01,645: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:45:01.675236982Z [2024-05-26 02:45:01,675: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:45:01.677282541Z [2024-05-26 02:45:01,677: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:45:01.677388433Z [2024-05-26 02:45:01,677: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:45:01.677516828Z [2024-05-26 02:45:01,677: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:45:01.678013571Z [2024-05-26 02:45:01,677: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:45:01.790973346Z [2024-05-26 02:45:01,790: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:45:02.306059474Z [2024-05-26 02:45:02,305: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9c521da4-8b9d-4284-8d5e-94b82d2dc865] succeeded in 1.3576030869990063s: None 2024-05-26T02:45:02.824189370Z [2024-05-26 02:45:02,823: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:45:02.833557232Z [2024-05-26 02:45:02,833: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:45:02.867993543Z [2024-05-26 02:45:02,867: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:45:02.869214566Z [2024-05-26 02:45:02,869: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:45:02.869343150Z [2024-05-26 02:45:02,869: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:45:02.869528288Z [2024-05-26 02:45:02,869: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:45:02.869644934Z [2024-05-26 02:45:02,869: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:45:02.870168762Z [2024-05-26 02:45:02,869: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:45:02.870298949Z [2024-05-26 02:45:02,870: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:45:02.942595387Z [2024-05-26 02:45:02,942: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:45:02.945930647Z [2024-05-26 02:45:02,945: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:45:02.950667706Z [2024-05-26 02:45:02,950: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:45:02.964095885Z [2024-05-26 02:45:02,963: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:45:02.965307999Z [2024-05-26 02:45:02,965: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:45:02.965428397Z [2024-05-26 02:45:02,965: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:45:02.965616108Z [2024-05-26 02:45:02,965: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:45:02.965758472Z [2024-05-26 02:45:02,965: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:45:02.966367490Z [2024-05-26 02:45:02,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:45:02.966507157Z [2024-05-26 02:45:02,966: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:45:03.021701886Z [2024-05-26 02:45:03,021: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:45:03.024921461Z [2024-05-26 02:45:03,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:45:03.046298972Z [2024-05-26 02:45:03,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:45:03.047807740Z [2024-05-26 02:45:03,047: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:45:03.047926765Z [2024-05-26 02:45:03,047: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:45:03.048098249Z [2024-05-26 02:45:03,047: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:45:03.048202065Z [2024-05-26 02:45:03,048: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:45:03.048412166Z [2024-05-26 02:45:03,048: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:45:03.048437680Z [2024-05-26 02:45:03,048: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:45:03.049073568Z [2024-05-26 02:45:03,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:45:03.128168491Z [2024-05-26 02:45:03,127: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:45:03.856386838Z [2024-05-26 02:45:03,856: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[44712868-cf60-43d0-b88d-939bfc8dbaa6] succeeded in 2.89634908699918s: None 2024-05-26T02:45:03.864851780Z [2024-05-26 02:45:03,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a1e1e76-610f-46db-b3b9-36b091c43924] received 2024-05-26T02:45:03.882589522Z [2024-05-26 02:45:03,882: INFO/ForkPoolWorker-16] [8a1e1e76-610f-46db-b3b9-36b091c43924] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:45:04.199302474Z [2024-05-26 02:45:04,196: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:45:04.724653770Z [2024-05-26 02:45:04,724: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39e61382-0ba6-4049-8577-5d831ea0d767] succeeded in 3.783600923999984s: None 2024-05-26T02:45:04.842007936Z [2024-05-26 02:45:04,841: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f3efecbb-6f81-4da3-a918-9b6a2e5ce51b] succeeded in 3.8740715330004605s: None 2024-05-26T02:45:05.590436971Z [2024-05-26 02:45:05,590: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:45:05.594811825Z [2024-05-26 02:45:05,594: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:45:05.654920382Z [2024-05-26 02:45:05,654: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:45:05.660328430Z [2024-05-26 02:45:05,660: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:45:05.660413689Z [2024-05-26 02:45:05,660: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:45:05.660568693Z [2024-05-26 02:45:05,660: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:45:05.660653058Z [2024-05-26 02:45:05,660: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:45:05.661019765Z [2024-05-26 02:45:05,660: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:45:05.661152113Z [2024-05-26 02:45:05,661: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:45:05.836164238Z [2024-05-26 02:45:05,835: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:45:06.477024075Z [2024-05-26 02:45:06,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8db4d508-46ad-4754-b88b-09ebb84c3240] received 2024-05-26T02:45:06.488175961Z [2024-05-26 02:45:06,487: INFO/ForkPoolWorker-15] [8db4d508-46ad-4754-b88b-09ebb84c3240] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:45:06.535811246Z [2024-05-26 02:45:06,535: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a1e1e76-610f-46db-b3b9-36b091c43924] succeeded in 2.6671938529998442s: None 2024-05-26T02:45:06.872304908Z [2024-05-26 02:45:06,869: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:45:07.954885207Z [2024-05-26 02:45:07,954: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:45:07.958276942Z [2024-05-26 02:45:07,957: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:45:07.989528744Z [2024-05-26 02:45:07,989: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:45:07.993593148Z [2024-05-26 02:45:07,993: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:45:07.993831361Z [2024-05-26 02:45:07,993: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:45:07.994132190Z [2024-05-26 02:45:07,993: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:45:07.994235742Z [2024-05-26 02:45:07,994: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:45:07.994615352Z [2024-05-26 02:45:07,994: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:45:07.994721993Z [2024-05-26 02:45:07,994: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:45:08.089096563Z [2024-05-26 02:45:08,088: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:45:08.752349142Z [2024-05-26 02:45:08,751: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8db4d508-46ad-4754-b88b-09ebb84c3240] succeeded in 2.2730453750009474s: None 2024-05-26T02:45:08.884260829Z [2024-05-26 02:45:08,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d5a01cd-a772-4a8e-9ee9-c6fd7419c65e] received 2024-05-26T02:45:08.896371469Z [2024-05-26 02:45:08,896: INFO/ForkPoolWorker-15] [9d5a01cd-a772-4a8e-9ee9-c6fd7419c65e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:45:09.210227541Z [2024-05-26 02:45:09,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:45:10.359746622Z [2024-05-26 02:45:10,359: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:45:10.362760507Z [2024-05-26 02:45:10,362: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:45:10.384325008Z [2024-05-26 02:45:10,384: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:45:10.385961533Z [2024-05-26 02:45:10,385: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:45:10.386001934Z [2024-05-26 02:45:10,385: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:45:10.386102570Z [2024-05-26 02:45:10,385: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:45:10.386264452Z [2024-05-26 02:45:10,386: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:45:10.386488365Z [2024-05-26 02:45:10,386: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:45:10.386521260Z [2024-05-26 02:45:10,386: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:45:10.479832770Z [2024-05-26 02:45:10,479: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:45:11.091609832Z [2024-05-26 02:45:11,090: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d5a01cd-a772-4a8e-9ee9-c6fd7419c65e] succeeded in 2.20183876199917s: None 2024-05-26T02:46:01.199688975Z [2024-05-26 02:46:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceb1b314-c862-4531-bd03-34413a06709e] received 2024-05-26T02:46:01.205669379Z [2024-05-26 02:46:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47d800b7-4f20-4f45-80f7-cc0f14aec4f0] received 2024-05-26T02:46:01.212158127Z [2024-05-26 02:46:01,211: INFO/ForkPoolWorker-15] [ceb1b314-c862-4531-bd03-34413a06709e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:46:01.212774684Z [2024-05-26 02:46:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c41e1a99-021d-4748-b01e-5a2aad1bade0] received 2024-05-26T02:46:01.219575551Z [2024-05-26 02:46:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b48ca0dd-02c8-4d73-a7f9-e863f9f8cfa3] received 2024-05-26T02:46:01.229630991Z [2024-05-26 02:46:01,229: INFO/ForkPoolWorker-2] [b48ca0dd-02c8-4d73-a7f9-e863f9f8cfa3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:46:01.229959771Z [2024-05-26 02:46:01,229: INFO/ForkPoolWorker-1] [c41e1a99-021d-4748-b01e-5a2aad1bade0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:46:01.233269118Z [2024-05-26 02:46:01,232: INFO/ForkPoolWorker-16] [47d800b7-4f20-4f45-80f7-cc0f14aec4f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:46:01.590307342Z [2024-05-26 02:46:01,586: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:46:01.645907761Z [2024-05-26 02:46:01,642: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:46:01.678386674Z [2024-05-26 02:46:01,674: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:46:01.693149768Z [2024-05-26 02:46:01,687: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:46:01.830023156Z [2024-05-26 02:46:01,829: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:46:01.833960226Z [2024-05-26 02:46:01,833: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:46:01.857156769Z [2024-05-26 02:46:01,856: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:46:01.860043421Z [2024-05-26 02:46:01,859: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:46:01.860093324Z [2024-05-26 02:46:01,859: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:46:01.860144344Z [2024-05-26 02:46:01,860: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:46:01.860327305Z [2024-05-26 02:46:01,860: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:46:01.936799427Z [2024-05-26 02:46:01,936: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:46:01.951044655Z [2024-05-26 02:46:01,950: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:46:02.556699700Z [2024-05-26 02:46:02,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ceb1b314-c862-4531-bd03-34413a06709e] succeeded in 1.3551758240009804s: None 2024-05-26T02:46:02.597949833Z [2024-05-26 02:46:02,597: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c41e1a99-021d-4748-b01e-5a2aad1bade0] succeeded in 1.382915801001218s: None 2024-05-26T02:46:02.901716187Z [2024-05-26 02:46:02,901: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:46:02.905342747Z [2024-05-26 02:46:02,904: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:46:02.929720831Z [2024-05-26 02:46:02,929: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:46:02.931379113Z [2024-05-26 02:46:02,931: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:46:02.931601979Z [2024-05-26 02:46:02,931: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:46:02.931953366Z [2024-05-26 02:46:02,931: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:46:02.932154999Z [2024-05-26 02:46:02,931: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:46:02.932754076Z [2024-05-26 02:46:02,932: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:46:02.933072719Z [2024-05-26 02:46:02,932: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:46:03.081483496Z [2024-05-26 02:46:03,081: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:46:03.167305256Z [2024-05-26 02:46:03,166: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:46:03.175126172Z [2024-05-26 02:46:03,174: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:46:03.237510122Z [2024-05-26 02:46:03,237: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:46:03.241506689Z [2024-05-26 02:46:03,241: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:46:03.241711020Z [2024-05-26 02:46:03,241: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:46:03.242041376Z [2024-05-26 02:46:03,241: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:46:03.242229407Z [2024-05-26 02:46:03,242: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:46:03.242647389Z [2024-05-26 02:46:03,242: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:46:03.242826528Z [2024-05-26 02:46:03,242: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:46:03.346122550Z [2024-05-26 02:46:03,345: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:46:04.737865738Z [2024-05-26 02:46:04,737: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[47d800b7-4f20-4f45-80f7-cc0f14aec4f0] succeeded in 3.53051571099968s: None 2024-05-26T02:46:05.291462784Z [2024-05-26 02:46:05,290: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b48ca0dd-02c8-4d73-a7f9-e863f9f8cfa3] succeeded in 4.069390120001117s: None 2024-05-26T02:47:00.364150424Z [2024-05-26 02:47:00,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cd098b9-6fac-483c-83af-80f450438d8e] received 2024-05-26T02:47:00.369935925Z [2024-05-26 02:47:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6fd1b25-0cd7-4922-b555-5f4740de289d] received 2024-05-26T02:47:00.379455421Z [2024-05-26 02:47:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d35520e-1f7f-4e87-9239-e8ca37049abe] received 2024-05-26T02:47:00.386638296Z [2024-05-26 02:47:00,386: INFO/ForkPoolWorker-16] [b6fd1b25-0cd7-4922-b555-5f4740de289d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:47:00.387156008Z [2024-05-26 02:47:00,386: INFO/ForkPoolWorker-15] [5cd098b9-6fac-483c-83af-80f450438d8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:47:00.396003764Z [2024-05-26 02:47:00,395: INFO/ForkPoolWorker-1] [1d35520e-1f7f-4e87-9239-e8ca37049abe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:47:00.693854294Z [2024-05-26 02:47:00,690: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:47:00.722211180Z [2024-05-26 02:47:00,719: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:47:00.731575567Z [2024-05-26 02:47:00,721: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:47:00.870290966Z [2024-05-26 02:47:00,869: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:47:00.874246451Z [2024-05-26 02:47:00,873: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:47:00.898988006Z [2024-05-26 02:47:00,898: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:47:00.900041387Z [2024-05-26 02:47:00,899: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:47:00.900153105Z [2024-05-26 02:47:00,899: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:47:00.900158607Z [2024-05-26 02:47:00,900: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:47:00.900359094Z [2024-05-26 02:47:00,900: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:47:00.995672046Z [2024-05-26 02:47:00,995: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:47:01.622992816Z [2024-05-26 02:47:01,622: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1d35520e-1f7f-4e87-9239-e8ca37049abe] succeeded in 1.2411948730004951s: None 2024-05-26T02:47:01.866157082Z [2024-05-26 02:47:01,865: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:47:01.869181424Z [2024-05-26 02:47:01,868: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:47:01.890972633Z [2024-05-26 02:47:01,890: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:47:01.892334541Z [2024-05-26 02:47:01,892: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:47:01.892380019Z [2024-05-26 02:47:01,892: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:47:01.892510056Z [2024-05-26 02:47:01,892: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:47:01.892549366Z [2024-05-26 02:47:01,892: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:47:01.892825693Z [2024-05-26 02:47:01,892: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:47:01.892897342Z [2024-05-26 02:47:01,892: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:47:01.967733117Z [2024-05-26 02:47:01,964: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:47:01.969325648Z [2024-05-26 02:47:01,968: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:47:01.987998328Z [2024-05-26 02:47:01,987: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:47:01.990382875Z [2024-05-26 02:47:01,990: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:47:01.991371271Z [2024-05-26 02:47:01,991: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:47:01.991383746Z [2024-05-26 02:47:01,991: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:47:01.991490010Z [2024-05-26 02:47:01,991: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:47:01.992039052Z [2024-05-26 02:47:01,991: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:47:01.992326559Z [2024-05-26 02:47:01,992: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:47:01.992992664Z [2024-05-26 02:47:01,992: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:47:02.110390521Z [2024-05-26 02:47:02,110: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:47:03.942316174Z [2024-05-26 02:47:03,941: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5cd098b9-6fac-483c-83af-80f450438d8e] succeeded in 3.56613550000111s: None 2024-05-26T02:47:04.580943120Z [2024-05-26 02:47:04,580: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6fd1b25-0cd7-4922-b555-5f4740de289d] succeeded in 4.207733199998984s: None 2024-05-26T02:48:00.510497290Z [2024-05-26 02:48:00,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4d7b1cc-d866-4bca-8076-e5c2ac0d65fc] received 2024-05-26T02:48:00.515993254Z [2024-05-26 02:48:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1540279-6312-4303-b186-4a1a41246876] received 2024-05-26T02:48:00.526999484Z [2024-05-26 02:48:00,526: INFO/ForkPoolWorker-15] [b4d7b1cc-d866-4bca-8076-e5c2ac0d65fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:48:00.528911437Z [2024-05-26 02:48:00,528: INFO/ForkPoolWorker-16] [c1540279-6312-4303-b186-4a1a41246876] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:48:00.529759260Z [2024-05-26 02:48:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[351add3f-2317-4bb4-a9ca-f2fc0040b844] received 2024-05-26T02:48:00.532759252Z [2024-05-26 02:48:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb70d9e5-87ee-4d12-a3e5-612ba7e7b148] received 2024-05-26T02:48:00.539443947Z [2024-05-26 02:48:00,539: INFO/ForkPoolWorker-1] [351add3f-2317-4bb4-a9ca-f2fc0040b844] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:48:00.578880455Z [2024-05-26 02:48:00,578: INFO/ForkPoolWorker-2] [eb70d9e5-87ee-4d12-a3e5-612ba7e7b148] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:48:00.872958463Z [2024-05-26 02:48:00,869: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:48:00.882270225Z [2024-05-26 02:48:00,879: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:48:00.885640935Z [2024-05-26 02:48:00,882: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:48:00.923001118Z [2024-05-26 02:48:00,919: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:48:01.064606307Z [2024-05-26 02:48:01,064: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:48:01.068954448Z [2024-05-26 02:48:01,068: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:48:01.130147584Z [2024-05-26 02:48:01,129: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:48:01.131410920Z [2024-05-26 02:48:01,131: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:48:01.131563361Z [2024-05-26 02:48:01,131: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:48:01.131749846Z [2024-05-26 02:48:01,131: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:48:01.131981490Z [2024-05-26 02:48:01,131: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:48:01.210347254Z [2024-05-26 02:48:01,210: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:48:01.239920474Z [2024-05-26 02:48:01,239: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:48:01.855106553Z [2024-05-26 02:48:01,854: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1540279-6312-4303-b186-4a1a41246876] succeeded in 1.3319320640002843s: None 2024-05-26T02:48:01.917986556Z [2024-05-26 02:48:01,917: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[351add3f-2317-4bb4-a9ca-f2fc0040b844] succeeded in 1.3836401789994852s: None 2024-05-26T02:48:02.179861306Z [2024-05-26 02:48:02,179: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:48:02.183305171Z [2024-05-26 02:48:02,182: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:48:02.214803216Z [2024-05-26 02:48:02,213: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:48:02.218928517Z [2024-05-26 02:48:02,218: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:48:02.219030657Z [2024-05-26 02:48:02,218: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:48:02.219236188Z [2024-05-26 02:48:02,219: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:48:02.219339330Z [2024-05-26 02:48:02,219: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:48:02.220269345Z [2024-05-26 02:48:02,219: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:48:02.221385396Z [2024-05-26 02:48:02,220: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:48:02.257233900Z [2024-05-26 02:48:02,256: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:48:02.260330219Z [2024-05-26 02:48:02,259: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:48:02.281342114Z [2024-05-26 02:48:02,281: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:48:02.282655171Z [2024-05-26 02:48:02,282: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:48:02.282951896Z [2024-05-26 02:48:02,282: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:48:02.283164729Z [2024-05-26 02:48:02,282: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:48:02.283270957Z [2024-05-26 02:48:02,283: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:48:02.283609542Z [2024-05-26 02:48:02,283: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:48:02.283810932Z [2024-05-26 02:48:02,283: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:48:02.324301060Z [2024-05-26 02:48:02,324: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:48:02.360396432Z [2024-05-26 02:48:02,360: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:48:03.788855674Z [2024-05-26 02:48:03,788: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4d7b1cc-d866-4bca-8076-e5c2ac0d65fc] succeeded in 3.2708495229999244s: None 2024-05-26T02:48:06.105497418Z [2024-05-26 02:48:06,104: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eb70d9e5-87ee-4d12-a3e5-612ba7e7b148] succeeded in 5.568444227999862s: None 2024-05-26T02:49:00.321318517Z [2024-05-26 02:49:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8324d98d-0fcc-4d09-b8e0-2afbaf18e3d1] received 2024-05-26T02:49:00.333260930Z [2024-05-26 02:49:00,332: INFO/ForkPoolWorker-15] [8324d98d-0fcc-4d09-b8e0-2afbaf18e3d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:49:00.333909292Z [2024-05-26 02:49:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef1b6df0-4368-422f-95f8-0b702511a29e] received 2024-05-26T02:49:00.349460451Z [2024-05-26 02:49:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f5cc887-3814-4932-8214-f19a593fc9ed] received 2024-05-26T02:49:00.351214980Z [2024-05-26 02:49:00,350: INFO/ForkPoolWorker-16] [ef1b6df0-4368-422f-95f8-0b702511a29e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:49:00.365971489Z [2024-05-26 02:49:00,365: INFO/ForkPoolWorker-1] [0f5cc887-3814-4932-8214-f19a593fc9ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:49:00.617846964Z [2024-05-26 02:49:00,614: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:49:00.694628439Z [2024-05-26 02:49:00,691: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:49:00.725977982Z [2024-05-26 02:49:00,721: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:49:00.949553167Z [2024-05-26 02:49:00,949: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:49:00.954301932Z [2024-05-26 02:49:00,953: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:49:00.981564063Z [2024-05-26 02:49:00,981: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:49:00.982734588Z [2024-05-26 02:49:00,982: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:49:00.982944587Z [2024-05-26 02:49:00,982: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:49:00.983025339Z [2024-05-26 02:49:00,982: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:49:00.983245620Z [2024-05-26 02:49:00,983: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:49:01.078717199Z [2024-05-26 02:49:01,078: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:49:01.722177934Z [2024-05-26 02:49:01,721: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0f5cc887-3814-4932-8214-f19a593fc9ed] succeeded in 1.3688690569997561s: None 2024-05-26T02:49:01.793293491Z [2024-05-26 02:49:01,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:49:01.806657496Z [2024-05-26 02:49:01,806: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:49:01.843619759Z [2024-05-26 02:49:01,843: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:49:01.845025021Z [2024-05-26 02:49:01,844: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:49:01.845218867Z [2024-05-26 02:49:01,844: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:49:01.845435790Z [2024-05-26 02:49:01,845: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:49:01.845582343Z [2024-05-26 02:49:01,845: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:49:01.845967962Z [2024-05-26 02:49:01,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:49:01.846130025Z [2024-05-26 02:49:01,846: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:49:01.927167467Z [2024-05-26 02:49:01,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:49:01.958408981Z [2024-05-26 02:49:01,957: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:49:01.961360176Z [2024-05-26 02:49:01,960: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:49:01.980908552Z [2024-05-26 02:49:01,980: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:49:01.984325300Z [2024-05-26 02:49:01,984: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:49:01.984420055Z [2024-05-26 02:49:01,984: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:49:01.984604413Z [2024-05-26 02:49:01,984: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:49:01.984678229Z [2024-05-26 02:49:01,984: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:49:01.985021337Z [2024-05-26 02:49:01,984: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:49:01.985589624Z [2024-05-26 02:49:01,985: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:49:02.081273239Z [2024-05-26 02:49:02,080: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:49:03.960568560Z [2024-05-26 02:49:03,959: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8324d98d-0fcc-4d09-b8e0-2afbaf18e3d1] succeeded in 3.6353142820007633s: None 2024-05-26T02:49:04.840281507Z [2024-05-26 02:49:04,839: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef1b6df0-4368-422f-95f8-0b702511a29e] succeeded in 4.503012769999259s: None 2024-05-26T02:50:01.040485076Z [2024-05-26 02:50:01,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de9e06b6-fdba-4d30-acd5-c33fcc9981b2] received 2024-05-26T02:50:01.042284993Z [2024-05-26 02:50:01,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d73725be-0379-4250-87f1-58af6c0807d7] received 2024-05-26T02:50:01.048268124Z [2024-05-26 02:50:01,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f105445b-bc90-4c79-ae40-d3a44e82dd7a] received 2024-05-26T02:50:01.051209370Z [2024-05-26 02:50:01,050: INFO/ForkPoolWorker-16] [d73725be-0379-4250-87f1-58af6c0807d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:50:01.054275284Z [2024-05-26 02:50:01,053: INFO/ForkPoolWorker-15] [de9e06b6-fdba-4d30-acd5-c33fcc9981b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:50:01.057369705Z [2024-05-26 02:50:01,057: INFO/ForkPoolWorker-1] [f105445b-bc90-4c79-ae40-d3a44e82dd7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:50:01.064219392Z [2024-05-26 02:50:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[065bfa3e-85b3-4813-8111-2cc0bc7c917b] received 2024-05-26T02:50:01.072338603Z [2024-05-26 02:50:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[468ea27c-26a6-4dff-815f-ff17b86e0958] received 2024-05-26T02:50:01.076827208Z [2024-05-26 02:50:01,076: INFO/ForkPoolWorker-2] [065bfa3e-85b3-4813-8111-2cc0bc7c917b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:50:01.085097052Z [2024-05-26 02:50:01,084: INFO/ForkPoolWorker-3] [468ea27c-26a6-4dff-815f-ff17b86e0958] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:50:01.378325865Z [2024-05-26 02:50:01,374: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:50:01.465244963Z [2024-05-26 02:50:01,460: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:50:01.544984776Z [2024-05-26 02:50:01,541: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:50:01.556294271Z [2024-05-26 02:50:01,555: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:50:01.560715823Z [2024-05-26 02:50:01,560: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:50:01.603615500Z [2024-05-26 02:50:01,603: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:50:01.606891012Z [2024-05-26 02:50:01,606: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:50:01.607109715Z [2024-05-26 02:50:01,606: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:50:01.607251047Z [2024-05-26 02:50:01,607: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:50:01.607683345Z [2024-05-26 02:50:01,607: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:50:01.738074538Z [2024-05-26 02:50:01,734: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:50:01.791926770Z [2024-05-26 02:50:01,791: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:50:01.921846987Z [2024-05-26 02:50:01,917: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:50:02.039350668Z [2024-05-26 02:50:02,039: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:50:02.685481693Z [2024-05-26 02:50:02,685: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f105445b-bc90-4c79-ae40-d3a44e82dd7a] succeeded in 1.6353303759988194s: None 2024-05-26T02:50:02.775657318Z [2024-05-26 02:50:02,775: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d73725be-0379-4250-87f1-58af6c0807d7] succeeded in 1.7312787609989755s: None 2024-05-26T02:50:03.118031646Z [2024-05-26 02:50:03,117: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-26T02:50:03.121326080Z [2024-05-26 02:50:03,120: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:50:03.144873537Z [2024-05-26 02:50:03,144: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-26T02:50:03.147331235Z [2024-05-26 02:50:03,147: INFO/ForkPoolWorker-3] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:50:03.147453099Z [2024-05-26 02:50:03,147: INFO/ForkPoolWorker-3] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:50:03.147764841Z [2024-05-26 02:50:03,147: INFO/ForkPoolWorker-3] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:50:03.147956182Z [2024-05-26 02:50:03,147: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-26T02:50:03.148255471Z [2024-05-26 02:50:03,148: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:50:03.148475232Z [2024-05-26 02:50:03,148: INFO/ForkPoolWorker-3] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:50:03.270310570Z [2024-05-26 02:50:03,270: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:50:03.309777611Z [2024-05-26 02:50:03,309: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:50:03.322044423Z [2024-05-26 02:50:03,321: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:50:03.363268545Z [2024-05-26 02:50:03,363: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:50:03.365273324Z [2024-05-26 02:50:03,364: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:50:03.365292508Z [2024-05-26 02:50:03,365: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:50:03.365477045Z [2024-05-26 02:50:03,365: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:50:03.365549453Z [2024-05-26 02:50:03,365: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:50:03.365833267Z [2024-05-26 02:50:03,365: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:50:03.365888793Z [2024-05-26 02:50:03,365: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:50:03.483681189Z [2024-05-26 02:50:03,483: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:50:03.923661355Z [2024-05-26 02:50:03,922: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:50:03.937235692Z [2024-05-26 02:50:03,936: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:50:03.990682968Z [2024-05-26 02:50:03,990: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:50:03.991785754Z [2024-05-26 02:50:03,991: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:50:03.991802522Z [2024-05-26 02:50:03,991: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:50:03.991914151Z [2024-05-26 02:50:03,991: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:50:03.991947675Z [2024-05-26 02:50:03,991: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:50:03.992231474Z [2024-05-26 02:50:03,992: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:50:03.992261127Z [2024-05-26 02:50:03,992: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:50:04.115163335Z [2024-05-26 02:50:04,114: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:50:04.176705817Z [2024-05-26 02:50:04,176: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de9e06b6-fdba-4d30-acd5-c33fcc9981b2] succeeded in 3.134191701999953s: None 2024-05-26T02:50:04.973909500Z [2024-05-26 02:50:04,973: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[468ea27c-26a6-4dff-815f-ff17b86e0958] succeeded in 3.897933306001505s: None 2024-05-26T02:50:05.138413747Z [2024-05-26 02:50:05,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f12f4b9b-5213-4f10-83c2-ded34cd1fc4a] received 2024-05-26T02:50:05.168294614Z [2024-05-26 02:50:05,168: INFO/ForkPoolWorker-15] [f12f4b9b-5213-4f10-83c2-ded34cd1fc4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:50:05.531701405Z [2024-05-26 02:50:05,522: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:50:06.288343009Z [2024-05-26 02:50:06,287: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[065bfa3e-85b3-4813-8111-2cc0bc7c917b] succeeded in 5.221475835998717s: None 2024-05-26T02:50:06.865889568Z [2024-05-26 02:50:06,865: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:50:06.872692182Z [2024-05-26 02:50:06,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:50:06.894555405Z [2024-05-26 02:50:06,894: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:50:06.896362183Z [2024-05-26 02:50:06,896: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:50:06.896516401Z [2024-05-26 02:50:06,896: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:50:06.896763249Z [2024-05-26 02:50:06,896: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:50:06.896960219Z [2024-05-26 02:50:06,896: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:50:06.897354280Z [2024-05-26 02:50:06,897: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:50:06.897454736Z [2024-05-26 02:50:06,897: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:50:07.002641326Z [2024-05-26 02:50:07,002: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:50:07.777844776Z [2024-05-26 02:50:07,777: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f12f4b9b-5213-4f10-83c2-ded34cd1fc4a] succeeded in 2.6379452849996596s: None 2024-05-26T02:50:07.945574801Z [2024-05-26 02:50:07,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c885e1d9-fed2-4ce1-b086-3a254a06c8e3] received 2024-05-26T02:50:07.952997661Z [2024-05-26 02:50:07,952: INFO/ForkPoolWorker-15] [c885e1d9-fed2-4ce1-b086-3a254a06c8e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:50:08.208864303Z [2024-05-26 02:50:08,205: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:50:09.293743379Z [2024-05-26 02:50:09,293: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:50:09.296927550Z [2024-05-26 02:50:09,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:50:09.323492993Z [2024-05-26 02:50:09,323: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:50:09.325122506Z [2024-05-26 02:50:09,324: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:50:09.325329242Z [2024-05-26 02:50:09,325: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:50:09.325645773Z [2024-05-26 02:50:09,325: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:50:09.325772081Z [2024-05-26 02:50:09,325: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:50:09.326251261Z [2024-05-26 02:50:09,325: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:50:09.326471205Z [2024-05-26 02:50:09,326: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:50:09.413826182Z [2024-05-26 02:50:09,413: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:50:10.058230648Z [2024-05-26 02:50:10,057: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c885e1d9-fed2-4ce1-b086-3a254a06c8e3] succeeded in 2.110735932999887s: None 2024-05-26T02:50:10.337873678Z [2024-05-26 02:50:10,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0c85aa0-ed1b-4ee5-a17a-8ac7d46e4dbe] received 2024-05-26T02:50:10.347395764Z [2024-05-26 02:50:10,347: INFO/ForkPoolWorker-15] [e0c85aa0-ed1b-4ee5-a17a-8ac7d46e4dbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:50:10.631229029Z [2024-05-26 02:50:10,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:50:11.677440135Z [2024-05-26 02:50:11,676: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:50:11.680463623Z [2024-05-26 02:50:11,679: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:50:11.701600138Z [2024-05-26 02:50:11,701: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:50:11.702728126Z [2024-05-26 02:50:11,702: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:50:11.702733297Z [2024-05-26 02:50:11,702: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:50:11.702906450Z [2024-05-26 02:50:11,702: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:50:11.702911751Z [2024-05-26 02:50:11,702: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:50:11.703138380Z [2024-05-26 02:50:11,702: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:50:11.703142951Z [2024-05-26 02:50:11,703: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:50:11.794414049Z [2024-05-26 02:50:11,793: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:50:12.487270423Z [2024-05-26 02:50:12,486: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0c85aa0-ed1b-4ee5-a17a-8ac7d46e4dbe] succeeded in 2.1472244119995594s: None 2024-05-26T02:51:00.943378518Z [2024-05-26 02:51:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a359e7b1-bbbe-4074-86e7-eb6a93bb9ce8] received 2024-05-26T02:51:00.945285453Z [2024-05-26 02:51:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c203089-30cf-4ed2-a3d6-628944b4f965] received 2024-05-26T02:51:00.946897335Z [2024-05-26 02:51:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bdc7dca-60ff-4260-a54f-7311a978a444] received 2024-05-26T02:51:00.959298718Z [2024-05-26 02:51:00,958: INFO/ForkPoolWorker-15] [a359e7b1-bbbe-4074-86e7-eb6a93bb9ce8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:51:00.964346148Z [2024-05-26 02:51:00,963: INFO/ForkPoolWorker-1] [0bdc7dca-60ff-4260-a54f-7311a978a444] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:51:00.969550391Z [2024-05-26 02:51:00,969: INFO/ForkPoolWorker-16] [7c203089-30cf-4ed2-a3d6-628944b4f965] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:51:01.304233404Z [2024-05-26 02:51:01,296: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:51:01.342507041Z [2024-05-26 02:51:01,338: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:51:01.449670265Z [2024-05-26 02:51:01,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:51:01.596773548Z [2024-05-26 02:51:01,596: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-26T02:51:01.600803031Z [2024-05-26 02:51:01,600: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:51:01.620194558Z [2024-05-26 02:51:01,619: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:51:01.621325516Z [2024-05-26 02:51:01,621: INFO/ForkPoolWorker-15] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:51:01.621505408Z [2024-05-26 02:51:01,621: INFO/ForkPoolWorker-15] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:51:01.621620808Z [2024-05-26 02:51:01,621: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-26T02:51:01.621892615Z [2024-05-26 02:51:01,621: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:51:01.735807348Z [2024-05-26 02:51:01,735: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:51:02.368988533Z [2024-05-26 02:51:02,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a359e7b1-bbbe-4074-86e7-eb6a93bb9ce8] succeeded in 1.4237985540003137s: None 2024-05-26T02:51:02.482769810Z [2024-05-26 02:51:02,482: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:51:02.486067367Z [2024-05-26 02:51:02,485: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:51:02.526410737Z [2024-05-26 02:51:02,526: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:51:02.528153715Z [2024-05-26 02:51:02,527: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:51:02.528409692Z [2024-05-26 02:51:02,528: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:51:02.528693135Z [2024-05-26 02:51:02,528: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:51:02.528923536Z [2024-05-26 02:51:02,528: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:51:02.529568818Z [2024-05-26 02:51:02,529: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:51:02.529713053Z [2024-05-26 02:51:02,529: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:51:02.616196934Z [2024-05-26 02:51:02,615: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:51:02.629218732Z [2024-05-26 02:51:02,628: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:51:02.633212002Z [2024-05-26 02:51:02,632: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:51:02.671513593Z [2024-05-26 02:51:02,671: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:51:02.672932296Z [2024-05-26 02:51:02,672: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:51:02.673057800Z [2024-05-26 02:51:02,672: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:51:02.673283474Z [2024-05-26 02:51:02,673: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:51:02.673448032Z [2024-05-26 02:51:02,673: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:51:02.673719711Z [2024-05-26 02:51:02,673: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:51:02.673792292Z [2024-05-26 02:51:02,673: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:51:02.761665513Z [2024-05-26 02:51:02,761: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:51:04.344879289Z [2024-05-26 02:51:04,344: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0bdc7dca-60ff-4260-a54f-7311a978a444] succeeded in 3.3958751789996313s: None 2024-05-26T02:51:04.894521986Z [2024-05-26 02:51:04,893: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c203089-30cf-4ed2-a3d6-628944b4f965] succeeded in 3.945350629999666s: None 2024-05-26T02:52:01.019803670Z [2024-05-26 02:52:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b54c19b-d847-4d43-b3ae-da64d6c0ad57] received 2024-05-26T02:52:01.022383927Z [2024-05-26 02:52:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67a23c78-5e9b-4163-b79d-66bdb1893c35] received 2024-05-26T02:52:01.027909587Z [2024-05-26 02:52:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5eb3c938-e35f-4cd2-9a5b-6eb397fc9040] received 2024-05-26T02:52:01.035894244Z [2024-05-26 02:52:01,035: INFO/ForkPoolWorker-16] [67a23c78-5e9b-4163-b79d-66bdb1893c35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:52:01.037750313Z [2024-05-26 02:52:01,037: INFO/ForkPoolWorker-1] [5eb3c938-e35f-4cd2-9a5b-6eb397fc9040] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:52:01.038846752Z [2024-05-26 02:52:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa63245d-552c-457c-890c-8204ae3be704] received 2024-05-26T02:52:01.056799370Z [2024-05-26 02:52:01,056: INFO/ForkPoolWorker-2] [fa63245d-552c-457c-890c-8204ae3be704] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:52:01.058001208Z [2024-05-26 02:52:01,057: INFO/ForkPoolWorker-15] [4b54c19b-d847-4d43-b3ae-da64d6c0ad57] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:52:01.510874676Z [2024-05-26 02:52:01,507: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:52:01.547783654Z [2024-05-26 02:52:01,538: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:52:01.564543021Z [2024-05-26 02:52:01,557: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:52:01.770589300Z [2024-05-26 02:52:01,766: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:52:01.780625030Z [2024-05-26 02:52:01,780: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:52:01.789724996Z [2024-05-26 02:52:01,789: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:52:01.876962899Z [2024-05-26 02:52:01,876: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:52:01.883745199Z [2024-05-26 02:52:01,883: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:52:01.891907942Z [2024-05-26 02:52:01,883: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:52:01.892025101Z [2024-05-26 02:52:01,891: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:52:01.892357341Z [2024-05-26 02:52:01,892: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:52:01.916686358Z [2024-05-26 02:52:01,916: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:52:02.050672228Z [2024-05-26 02:52:02,050: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:52:02.853995088Z [2024-05-26 02:52:02,853: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b54c19b-d847-4d43-b3ae-da64d6c0ad57] succeeded in 1.8300125639998441s: None 2024-05-26T02:52:02.906309342Z [2024-05-26 02:52:02,905: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fa63245d-552c-457c-890c-8204ae3be704] succeeded in 1.863963337000314s: None 2024-05-26T02:52:03.691134815Z [2024-05-26 02:52:03,690: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:52:03.694646915Z [2024-05-26 02:52:03,694: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:52:03.752531996Z [2024-05-26 02:52:03,752: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:52:03.756294938Z [2024-05-26 02:52:03,756: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:52:03.756526214Z [2024-05-26 02:52:03,756: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:52:03.756743857Z [2024-05-26 02:52:03,756: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:52:03.756905096Z [2024-05-26 02:52:03,756: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:52:03.757292103Z [2024-05-26 02:52:03,757: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:52:03.757486413Z [2024-05-26 02:52:03,757: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:52:03.916367261Z [2024-05-26 02:52:03,916: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:52:03.943473374Z [2024-05-26 02:52:03,943: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:52:03.957070826Z [2024-05-26 02:52:03,956: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:52:04.028490800Z [2024-05-26 02:52:04,028: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:52:04.036355801Z [2024-05-26 02:52:04,036: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:52:04.036633560Z [2024-05-26 02:52:04,036: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:52:04.036797707Z [2024-05-26 02:52:04,036: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:52:04.036893726Z [2024-05-26 02:52:04,036: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:52:04.037228506Z [2024-05-26 02:52:04,037: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:52:04.037325580Z [2024-05-26 02:52:04,037: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:52:04.228767964Z [2024-05-26 02:52:04,228: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:52:05.996546591Z [2024-05-26 02:52:05,996: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67a23c78-5e9b-4163-b79d-66bdb1893c35] succeeded in 4.972002495998822s: None 2024-05-26T02:52:06.988589059Z [2024-05-26 02:52:06,988: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5eb3c938-e35f-4cd2-9a5b-6eb397fc9040] succeeded in 5.958921706998808s: None 2024-05-26T02:53:00.966818114Z [2024-05-26 02:53:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[106d0015-ea2c-4635-ace5-57141953478e] received 2024-05-26T02:53:00.972097950Z [2024-05-26 02:53:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d382e4f2-af96-422a-9039-5d2e2b1c84aa] received 2024-05-26T02:53:00.978882549Z [2024-05-26 02:53:00,978: INFO/ForkPoolWorker-15] [106d0015-ea2c-4635-ace5-57141953478e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:53:00.980549685Z [2024-05-26 02:53:00,980: INFO/ForkPoolWorker-16] [d382e4f2-af96-422a-9039-5d2e2b1c84aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:53:00.980934686Z [2024-05-26 02:53:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fbf451d-9b0a-4129-b4d5-7f96aea9f76d] received 2024-05-26T02:53:00.988806965Z [2024-05-26 02:53:00,988: INFO/ForkPoolWorker-1] [8fbf451d-9b0a-4129-b4d5-7f96aea9f76d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:53:01.261115638Z [2024-05-26 02:53:01,257: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:53:01.302016286Z [2024-05-26 02:53:01,298: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:53:01.326728624Z [2024-05-26 02:53:01,323: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:53:01.491285447Z [2024-05-26 02:53:01,490: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-26T02:53:01.495073895Z [2024-05-26 02:53:01,494: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:53:01.519613091Z [2024-05-26 02:53:01,519: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:53:01.520774623Z [2024-05-26 02:53:01,520: INFO/ForkPoolWorker-16] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:53:01.520938938Z [2024-05-26 02:53:01,520: INFO/ForkPoolWorker-16] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:53:01.521048499Z [2024-05-26 02:53:01,520: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-26T02:53:01.521653208Z [2024-05-26 02:53:01,521: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:53:01.640221048Z [2024-05-26 02:53:01,639: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:53:02.221508628Z [2024-05-26 02:53:02,220: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d382e4f2-af96-422a-9039-5d2e2b1c84aa] succeeded in 1.2476764780003577s: None 2024-05-26T02:53:02.391631508Z [2024-05-26 02:53:02,391: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:53:02.394858331Z [2024-05-26 02:53:02,394: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:53:02.422787225Z [2024-05-26 02:53:02,422: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:53:02.425021177Z [2024-05-26 02:53:02,424: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:53:02.425061998Z [2024-05-26 02:53:02,424: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:53:02.425289893Z [2024-05-26 02:53:02,425: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:53:02.425357843Z [2024-05-26 02:53:02,425: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:53:02.425669868Z [2024-05-26 02:53:02,425: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:53:02.425743027Z [2024-05-26 02:53:02,425: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:53:02.503612365Z [2024-05-26 02:53:02,503: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:53:02.553718672Z [2024-05-26 02:53:02,553: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:53:02.556890766Z [2024-05-26 02:53:02,556: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:53:02.579269577Z [2024-05-26 02:53:02,579: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:53:02.583669009Z [2024-05-26 02:53:02,583: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:53:02.583708761Z [2024-05-26 02:53:02,583: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:53:02.584028107Z [2024-05-26 02:53:02,583: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:53:02.584134833Z [2024-05-26 02:53:02,583: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:53:02.584586850Z [2024-05-26 02:53:02,584: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:53:02.584596877Z [2024-05-26 02:53:02,584: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:53:02.659697103Z [2024-05-26 02:53:02,659: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:53:04.736474756Z [2024-05-26 02:53:04,736: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8fbf451d-9b0a-4129-b4d5-7f96aea9f76d] succeeded in 3.7537996510000085s: None 2024-05-26T02:53:04.784735476Z [2024-05-26 02:53:04,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[106d0015-ea2c-4635-ace5-57141953478e] succeeded in 3.815912361998926s: None 2024-05-26T02:54:00.972138434Z [2024-05-26 02:54:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c925577f-f263-42ba-9eae-f24b633e5283] received 2024-05-26T02:54:00.974639332Z [2024-05-26 02:54:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25ff6a3b-796f-4239-a98b-9f1068ce3a24] received 2024-05-26T02:54:00.982773669Z [2024-05-26 02:54:00,982: INFO/ForkPoolWorker-15] [c925577f-f263-42ba-9eae-f24b633e5283] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:54:00.986493844Z [2024-05-26 02:54:00,986: INFO/ForkPoolWorker-16] [25ff6a3b-796f-4239-a98b-9f1068ce3a24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:54:00.992207973Z [2024-05-26 02:54:00,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[337cf216-880c-4cf5-b355-b07f3f9fda5e] received 2024-05-26T02:54:00.995107406Z [2024-05-26 02:54:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c62d32f9-2f0d-4f17-bc59-03c8a6e5bf13] received 2024-05-26T02:54:01.014153122Z [2024-05-26 02:54:01,013: INFO/ForkPoolWorker-2] [c62d32f9-2f0d-4f17-bc59-03c8a6e5bf13] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:54:01.020552028Z [2024-05-26 02:54:01,020: INFO/ForkPoolWorker-1] [337cf216-880c-4cf5-b355-b07f3f9fda5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:54:01.358396063Z [2024-05-26 02:54:01,354: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:54:01.394977256Z [2024-05-26 02:54:01,390: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:54:01.404945881Z [2024-05-26 02:54:01,401: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:54:01.571357386Z [2024-05-26 02:54:01,570: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:54:01.575616458Z [2024-05-26 02:54:01,575: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:54:01.579233676Z [2024-05-26 02:54:01,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:54:01.631395555Z [2024-05-26 02:54:01,631: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:54:01.641667633Z [2024-05-26 02:54:01,641: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:54:01.642449223Z [2024-05-26 02:54:01,642: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:54:01.642534634Z [2024-05-26 02:54:01,642: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:54:01.643657959Z [2024-05-26 02:54:01,642: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:54:01.773253223Z [2024-05-26 02:54:01,772: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:54:01.853124339Z [2024-05-26 02:54:01,852: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:54:02.341824282Z [2024-05-26 02:54:02,341: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c62d32f9-2f0d-4f17-bc59-03c8a6e5bf13] succeeded in 1.3445772329996544s: None 2024-05-26T02:54:02.501862285Z [2024-05-26 02:54:02,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c925577f-f263-42ba-9eae-f24b633e5283] succeeded in 1.527337597000951s: None 2024-05-26T02:54:02.681682455Z [2024-05-26 02:54:02,681: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:54:02.685017206Z [2024-05-26 02:54:02,684: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:54:02.714342662Z [2024-05-26 02:54:02,714: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:54:02.716982215Z [2024-05-26 02:54:02,716: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:54:02.717135799Z [2024-05-26 02:54:02,716: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:54:02.717301824Z [2024-05-26 02:54:02,717: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:54:02.717376299Z [2024-05-26 02:54:02,717: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:54:02.717722902Z [2024-05-26 02:54:02,717: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:54:02.718341181Z [2024-05-26 02:54:02,718: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:54:02.798903566Z [2024-05-26 02:54:02,798: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:54:02.850170817Z [2024-05-26 02:54:02,849: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:54:02.853533915Z [2024-05-26 02:54:02,853: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:54:02.874068570Z [2024-05-26 02:54:02,873: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:54:02.875765831Z [2024-05-26 02:54:02,875: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:54:02.875816043Z [2024-05-26 02:54:02,875: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:54:02.875976018Z [2024-05-26 02:54:02,875: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:54:02.876037251Z [2024-05-26 02:54:02,875: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:54:02.876535642Z [2024-05-26 02:54:02,876: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:54:02.876588354Z [2024-05-26 02:54:02,876: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:54:02.972861519Z [2024-05-26 02:54:02,972: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:54:04.856094045Z [2024-05-26 02:54:04,855: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[337cf216-880c-4cf5-b355-b07f3f9fda5e] succeeded in 3.8615192149991344s: None 2024-05-26T02:54:05.237309836Z [2024-05-26 02:54:05,236: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[25ff6a3b-796f-4239-a98b-9f1068ce3a24] succeeded in 4.259057395998752s: None 2024-05-26T02:55:00.685863390Z [2024-05-26 02:55:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd750cd6-5dac-4a71-bfce-4ec6dd61ff46] received 2024-05-26T02:55:00.690720223Z [2024-05-26 02:55:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc039aaa-b4dd-4a8b-952c-e8a2f59a8893] received 2024-05-26T02:55:00.695837400Z [2024-05-26 02:55:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7079b3e9-18b9-4e3c-b4ca-303571d2dab0] received 2024-05-26T02:55:00.696903342Z [2024-05-26 02:55:00,696: INFO/ForkPoolWorker-15] [fd750cd6-5dac-4a71-bfce-4ec6dd61ff46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:55:00.709318589Z [2024-05-26 02:55:00,708: INFO/ForkPoolWorker-16] [dc039aaa-b4dd-4a8b-952c-e8a2f59a8893] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:55:00.712172352Z [2024-05-26 02:55:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d2f72ec-0617-4c97-a96f-8afe41b78214] received 2024-05-26T02:55:00.713074228Z [2024-05-26 02:55:00,712: INFO/ForkPoolWorker-1] [7079b3e9-18b9-4e3c-b4ca-303571d2dab0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:55:00.731290357Z [2024-05-26 02:55:00,731: INFO/ForkPoolWorker-2] [2d2f72ec-0617-4c97-a96f-8afe41b78214] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:55:01.064619514Z [2024-05-26 02:55:01,061: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:55:01.078520053Z [2024-05-26 02:55:01,075: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:55:01.110605849Z [2024-05-26 02:55:01,106: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:55:01.156385378Z [2024-05-26 02:55:01,153: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:55:01.230598641Z [2024-05-26 02:55:01,230: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:55:01.234486588Z [2024-05-26 02:55:01,234: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:55:01.256788709Z [2024-05-26 02:55:01,256: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:55:01.259959505Z [2024-05-26 02:55:01,259: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:55:01.260182703Z [2024-05-26 02:55:01,259: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:55:01.260320803Z [2024-05-26 02:55:01,260: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:55:01.260651884Z [2024-05-26 02:55:01,260: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:55:01.406173060Z [2024-05-26 02:55:01,405: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:55:02.044328061Z [2024-05-26 02:55:02,043: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2d2f72ec-0617-4c97-a96f-8afe41b78214] succeeded in 1.329842451001241s: None 2024-05-26T02:55:02.355993790Z [2024-05-26 02:55:02,355: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:55:02.359569549Z [2024-05-26 02:55:02,359: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:55:02.408153543Z [2024-05-26 02:55:02,407: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:55:02.409401013Z [2024-05-26 02:55:02,409: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:55:02.409580909Z [2024-05-26 02:55:02,409: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:55:02.409779510Z [2024-05-26 02:55:02,409: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:55:02.409917742Z [2024-05-26 02:55:02,409: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:55:02.410272177Z [2024-05-26 02:55:02,410: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:55:02.410418934Z [2024-05-26 02:55:02,410: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:55:02.479846415Z [2024-05-26 02:55:02,479: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:55:02.483175932Z [2024-05-26 02:55:02,482: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:55:02.504942753Z [2024-05-26 02:55:02,504: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:55:02.506316455Z [2024-05-26 02:55:02,506: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:55:02.506331110Z [2024-05-26 02:55:02,506: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:55:02.506451535Z [2024-05-26 02:55:02,506: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:55:02.506495700Z [2024-05-26 02:55:02,506: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:55:02.506730742Z [2024-05-26 02:55:02,506: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:55:02.506778403Z [2024-05-26 02:55:02,506: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:55:02.509470025Z [2024-05-26 02:55:02,509: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:55:02.614609431Z [2024-05-26 02:55:02,614: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:55:02.615295338Z [2024-05-26 02:55:02,614: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:55:02.618537708Z [2024-05-26 02:55:02,618: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:55:02.645371941Z [2024-05-26 02:55:02,645: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:55:02.648536681Z [2024-05-26 02:55:02,648: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:55:02.650269050Z [2024-05-26 02:55:02,648: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:55:02.650425921Z [2024-05-26 02:55:02,650: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:55:02.650482577Z [2024-05-26 02:55:02,650: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:55:02.650736504Z [2024-05-26 02:55:02,650: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:55:02.650816306Z [2024-05-26 02:55:02,650: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:55:02.746244406Z [2024-05-26 02:55:02,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:55:03.468373924Z [2024-05-26 02:55:03,468: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd750cd6-5dac-4a71-bfce-4ec6dd61ff46] succeeded in 2.778505406000477s: None 2024-05-26T02:55:04.037139743Z [2024-05-26 02:55:04,036: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7079b3e9-18b9-4e3c-b4ca-303571d2dab0] succeeded in 3.3373981549993914s: None 2024-05-26T02:55:04.242955015Z [2024-05-26 02:55:04,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0dacef3-6e8b-41d6-a182-553e16811081] received 2024-05-26T02:55:04.255135340Z [2024-05-26 02:55:04,254: INFO/ForkPoolWorker-15] [c0dacef3-6e8b-41d6-a182-553e16811081] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:55:04.560561740Z [2024-05-26 02:55:04,560: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dc039aaa-b4dd-4a8b-952c-e8a2f59a8893] succeeded in 3.866494748999685s: None 2024-05-26T02:55:04.671206706Z [2024-05-26 02:55:04,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:55:05.931184751Z [2024-05-26 02:55:05,930: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:55:05.938717387Z [2024-05-26 02:55:05,937: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:55:05.962565099Z [2024-05-26 02:55:05,962: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:55:05.963781607Z [2024-05-26 02:55:05,963: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:55:05.963812948Z [2024-05-26 02:55:05,963: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:55:05.964013420Z [2024-05-26 02:55:05,963: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:55:05.964474627Z [2024-05-26 02:55:05,964: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:55:05.964484755Z [2024-05-26 02:55:05,964: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:55:05.964491752Z [2024-05-26 02:55:05,964: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:55:06.086410187Z [2024-05-26 02:55:06,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:55:06.793414266Z [2024-05-26 02:55:06,792: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0dacef3-6e8b-41d6-a182-553e16811081] succeeded in 2.5488614660007443s: None 2024-05-26T02:55:07.361371439Z [2024-05-26 02:55:07,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78fc71c5-c3a9-4c62-a5ca-775085c0095e] received 2024-05-26T02:55:07.369294385Z [2024-05-26 02:55:07,368: INFO/ForkPoolWorker-15] [78fc71c5-c3a9-4c62-a5ca-775085c0095e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:55:07.645471166Z [2024-05-26 02:55:07,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:55:08.720789916Z [2024-05-26 02:55:08,720: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:55:08.723842348Z [2024-05-26 02:55:08,723: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:55:08.750139312Z [2024-05-26 02:55:08,749: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:55:08.751682742Z [2024-05-26 02:55:08,751: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:55:08.751834315Z [2024-05-26 02:55:08,751: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:55:08.752095943Z [2024-05-26 02:55:08,751: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:55:08.752235274Z [2024-05-26 02:55:08,752: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:55:08.752574670Z [2024-05-26 02:55:08,752: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:55:08.752748935Z [2024-05-26 02:55:08,752: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:55:08.859157966Z [2024-05-26 02:55:08,856: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:55:09.584019990Z [2024-05-26 02:55:09,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78fc71c5-c3a9-4c62-a5ca-775085c0095e] succeeded in 2.220728643000257s: None 2024-05-26T02:55:09.711603809Z [2024-05-26 02:55:09,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed09835c-8288-4eea-9eb0-20efa436d4c7] received 2024-05-26T02:55:09.721461604Z [2024-05-26 02:55:09,721: INFO/ForkPoolWorker-15] [ed09835c-8288-4eea-9eb0-20efa436d4c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:55:09.992536054Z [2024-05-26 02:55:09,989: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-26T02:55:11.105527108Z [2024-05-26 02:55:11,105: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:55:11.108695015Z [2024-05-26 02:55:11,108: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:55:11.137628721Z [2024-05-26 02:55:11,137: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:55:11.139410123Z [2024-05-26 02:55:11,139: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:55:11.139732735Z [2024-05-26 02:55:11,139: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:55:11.140064652Z [2024-05-26 02:55:11,139: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:55:11.140297276Z [2024-05-26 02:55:11,140: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:55:11.140763071Z [2024-05-26 02:55:11,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-26T02:55:11.141066427Z [2024-05-26 02:55:11,140: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:55:11.236284173Z [2024-05-26 02:55:11,235: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:55:11.922428311Z [2024-05-26 02:55:11,921: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed09835c-8288-4eea-9eb0-20efa436d4c7] succeeded in 2.20812336400013s: None 2024-05-26T02:56:00.599732513Z [2024-05-26 02:56:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[635a2ef7-9b45-477c-a23d-42d96c04439d] received 2024-05-26T02:56:00.602560882Z [2024-05-26 02:56:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec4135ad-f6e7-4a95-8285-c8b015fbf457] received 2024-05-26T02:56:00.605123780Z [2024-05-26 02:56:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb260e44-41e1-4275-82a6-3bd03ee70c44] received 2024-05-26T02:56:00.606861878Z [2024-05-26 02:56:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d91324d-d85d-42d7-a760-ea60c6b1c00f] received 2024-05-26T02:56:00.614211756Z [2024-05-26 02:56:00,613: INFO/ForkPoolWorker-15] [635a2ef7-9b45-477c-a23d-42d96c04439d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:56:00.618905814Z [2024-05-26 02:56:00,618: INFO/ForkPoolWorker-16] [ec4135ad-f6e7-4a95-8285-c8b015fbf457] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:56:00.620789559Z [2024-05-26 02:56:00,620: INFO/ForkPoolWorker-1] [bb260e44-41e1-4275-82a6-3bd03ee70c44] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:56:00.627914087Z [2024-05-26 02:56:00,627: INFO/ForkPoolWorker-2] [3d91324d-d85d-42d7-a760-ea60c6b1c00f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:56:00.962191817Z [2024-05-26 02:56:00,959: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:56:00.967979524Z [2024-05-26 02:56:00,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:56:00.981217383Z [2024-05-26 02:56:00,975: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:56:00.982196387Z [2024-05-26 02:56:00,974: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:56:01.140074173Z [2024-05-26 02:56:01,139: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:56:01.144234267Z [2024-05-26 02:56:01,143: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:56:01.173184264Z [2024-05-26 02:56:01,172: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:56:01.174183387Z [2024-05-26 02:56:01,173: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:56:01.174314668Z [2024-05-26 02:56:01,174: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:56:01.174362471Z [2024-05-26 02:56:01,174: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:56:01.174593237Z [2024-05-26 02:56:01,174: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:56:01.286843501Z [2024-05-26 02:56:01,286: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:56:01.297870052Z [2024-05-26 02:56:01,297: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:56:01.836119952Z [2024-05-26 02:56:01,835: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb260e44-41e1-4275-82a6-3bd03ee70c44] succeeded in 1.2272446409988333s: None 2024-05-26T02:56:01.881413498Z [2024-05-26 02:56:01,880: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec4135ad-f6e7-4a95-8285-c8b015fbf457] succeeded in 1.2766998730003252s: None 2024-05-26T02:56:02.325488774Z [2024-05-26 02:56:02,325: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:56:02.329390048Z [2024-05-26 02:56:02,328: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:56:02.366751586Z [2024-05-26 02:56:02,366: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:56:02.368341174Z [2024-05-26 02:56:02,368: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:56:02.368651985Z [2024-05-26 02:56:02,368: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:56:02.368920497Z [2024-05-26 02:56:02,368: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:56:02.369090380Z [2024-05-26 02:56:02,368: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:56:02.369455728Z [2024-05-26 02:56:02,369: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:56:02.369607129Z [2024-05-26 02:56:02,369: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:56:02.436246183Z [2024-05-26 02:56:02,435: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-26T02:56:02.439275978Z [2024-05-26 02:56:02,438: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:56:02.458845902Z [2024-05-26 02:56:02,458: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:56:02.465396723Z [2024-05-26 02:56:02,465: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:56:02.467570457Z [2024-05-26 02:56:02,467: INFO/ForkPoolWorker-2] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:56:02.467652075Z [2024-05-26 02:56:02,467: INFO/ForkPoolWorker-2] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:56:02.467880586Z [2024-05-26 02:56:02,467: INFO/ForkPoolWorker-2] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:56:02.467990139Z [2024-05-26 02:56:02,467: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-26T02:56:02.468481269Z [2024-05-26 02:56:02,468: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:56:02.468605680Z [2024-05-26 02:56:02,468: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:56:02.560778039Z [2024-05-26 02:56:02,560: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:56:03.818549449Z [2024-05-26 02:56:03,818: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[635a2ef7-9b45-477c-a23d-42d96c04439d] succeeded in 3.2162237359989376s: None 2024-05-26T02:56:04.545464265Z [2024-05-26 02:56:04,544: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d91324d-d85d-42d7-a760-ea60c6b1c00f] succeeded in 3.933270199000617s: None 2024-05-26T02:57:00.501348100Z [2024-05-26 02:57:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3836e424-fba1-470c-ae6b-f07f085b2831] received 2024-05-26T02:57:00.505680189Z [2024-05-26 02:57:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3bed4cb-bd28-4274-a6fd-234acd6c4972] received 2024-05-26T02:57:00.508927679Z [2024-05-26 02:57:00,508: INFO/ForkPoolWorker-15] [3836e424-fba1-470c-ae6b-f07f085b2831] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:57:00.513520467Z [2024-05-26 02:57:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77fe2ee9-dc33-44e7-a067-71fc62719916] received 2024-05-26T02:57:00.513983965Z [2024-05-26 02:57:00,513: INFO/ForkPoolWorker-16] [f3bed4cb-bd28-4274-a6fd-234acd6c4972] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:57:00.519420584Z [2024-05-26 02:57:00,519: INFO/ForkPoolWorker-1] [77fe2ee9-dc33-44e7-a067-71fc62719916] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:57:00.852449662Z [2024-05-26 02:57:00,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:57:00.861519236Z [2024-05-26 02:57:00,854: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:57:00.874935056Z [2024-05-26 02:57:00,872: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:57:01.021014266Z [2024-05-26 02:57:01,020: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:57:01.025041709Z [2024-05-26 02:57:01,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:57:01.052836967Z [2024-05-26 02:57:01,052: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:57:01.054375517Z [2024-05-26 02:57:01,054: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:57:01.054474087Z [2024-05-26 02:57:01,054: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:57:01.054643938Z [2024-05-26 02:57:01,054: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:57:01.055325810Z [2024-05-26 02:57:01,055: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:57:01.138023618Z [2024-05-26 02:57:01,137: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:57:01.760698743Z [2024-05-26 02:57:01,760: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77fe2ee9-dc33-44e7-a067-71fc62719916] succeeded in 1.2455943350014422s: None 2024-05-26T02:57:01.960688696Z [2024-05-26 02:57:01,960: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:57:01.963622544Z [2024-05-26 02:57:01,963: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:57:01.982411335Z [2024-05-26 02:57:01,982: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:57:01.983356801Z [2024-05-26 02:57:01,983: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:57:01.983430596Z [2024-05-26 02:57:01,983: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:57:01.983658556Z [2024-05-26 02:57:01,983: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:57:01.983708771Z [2024-05-26 02:57:01,983: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:57:01.983913379Z [2024-05-26 02:57:01,983: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:57:01.984201255Z [2024-05-26 02:57:01,984: INFO/ForkPoolWorker-16] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:57:02.015904155Z [2024-05-26 02:57:02,015: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:57:02.025365735Z [2024-05-26 02:57:02,024: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:57:02.057857801Z [2024-05-26 02:57:02,057: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:57:02.060470921Z [2024-05-26 02:57:02,060: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:57:02.060845442Z [2024-05-26 02:57:02,060: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:57:02.061341316Z [2024-05-26 02:57:02,060: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:57:02.061518751Z [2024-05-26 02:57:02,061: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:57:02.061820811Z [2024-05-26 02:57:02,061: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:57:02.062836860Z [2024-05-26 02:57:02,062: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:57:02.063192240Z [2024-05-26 02:57:02,062: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:57:02.201497636Z [2024-05-26 02:57:02,201: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:57:03.695214930Z [2024-05-26 02:57:03,694: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3bed4cb-bd28-4274-a6fd-234acd6c4972] succeeded in 3.187333572999705s: None 2024-05-26T02:57:04.160673422Z [2024-05-26 02:57:04,159: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3836e424-fba1-470c-ae6b-f07f085b2831] succeeded in 3.6571806829997513s: None 2024-05-26T02:58:00.583864844Z [2024-05-26 02:58:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca8098c2-0544-461d-a4ca-b98d960b47d4] received 2024-05-26T02:58:00.592129006Z [2024-05-26 02:58:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3ae12e5-ee52-4dd7-a9ec-20f8c16b2d4f] received 2024-05-26T02:58:00.597999626Z [2024-05-26 02:58:00,597: INFO/ForkPoolWorker-15] [ca8098c2-0544-461d-a4ca-b98d960b47d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:58:00.598354226Z [2024-05-26 02:58:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f63e430-c4a0-40bf-b490-ed84e76c87e8] received 2024-05-26T02:58:00.602291537Z [2024-05-26 02:58:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de86bdc0-a911-41f3-8aef-352cb01e0596] received 2024-05-26T02:58:00.613521088Z [2024-05-26 02:58:00,613: INFO/ForkPoolWorker-16] [b3ae12e5-ee52-4dd7-a9ec-20f8c16b2d4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:58:00.617940899Z [2024-05-26 02:58:00,617: INFO/ForkPoolWorker-1] [2f63e430-c4a0-40bf-b490-ed84e76c87e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:58:00.618596031Z [2024-05-26 02:58:00,618: INFO/ForkPoolWorker-2] [de86bdc0-a911-41f3-8aef-352cb01e0596] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:58:00.972114905Z [2024-05-26 02:58:00,968: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-26T02:58:00.990431503Z [2024-05-26 02:58:00,986: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:58:01.086419165Z [2024-05-26 02:58:01,083: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:58:01.118521125Z [2024-05-26 02:58:01,115: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:58:01.157585564Z [2024-05-26 02:58:01,157: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-26T02:58:01.161802009Z [2024-05-26 02:58:01,161: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:58:01.206270913Z [2024-05-26 02:58:01,206: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-26T02:58:01.208254228Z [2024-05-26 02:58:01,208: INFO/ForkPoolWorker-2] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:58:01.208498120Z [2024-05-26 02:58:01,208: INFO/ForkPoolWorker-2] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:58:01.208652622Z [2024-05-26 02:58:01,208: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-26T02:58:01.209330762Z [2024-05-26 02:58:01,209: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:58:01.324380821Z [2024-05-26 02:58:01,324: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:58:01.370661868Z [2024-05-26 02:58:01,370: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:58:01.932836945Z [2024-05-26 02:58:01,932: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca8098c2-0544-461d-a4ca-b98d960b47d4] succeeded in 1.343804955999076s: None 2024-05-26T02:58:02.152882942Z [2024-05-26 02:58:02,152: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[de86bdc0-a911-41f3-8aef-352cb01e0596] succeeded in 1.547915720000674s: None 2024-05-26T02:58:02.422679854Z [2024-05-26 02:58:02,422: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:58:02.425696697Z [2024-05-26 02:58:02,425: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:58:02.444599271Z [2024-05-26 02:58:02,444: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:58:02.445812316Z [2024-05-26 02:58:02,445: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:58:02.445823559Z [2024-05-26 02:58:02,445: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:58:02.445938586Z [2024-05-26 02:58:02,445: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:58:02.446020454Z [2024-05-26 02:58:02,445: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:58:02.446232232Z [2024-05-26 02:58:02,446: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:58:02.446255305Z [2024-05-26 02:58:02,446: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:58:02.515642820Z [2024-05-26 02:58:02,515: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-26T02:58:02.518951107Z [2024-05-26 02:58:02,518: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:58:02.545370182Z [2024-05-26 02:58:02,545: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:58:02.546988752Z [2024-05-26 02:58:02,546: INFO/ForkPoolWorker-1] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:58:02.547126610Z [2024-05-26 02:58:02,546: INFO/ForkPoolWorker-1] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:58:02.547341647Z [2024-05-26 02:58:02,547: INFO/ForkPoolWorker-1] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:58:02.547453371Z [2024-05-26 02:58:02,547: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-26T02:58:02.547849084Z [2024-05-26 02:58:02,547: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:58:02.547960105Z [2024-05-26 02:58:02,547: INFO/ForkPoolWorker-1] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:58:02.553132813Z [2024-05-26 02:58:02,552: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:58:02.628426976Z [2024-05-26 02:58:02,628: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:58:04.420090735Z [2024-05-26 02:58:04,419: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3ae12e5-ee52-4dd7-a9ec-20f8c16b2d4f] succeeded in 3.8246004630000243s: None 2024-05-26T02:58:04.421005752Z [2024-05-26 02:58:04,420: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f63e430-c4a0-40bf-b490-ed84e76c87e8] succeeded in 3.8194720949995826s: None 2024-05-26T02:59:01.173132094Z [2024-05-26 02:59:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[114cc7fc-0d84-4732-ad3f-3dec04c12e39] received 2024-05-26T02:59:01.175608832Z [2024-05-26 02:59:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbf79389-0867-464a-8f94-d6479cfbfaf7] received 2024-05-26T02:59:01.189555020Z [2024-05-26 02:59:01,188: INFO/ForkPoolWorker-16] [dbf79389-0867-464a-8f94-d6479cfbfaf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:59:01.232368774Z [2024-05-26 02:59:01,231: INFO/ForkPoolWorker-15] [114cc7fc-0d84-4732-ad3f-3dec04c12e39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:59:01.258381825Z [2024-05-26 02:59:01,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47b8ee76-9b66-4625-bebc-a04b928e67b5] received 2024-05-26T02:59:01.272522881Z [2024-05-26 02:59:01,272: INFO/ForkPoolWorker-1] [47b8ee76-9b66-4625-bebc-a04b928e67b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:59:01.637949386Z [2024-05-26 02:59:01,634: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-26T02:59:01.649866781Z [2024-05-26 02:59:01,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-26T02:59:01.680298517Z [2024-05-26 02:59:01,676: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-26T02:59:01.974120474Z [2024-05-26 02:59:01,973: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-26T02:59:01.978584346Z [2024-05-26 02:59:01,978: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:59:02.028170715Z [2024-05-26 02:59:02,027: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-26T02:59:02.029716400Z [2024-05-26 02:59:02,029: INFO/ForkPoolWorker-1] Read SDNC 568de5b1-b2fc-405e-8cde-21b557a0f2fb (sdnc-osm) 2024-05-26T02:59:02.029902249Z [2024-05-26 02:59:02,029: INFO/ForkPoolWorker-1] [{'_id': '568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-26T02:59:02.030031204Z [2024-05-26 02:59:02,029: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-26T02:59:02.030314918Z [2024-05-26 02:59:02,030: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb 2024-05-26T02:59:02.151316101Z [2024-05-26 02:59:02,151: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:59:03.219750127Z [2024-05-26 02:59:03,218: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[47b8ee76-9b66-4625-bebc-a04b928e67b5] succeeded in 1.957545081000717s: None 2024-05-26T02:59:03.769830580Z [2024-05-26 02:59:03,769: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-26T02:59:03.773634454Z [2024-05-26 02:59:03,773: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:59:03.844565244Z [2024-05-26 02:59:03,844: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-26T02:59:03.856995098Z [2024-05-26 02:59:03,856: INFO/ForkPoolWorker-16] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:59:03.857168452Z [2024-05-26 02:59:03,857: INFO/ForkPoolWorker-16] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:59:03.857338668Z [2024-05-26 02:59:03,857: INFO/ForkPoolWorker-16] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:59:03.860062276Z [2024-05-26 02:59:03,859: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-26T02:59:03.872120805Z [2024-05-26 02:59:03,871: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-26T02:59:03.872143258Z [2024-05-26 02:59:03,872: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:59:03.965779568Z [2024-05-26 02:59:03,965: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-26T02:59:04.091491782Z [2024-05-26 02:59:04,091: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-26T02:59:04.094818878Z [2024-05-26 02:59:04,094: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Z8w1jLtfRndDaLdQ2qoqgGxuse3VG9D6'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-26T02:59:04.161538234Z [2024-05-26 02:59:04,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-26T02:59:04.165894995Z [2024-05-26 02:59:04,165: INFO/ForkPoolWorker-15] Read VIM 69f6697b-8891-4d47-9be2-258e9da3332a (_system-osm-vim) 2024-05-26T02:59:04.165949018Z [2024-05-26 02:59:04,165: INFO/ForkPoolWorker-15] Read VIM 9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 (osm) 2024-05-26T02:59:04.166091701Z [2024-05-26 02:59:04,165: INFO/ForkPoolWorker-15] [{'_id': '69f6697b-8891-4d47-9be2-258e9da3332a', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-26T02:59:04.166153891Z [2024-05-26 02:59:04,166: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-26T02:59:04.166414573Z [2024-05-26 02:59:04,166: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-26T02:59:04.166486882Z [2024-05-26 02:59:04,166: INFO/ForkPoolWorker-15] Creating DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 2024-05-26T02:59:04.444066117Z [2024-05-26 02:59:04,441: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local