2024-04-06T01:29:23.368626495Z . 2024-04-06T01:29:25.200502373Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-06T01:29:27.197240356Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-06T01:29:35.761926873Z [2024-04-06T01:29:35.752+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-06T01:29:54.869281510Z 2024-04-06T01:29:55.958463761Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-06T01:29:59.263754720Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-06T01:30:07.226773366Z [2024-04-06 01:30:07 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-04-06T01:30:07.237778546Z [2024-04-06 01:30:07 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-04-06T01:30:07.237793763Z [2024-04-06 01:30:07 +0000] [16] [INFO] Using worker: sync 2024-04-06T01:30:07.258386840Z [2024-04-06 01:30:07 +0000] [17] [INFO] Booting worker with pid: 17 2024-04-06T01:30:07.275667553Z [2024-04-06 01:30:07 +0000] [18] [INFO] Booting worker with pid: 18 2024-04-06T01:30:13.482109480Z 2024-04-06T01:30:13.482133499Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-04-06T01:30:13.482138380Z --- ***** ----- 2024-04-06T01:30:13.482142266Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-04-06 01:30:13 2024-04-06T01:30:13.482152154Z - *** --- * --- 2024-04-06T01:30:13.482156076Z - ** ---------- [config] 2024-04-06T01:30:13.482160134Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f39112e0220 2024-04-06T01:30:13.482163236Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-04-06T01:30:13.482166506Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-04-06T01:30:13.482172079Z - *** --- * --- .> concurrency: 16 (prefork) 2024-04-06T01:30:13.482175935Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-04-06T01:30:13.482179370Z --- ***** ----- 2024-04-06T01:30:13.482182483Z -------------- [queues] 2024-04-06T01:30:13.482185622Z .> default exchange=default(direct) key=default 2024-04-06T01:30:13.482188849Z 2024-04-06T01:30:13.482191837Z 2024-04-06T01:30:13.482195051Z [tasks] 2024-04-06T01:30:13.482198196Z . airflow.executors.celery_executor.execute_command 2024-04-06T01:30:13.482201142Z 2024-04-06T01:30:30.821116916Z [2024-04-06 01:30:30,813: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-04-06T01:30:30.839243130Z [2024-04-06 01:30:30,838: INFO/MainProcess] mingle: searching for neighbors 2024-04-06T01:30:31.919558776Z [2024-04-06 01:30:31,919: INFO/MainProcess] mingle: all alone 2024-04-06T01:30:32.029833753Z [2024-04-06 01:30:32,029: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-04-06T01:30:34.835948049Z [2024-04-06 01:30:34,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30046c95-c944-47d6-ae4d-25e69963147a] received 2024-04-06T01:30:34.948210202Z [2024-04-06 01:30:34,947: INFO/ForkPoolWorker-15] [30046c95-c944-47d6-ae4d-25e69963147a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:30:35.998085839Z [2024-04-06 01:30:35,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:30:37.524619591Z [2024-04-06 01:30:37,524: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:39.557940054Z [2024-04-06 01:30:39,557: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[30046c95-c944-47d6-ae4d-25e69963147a] succeeded in 4.711474683000006s: None 2024-04-06T01:30:49.679755593Z [2024-04-06 01:30:49,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b89b69ba-0b97-49e8-b8fd-092a66fbb613] received 2024-04-06T01:30:49.718014961Z [2024-04-06 01:30:49,717: INFO/ForkPoolWorker-15] [b89b69ba-0b97-49e8-b8fd-092a66fbb613] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:30:50.199640177Z [2024-04-06 01:30:50,194: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:30:50.622147047Z [2024-04-06 01:30:50,621: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:51.537242112Z [2024-04-06 01:30:51,532: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b89b69ba-0b97-49e8-b8fd-092a66fbb613] succeeded in 1.8535049229999458s: None 2024-04-06T01:32:00.299881251Z [2024-04-06 01:32:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62a2d69e-3d12-4fdb-ac4c-781e90d3f7ef] received 2024-04-06T01:32:00.350039200Z [2024-04-06 01:32:00,349: INFO/ForkPoolWorker-15] [62a2d69e-3d12-4fdb-ac4c-781e90d3f7ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:32:00.796429427Z [2024-04-06 01:32:00,785: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:32:01.289418194Z [2024-04-06 01:32:01,289: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:32:02.599633368Z [2024-04-06 01:32:02,599: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62a2d69e-3d12-4fdb-ac4c-781e90d3f7ef] succeeded in 2.288072454999906s: None 2024-04-06T01:34:00.907847878Z [2024-04-06 01:34:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[456f0d77-5581-47a3-8674-e0806edc82ca] received 2024-04-06T01:34:00.934304925Z [2024-04-06 01:34:00,933: INFO/ForkPoolWorker-15] [456f0d77-5581-47a3-8674-e0806edc82ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:34:01.384040971Z [2024-04-06 01:34:01,379: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:34:01.888161010Z [2024-04-06 01:34:01,887: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:34:02.704396719Z [2024-04-06 01:34:02,703: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[456f0d77-5581-47a3-8674-e0806edc82ca] succeeded in 1.789549954999984s: None 2024-04-06T01:36:00.581829897Z [2024-04-06 01:36:00,575: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69960e87-382c-412b-99eb-94588c791852] received 2024-04-06T01:36:00.604934050Z [2024-04-06 01:36:00,604: INFO/ForkPoolWorker-15] [69960e87-382c-412b-99eb-94588c791852] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:36:01.163246672Z [2024-04-06 01:36:01,158: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:36:01.580664140Z [2024-04-06 01:36:01,580: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:36:02.434920092Z [2024-04-06 01:36:02,434: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[69960e87-382c-412b-99eb-94588c791852] succeeded in 1.8481928300000163s: None 2024-04-06T01:37:28.449716375Z [2024-04-06 01:37:28,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9ae8f08-5dce-46d6-9386-dc46c03b7b31] received 2024-04-06T01:37:28.485914195Z [2024-04-06 01:37:28,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ef506ab-bc5c-4286-8ee2-3f3eaa4bf412] received 2024-04-06T01:37:28.513906235Z [2024-04-06 01:37:28,513: INFO/ForkPoolWorker-15] [c9ae8f08-5dce-46d6-9386-dc46c03b7b31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:37:28.568694024Z [2024-04-06 01:37:28,568: INFO/ForkPoolWorker-16] [4ef506ab-bc5c-4286-8ee2-3f3eaa4bf412] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:37:29.010851525Z [2024-04-06 01:37:29,006: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:37:29.043048348Z [2024-04-06 01:37:29,037: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:37:30.724597294Z [2024-04-06 01:37:30,724: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:37:30.728713934Z [2024-04-06 01:37:30,728: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:30.764604554Z [2024-04-06 01:37:30,764: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:37:30.768503738Z [2024-04-06 01:37:30,767: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:30.768680294Z [2024-04-06 01:37:30,768: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:30.768817318Z [2024-04-06 01:37:30,768: INFO/ForkPoolWorker-15] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:30.770500975Z [2024-04-06 01:37:30,770: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:30.771107201Z [2024-04-06 01:37:30,770: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:37:30.771797257Z [2024-04-06 01:37:30,771: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:37:30.771908858Z [2024-04-06 01:37:30,771: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:30.786402741Z [2024-04-06 01:37:30,786: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:30.797131271Z [2024-04-06 01:37:30,796: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:37:30.801688675Z [2024-04-06 01:37:30,801: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:30.858549894Z [2024-04-06 01:37:30,858: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:37:30.859706116Z [2024-04-06 01:37:30,859: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:30.859807761Z [2024-04-06 01:37:30,859: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:30.859930860Z [2024-04-06 01:37:30,859: INFO/ForkPoolWorker-16] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:30.860145417Z [2024-04-06 01:37:30,859: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:30.860320034Z [2024-04-06 01:37:30,860: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:37:30.860823639Z [2024-04-06 01:37:30,860: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:37:30.861649756Z [2024-04-06 01:37:30,860: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:30.863789006Z [2024-04-06 01:37:30,863: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:30.867301217Z [2024-04-06 01:37:30,867: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:30.961870526Z [2024-04-06 01:37:30,961: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:31.346523197Z [2024-04-06 01:37:31,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c343942-784f-44d0-86c7-b5ad0610f0e3] received 2024-04-06T01:37:31.347653170Z [2024-04-06 01:37:31,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b7e7548-25bb-4282-be15-3de01878f19d] received 2024-04-06T01:37:31.414936532Z [2024-04-06 01:37:31,414: INFO/ForkPoolWorker-1] [0c343942-784f-44d0-86c7-b5ad0610f0e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:37:31.458700984Z [2024-04-06 01:37:31,457: INFO/ForkPoolWorker-2] [5b7e7548-25bb-4282-be15-3de01878f19d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:37:32.122645022Z [2024-04-06 01:37:32,117: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:37:32.229041107Z [2024-04-06 01:37:32,223: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:37:33.704263126Z [2024-04-06 01:37:33,703: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9ae8f08-5dce-46d6-9386-dc46c03b7b31] succeeded in 5.253251570999964s: None 2024-04-06T01:37:33.712438661Z [2024-04-06 01:37:33,712: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ef506ab-bc5c-4286-8ee2-3f3eaa4bf412] succeeded in 5.2271901509998315s: None 2024-04-06T01:37:33.933205018Z [2024-04-06 01:37:33,932: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:37:33.937305758Z [2024-04-06 01:37:33,936: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:33.998557011Z [2024-04-06 01:37:33,998: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:37:34.006125855Z [2024-04-06 01:37:34,005: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:34.008014501Z [2024-04-06 01:37:34,007: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:34.008102038Z [2024-04-06 01:37:34,007: INFO/ForkPoolWorker-2] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:34.010544075Z [2024-04-06 01:37:34,008: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:34.010717534Z [2024-04-06 01:37:34,010: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:37:34.011091901Z [2024-04-06 01:37:34,010: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:37:34.011630489Z [2024-04-06 01:37:34,011: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:34.018093978Z [2024-04-06 01:37:34,017: INFO/ForkPoolWorker-2] Creating DAG vim_status_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:34.087513696Z [2024-04-06 01:37:34,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4050bd9-faca-47bb-9168-063c3122560a] received 2024-04-06T01:37:34.100674974Z [2024-04-06 01:37:34,100: INFO/ForkPoolWorker-15] [a4050bd9-faca-47bb-9168-063c3122560a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:34.111091468Z [2024-04-06 01:37:34,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93283ae1-2bb2-42a5-8cb9-e10dbd8898ac] received 2024-04-06T01:37:34.127542023Z [2024-04-06 01:37:34,127: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:34.142542130Z [2024-04-06 01:37:34,142: INFO/ForkPoolWorker-16] [93283ae1-2bb2-42a5-8cb9-e10dbd8898ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:34.366665372Z [2024-04-06 01:37:34,366: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:37:34.371397629Z [2024-04-06 01:37:34,371: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:34.496190823Z [2024-04-06 01:37:34,495: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:37:34.501307394Z [2024-04-06 01:37:34,501: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:34.501497376Z [2024-04-06 01:37:34,501: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:34.501658394Z [2024-04-06 01:37:34,501: INFO/ForkPoolWorker-1] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:34.501922819Z [2024-04-06 01:37:34,501: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:34.502092179Z [2024-04-06 01:37:34,501: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:37:34.502398506Z [2024-04-06 01:37:34,502: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:37:34.502645222Z [2024-04-06 01:37:34,502: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:34.508017952Z [2024-04-06 01:37:34,507: INFO/ForkPoolWorker-1] Creating DAG vim_status_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:34.653489526Z [2024-04-06 01:37:34,650: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:37:34.701375417Z [2024-04-06 01:37:34,701: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:34.712386864Z [2024-04-06 01:37:34,709: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:37:36.124331263Z [2024-04-06 01:37:36,123: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5b7e7548-25bb-4282-be15-3de01878f19d] succeeded in 4.773057592999976s: None 2024-04-06T01:37:36.581458755Z [2024-04-06 01:37:36,581: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c343942-784f-44d0-86c7-b5ad0610f0e3] succeeded in 5.231035119000126s: None 2024-04-06T01:37:36.675562204Z [2024-04-06 01:37:36,675: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:37:36.679477043Z [2024-04-06 01:37:36,679: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:36.728419139Z [2024-04-06 01:37:36,728: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:37:36.735014143Z [2024-04-06 01:37:36,734: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:36.742625699Z [2024-04-06 01:37:36,742: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:37:36.749349159Z [2024-04-06 01:37:36,749: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:36.749374598Z [2024-04-06 01:37:36,749: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:36.749420153Z [2024-04-06 01:37:36,749: INFO/ForkPoolWorker-16] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:36.749569394Z [2024-04-06 01:37:36,749: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:36.749594434Z [2024-04-06 01:37:36,749: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:37:36.750312992Z [2024-04-06 01:37:36,749: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:37:36.750347437Z [2024-04-06 01:37:36,750: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:36.770905838Z [2024-04-06 01:37:36,770: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:37:36.770924450Z [2024-04-06 01:37:36,770: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:36.772573884Z [2024-04-06 01:37:36,772: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:36.772585791Z [2024-04-06 01:37:36,772: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:36.772660055Z [2024-04-06 01:37:36,772: INFO/ForkPoolWorker-15] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:36.772754383Z [2024-04-06 01:37:36,772: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:36.772778939Z [2024-04-06 01:37:36,772: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:37:36.773071784Z [2024-04-06 01:37:36,772: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:37:36.773201129Z [2024-04-06 01:37:36,773: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:36.782267826Z [2024-04-06 01:37:36,780: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:36.844605918Z [2024-04-06 01:37:36,844: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:36.869374435Z [2024-04-06 01:37:36,868: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:37.622247687Z [2024-04-06 01:37:37,617: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93283ae1-2bb2-42a5-8cb9-e10dbd8898ac] succeeded in 3.4816797019998376s: None 2024-04-06T01:37:37.639660744Z [2024-04-06 01:37:37,639: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4050bd9-faca-47bb-9168-063c3122560a] succeeded in 3.5496462979999706s: None 2024-04-06T01:37:38.662525469Z [2024-04-06 01:37:38,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acb4dc9d-ee36-4db9-a27f-63e96f7ce885] received 2024-04-06T01:37:38.669549114Z [2024-04-06 01:37:38,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d8068f7-6d0a-4adb-8060-51507ff645c9] received 2024-04-06T01:37:38.675714718Z [2024-04-06 01:37:38,675: INFO/ForkPoolWorker-15] [acb4dc9d-ee36-4db9-a27f-63e96f7ce885] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', 'split_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:38.678520156Z [2024-04-06 01:37:38,678: INFO/ForkPoolWorker-16] [7d8068f7-6d0a-4adb-8060-51507ff645c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:39.027875432Z [2024-04-06 01:37:39,023: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:37:39.093935440Z [2024-04-06 01:37:39,088: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:37:40.470053368Z [2024-04-06 01:37:40,469: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:37:40.473371382Z [2024-04-06 01:37:40,472: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:40.496928864Z [2024-04-06 01:37:40,496: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:37:40.501317430Z [2024-04-06 01:37:40,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:40.520506258Z [2024-04-06 01:37:40,520: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:37:40.521799348Z [2024-04-06 01:37:40,521: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:40.521898722Z [2024-04-06 01:37:40,521: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:40.521929227Z [2024-04-06 01:37:40,521: INFO/ForkPoolWorker-16] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:40.522083723Z [2024-04-06 01:37:40,521: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:40.522118100Z [2024-04-06 01:37:40,522: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:37:40.522433846Z [2024-04-06 01:37:40,522: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:37:40.522447684Z [2024-04-06 01:37:40,522: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:40.529219415Z [2024-04-06 01:37:40,529: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:40.573788045Z [2024-04-06 01:37:40,573: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:37:40.576024233Z [2024-04-06 01:37:40,575: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:40.576189415Z [2024-04-06 01:37:40,576: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:40.576446855Z [2024-04-06 01:37:40,576: INFO/ForkPoolWorker-15] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:40.576777968Z [2024-04-06 01:37:40,576: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:40.576990666Z [2024-04-06 01:37:40,576: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:37:40.577433558Z [2024-04-06 01:37:40,577: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:37:40.577611576Z [2024-04-06 01:37:40,577: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:40.590971362Z [2024-04-06 01:37:40,590: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:40.604790035Z [2024-04-06 01:37:40,604: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:40.721905299Z [2024-04-06 01:37:40,694: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:41.273087869Z [2024-04-06 01:37:41,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88de24eb-5356-452d-9e6a-ca93293ab7df] received 2024-04-06T01:37:41.288745205Z [2024-04-06 01:37:41,288: INFO/ForkPoolWorker-1] [88de24eb-5356-452d-9e6a-ca93293ab7df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:37:41.438105681Z [2024-04-06 01:37:41,435: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d8068f7-6d0a-4adb-8060-51507ff645c9] succeeded in 2.763798940000015s: None 2024-04-06T01:37:41.504888657Z [2024-04-06 01:37:41,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d54f9626-5509-430d-ab82-28ffff007c91] received 2024-04-06T01:37:41.518678259Z [2024-04-06 01:37:41,518: INFO/ForkPoolWorker-16] [d54f9626-5509-430d-ab82-28ffff007c91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', 'collect_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:37:41.643151158Z [2024-04-06 01:37:41,642: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[acb4dc9d-ee36-4db9-a27f-63e96f7ce885] succeeded in 2.9770854440000676s: None 2024-04-06T01:37:41.886186511Z [2024-04-06 01:37:41,881: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:37:42.087730954Z [2024-04-06 01:37:42,084: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:37:43.674882499Z [2024-04-06 01:37:43,674: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:37:43.678581731Z [2024-04-06 01:37:43,678: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:43.733509484Z [2024-04-06 01:37:43,733: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:37:43.735300700Z [2024-04-06 01:37:43,735: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:43.735426306Z [2024-04-06 01:37:43,735: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:43.735594231Z [2024-04-06 01:37:43,735: INFO/ForkPoolWorker-1] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:43.735785256Z [2024-04-06 01:37:43,735: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:43.736217640Z [2024-04-06 01:37:43,736: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:37:43.736887543Z [2024-04-06 01:37:43,736: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:37:43.737043561Z [2024-04-06 01:37:43,736: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:43.750548526Z [2024-04-06 01:37:43,750: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:43.768392689Z [2024-04-06 01:37:43,768: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:37:43.771814220Z [2024-04-06 01:37:43,771: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:43.814118176Z [2024-04-06 01:37:43,813: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:37:43.815885324Z [2024-04-06 01:37:43,815: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:43.816011112Z [2024-04-06 01:37:43,815: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:43.816155843Z [2024-04-06 01:37:43,816: INFO/ForkPoolWorker-16] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:43.816519514Z [2024-04-06 01:37:43,816: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:43.816633416Z [2024-04-06 01:37:43,816: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:37:43.817054669Z [2024-04-06 01:37:43,816: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:37:43.817184695Z [2024-04-06 01:37:43,817: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:43.827272655Z [2024-04-06 01:37:43,826: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:43.890950817Z [2024-04-06 01:37:43,890: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:43.914216520Z [2024-04-06 01:37:43,914: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:44.564830150Z [2024-04-06 01:37:44,564: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[88de24eb-5356-452d-9e6a-ca93293ab7df] succeeded in 3.2859349819998442s: None 2024-04-06T01:37:44.677669243Z [2024-04-06 01:37:44,677: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d54f9626-5509-430d-ab82-28ffff007c91] succeeded in 3.169114013999888s: None 2024-04-06T01:37:45.255877622Z [2024-04-06 01:37:45,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e47edb8-4de7-44c1-bf03-e5658e0815c0] received 2024-04-06T01:37:45.259041482Z [2024-04-06 01:37:45,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29dc952e-86c4-4e56-b290-03097d7706c4] received 2024-04-06T01:37:45.266397623Z [2024-04-06 01:37:45,265: INFO/ForkPoolWorker-15] [7e47edb8-4de7-44c1-bf03-e5658e0815c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:45.275179815Z [2024-04-06 01:37:45,274: INFO/ForkPoolWorker-16] [29dc952e-86c4-4e56-b290-03097d7706c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', 'send_prometheus', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:45.687746456Z [2024-04-06 01:37:45,680: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:37:45.698017028Z [2024-04-06 01:37:45,691: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:37:47.131439768Z [2024-04-06 01:37:47,131: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:37:47.134884864Z [2024-04-06 01:37:47,134: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:47.177845389Z [2024-04-06 01:37:47,177: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:37:47.179695203Z [2024-04-06 01:37:47,179: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:47.179831859Z [2024-04-06 01:37:47,179: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:47.180134503Z [2024-04-06 01:37:47,179: INFO/ForkPoolWorker-16] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:47.180428180Z [2024-04-06 01:37:47,180: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:47.180571893Z [2024-04-06 01:37:47,180: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:37:47.180893845Z [2024-04-06 01:37:47,180: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:37:47.181185162Z [2024-04-06 01:37:47,180: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:47.184710449Z [2024-04-06 01:37:47,184: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:37:47.189653871Z [2024-04-06 01:37:47,188: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:47.190052521Z [2024-04-06 01:37:47,189: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:47.252929224Z [2024-04-06 01:37:47,252: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:37:47.262951358Z [2024-04-06 01:37:47,262: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:37:47.263245032Z [2024-04-06 01:37:47,263: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:37:47.263335304Z [2024-04-06 01:37:47,263: INFO/ForkPoolWorker-15] Read VIM 99757926-e4d9-470a-8811-67fd70635e04 (basic01_755974) 2024-04-06T01:37:47.263513310Z [2024-04-06 01:37:47,263: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '99757926-e4d9-470a-8811-67fd70635e04', 'name': 'basic01_755974', 'vim_type': 'openstack'}] 2024-04-06T01:37:47.263713800Z [2024-04-06 01:37:47,263: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:37:47.264035957Z [2024-04-06 01:37:47,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:37:47.264165037Z [2024-04-06 01:37:47,264: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:37:47.272583398Z [2024-04-06 01:37:47,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 2024-04-06T01:37:47.286867009Z [2024-04-06 01:37:47,285: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:47.355374499Z [2024-04-06 01:37:47,355: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:47.805453405Z [2024-04-06 01:37:47,804: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29dc952e-86c4-4e56-b290-03097d7706c4] succeeded in 2.5450795050001034s: None 2024-04-06T01:37:47.965123775Z [2024-04-06 01:37:47,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e47edb8-4de7-44c1-bf03-e5658e0815c0] succeeded in 2.7066325270000107s: None 2024-04-06T01:38:01.378216579Z [2024-04-06 01:38:01,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52de21e0-229a-4341-8feb-5be2f1cf85cd] received 2024-04-06T01:38:01.385039415Z [2024-04-06 01:38:01,384: INFO/ForkPoolWorker-15] [52de21e0-229a-4341-8feb-5be2f1cf85cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:38:01.401930139Z [2024-04-06 01:38:01,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[822f7fd4-4dea-4088-adc4-900076c22fed] received 2024-04-06T01:38:01.410357990Z [2024-04-06 01:38:01,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23b13a97-b7f7-41ff-8379-a93c8a17dd75] received 2024-04-06T01:38:01.416465571Z [2024-04-06 01:38:01,416: INFO/ForkPoolWorker-1] [23b13a97-b7f7-41ff-8379-a93c8a17dd75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:38:01.417653692Z [2024-04-06 01:38:01,417: INFO/ForkPoolWorker-16] [822f7fd4-4dea-4088-adc4-900076c22fed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:38:01.455660433Z [2024-04-06 01:38:01,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a28b9c42-5afe-4660-9db3-3e53b1a5f9fc] received 2024-04-06T01:38:01.479736404Z [2024-04-06 01:38:01,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa337de6-360a-4dad-b49d-761684587930] received 2024-04-06T01:38:01.503013211Z [2024-04-06 01:38:01,502: INFO/ForkPoolWorker-2] [a28b9c42-5afe-4660-9db3-3e53b1a5f9fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:38:01.576324594Z [2024-04-06 01:38:01,575: INFO/ForkPoolWorker-3] [fa337de6-360a-4dad-b49d-761684587930] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:38:02.239922476Z [2024-04-06 01:38:02,235: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:38:02.287570368Z [2024-04-06 01:38:02,284: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:38:02.514894096Z [2024-04-06 01:38:02,511: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:38:02.891645554Z [2024-04-06 01:38:02,887: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:38:03.030613295Z [2024-04-06 01:38:03,017: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:38:03.264024669Z [2024-04-06 01:38:03,263: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:38:06.196134591Z [2024-04-06 01:38:06,195: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:38:06.201905434Z [2024-04-06 01:38:06,201: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:06.374014053Z [2024-04-06 01:38:06,373: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:38:06.385656221Z [2024-04-06 01:38:06,385: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:06.385690138Z [2024-04-06 01:38:06,385: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:06.387326614Z [2024-04-06 01:38:06,387: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:06.387342589Z [2024-04-06 01:38:06,387: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:38:06.387764916Z [2024-04-06 01:38:06,387: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:38:06.387842189Z [2024-04-06 01:38:06,387: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:06.513522707Z [2024-04-06 01:38:06,513: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:38:07.143324701Z [2024-04-06 01:38:07,142: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:38:07.147337561Z [2024-04-06 01:38:07,146: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:07.319725614Z [2024-04-06 01:38:07,319: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T01:38:07.325789903Z [2024-04-06 01:38:07,324: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:07.338033072Z [2024-04-06 01:38:07,333: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:38:07.351550459Z [2024-04-06 01:38:07,351: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:07.357889449Z [2024-04-06 01:38:07,351: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:07.358213741Z [2024-04-06 01:38:07,357: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:07.366825637Z [2024-04-06 01:38:07,358: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:38:07.367290136Z [2024-04-06 01:38:07,367: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:38:07.368903255Z [2024-04-06 01:38:07,367: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:07.398362887Z [2024-04-06 01:38:07,392: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a28b9c42-5afe-4660-9db3-3e53b1a5f9fc] succeeded in 5.906114250999963s: None 2024-04-06T01:38:07.476753653Z [2024-04-06 01:38:07,476: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:38:07.496903453Z [2024-04-06 01:38:07,496: INFO/ForkPoolWorker-3] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:07.497288606Z [2024-04-06 01:38:07,496: INFO/ForkPoolWorker-3] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:07.497563259Z [2024-04-06 01:38:07,497: INFO/ForkPoolWorker-3] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:07.497904314Z [2024-04-06 01:38:07,497: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T01:38:07.500329455Z [2024-04-06 01:38:07,500: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:38:07.500366531Z [2024-04-06 01:38:07,500: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:07.521049545Z [2024-04-06 01:38:07,520: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:38:07.524749429Z [2024-04-06 01:38:07,521: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:38:07.532000352Z [2024-04-06 01:38:07,531: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T01:38:07.559340344Z [2024-04-06 01:38:07,559: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:07.570976445Z [2024-04-06 01:38:07,570: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:38:07.813952919Z [2024-04-06 01:38:07,813: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:38:07.826823692Z [2024-04-06 01:38:07,826: INFO/ForkPoolWorker-3] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:07.830122280Z [2024-04-06 01:38:07,826: INFO/ForkPoolWorker-3] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:07.833234222Z [2024-04-06 01:38:07,831: INFO/ForkPoolWorker-3] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:07.836658357Z [2024-04-06 01:38:07,836: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T01:38:07.840961323Z [2024-04-06 01:38:07,840: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:38:07.840974883Z [2024-04-06 01:38:07,840: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:07.889672229Z [2024-04-06 01:38:07,888: ERROR/ForkPoolWorker-3] [fa337de6-360a-4dad-b49d-761684587930] Failed to execute task Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:38:07.889695107Z Traceback (most recent call last): 2024-04-06T01:38:07.889699157Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:38:07.889702948Z args.func(args) 2024-04-06T01:38:07.889706551Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:38:07.889710269Z return func(*args, **kwargs) 2024-04-06T01:38:07.889713508Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:38:07.889716492Z return f(*args, **kwargs) 2024-04-06T01:38:07.889719676Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:38:07.889722559Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:38:07.889743488Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:38:07.889746741Z raise AirflowException( 2024-04-06T01:38:07.889750314Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:38:08.177954068Z [2024-04-06 01:38:08,161: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[fa337de6-360a-4dad-b49d-761684587930] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fa337de6-360a-4dad-b49d-761684587930') 2024-04-06T01:38:08.177982960Z Traceback (most recent call last): 2024-04-06T01:38:08.177987163Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:38:08.177990447Z R = retval = fun(*args, **kwargs) 2024-04-06T01:38:08.177993288Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:38:08.177996415Z return self.run(*args, **kwargs) 2024-04-06T01:38:08.177999879Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:38:08.178003248Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:38:08.178005992Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:38:08.178009256Z raise AirflowException(msg) 2024-04-06T01:38:08.178012699Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fa337de6-360a-4dad-b49d-761684587930 2024-04-06T01:38:08.889709734Z [2024-04-06 01:38:08,889: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:38:08.892937874Z [2024-04-06 01:38:08,892: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:08.932141676Z [2024-04-06 01:38:08,931: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:38:08.933563514Z [2024-04-06 01:38:08,933: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:08.933574004Z [2024-04-06 01:38:08,933: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:08.933748565Z [2024-04-06 01:38:08,933: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:08.933962579Z [2024-04-06 01:38:08,933: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:38:08.934250812Z [2024-04-06 01:38:08,934: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:38:08.934323723Z [2024-04-06 01:38:08,934: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:08.940107633Z [2024-04-06 01:38:08,939: WARNING/ForkPoolWorker-1] Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:38:08.941068886Z [2024-04-06 01:38:08,940: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:38:08.941969431Z [2024-04-06 01:38:08,941: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:38:08.945803278Z [2024-04-06 01:38:08,945: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:08.972141569Z [2024-04-06 01:38:08,971: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:38:08.979389480Z [2024-04-06 01:38:08,979: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:08.981578954Z [2024-04-06 01:38:08,979: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:08.981797767Z [2024-04-06 01:38:08,981: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:08.981942135Z [2024-04-06 01:38:08,981: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:38:08.982468787Z [2024-04-06 01:38:08,982: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:38:08.982565726Z [2024-04-06 01:38:08,982: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:08.985793746Z [2024-04-06 01:38:08,985: ERROR/ForkPoolWorker-1] [23b13a97-b7f7-41ff-8379-a93c8a17dd75] Failed to execute task Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:38:08.985806025Z Traceback (most recent call last): 2024-04-06T01:38:08.985821747Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:38:08.985826658Z args.func(args) 2024-04-06T01:38:08.985830059Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:38:08.985833583Z return func(*args, **kwargs) 2024-04-06T01:38:08.985836498Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:38:08.985839432Z return f(*args, **kwargs) 2024-04-06T01:38:08.985842633Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:38:08.985845582Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:38:08.985848479Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:38:08.985851382Z raise AirflowException( 2024-04-06T01:38:08.985854970Z airflow.exceptions.AirflowException: Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:38:09.037463414Z [2024-04-06 01:38:09,036: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23b13a97-b7f7-41ff-8379-a93c8a17dd75] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 23b13a97-b7f7-41ff-8379-a93c8a17dd75') 2024-04-06T01:38:09.037480475Z Traceback (most recent call last): 2024-04-06T01:38:09.037484847Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:38:09.037487956Z R = retval = fun(*args, **kwargs) 2024-04-06T01:38:09.037491238Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:38:09.037504058Z return self.run(*args, **kwargs) 2024-04-06T01:38:09.037508213Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:38:09.037511941Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:38:09.037515014Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:38:09.037518564Z raise AirflowException(msg) 2024-04-06T01:38:09.037522306Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 23b13a97-b7f7-41ff-8379-a93c8a17dd75 2024-04-06T01:38:09.996916092Z [2024-04-06 01:38:09,996: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52de21e0-229a-4341-8feb-5be2f1cf85cd] succeeded in 8.617398683999909s: None 2024-04-06T01:38:10.419433684Z [2024-04-06 01:38:10,418: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[822f7fd4-4dea-4088-adc4-900076c22fed] succeeded in 9.011912920999976s: None 2024-04-06T01:38:19.732337227Z [2024-04-06 01:38:19,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2fe9a77-f65b-4549-9ccf-cd2c2ed449c9] received 2024-04-06T01:38:19.742738233Z [2024-04-06 01:38:19,742: INFO/ForkPoolWorker-15] [f2fe9a77-f65b-4549-9ccf-cd2c2ed449c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:38:19.753505932Z [2024-04-06 01:38:19,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86491bf7-b831-4d69-bf47-bcef861f8f73] received 2024-04-06T01:38:19.767973796Z [2024-04-06 01:38:19,767: INFO/ForkPoolWorker-16] [86491bf7-b831-4d69-bf47-bcef861f8f73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:38:20.125308051Z [2024-04-06 01:38:20,121: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:38:20.154193205Z [2024-04-06 01:38:20,150: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:38:22.021974812Z [2024-04-06 01:38:22,021: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:38:22.025290320Z [2024-04-06 01:38:22,024: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:22.100310791Z [2024-04-06 01:38:22,100: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:38:22.103353031Z [2024-04-06 01:38:22,103: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:22.103368446Z [2024-04-06 01:38:22,103: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:22.103533974Z [2024-04-06 01:38:22,103: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:22.105258344Z [2024-04-06 01:38:22,103: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:38:22.105507950Z [2024-04-06 01:38:22,105: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:38:22.105545657Z [2024-04-06 01:38:22,105: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:22.118290828Z [2024-04-06 01:38:22,118: WARNING/ForkPoolWorker-15] Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:38:22.119078960Z [2024-04-06 01:38:22,118: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:38:22.119816406Z [2024-04-06 01:38:22,119: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:38:22.123745681Z [2024-04-06 01:38:22,123: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:22.166184447Z [2024-04-06 01:38:22,165: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:38:22.179454798Z [2024-04-06 01:38:22,175: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:22.200288771Z [2024-04-06 01:38:22,200: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:38:22.206774915Z [2024-04-06 01:38:22,206: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:22.206792209Z [2024-04-06 01:38:22,206: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:22.206881768Z [2024-04-06 01:38:22,206: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:22.206911667Z [2024-04-06 01:38:22,206: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:38:22.207218474Z [2024-04-06 01:38:22,207: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:38:22.207232436Z [2024-04-06 01:38:22,207: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:22.215786209Z [2024-04-06 01:38:22,215: ERROR/ForkPoolWorker-15] [f2fe9a77-f65b-4549-9ccf-cd2c2ed449c9] Failed to execute task Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:38:22.215797020Z Traceback (most recent call last): 2024-04-06T01:38:22.215800865Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:38:22.215804536Z args.func(args) 2024-04-06T01:38:22.215808175Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:38:22.215814272Z return func(*args, **kwargs) 2024-04-06T01:38:22.215817100Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:38:22.215819946Z return f(*args, **kwargs) 2024-04-06T01:38:22.215822708Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:38:22.215825511Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:38:22.215838670Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:38:22.215841477Z raise AirflowException( 2024-04-06T01:38:22.215844813Z airflow.exceptions.AirflowException: Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:38:22.239013544Z [2024-04-06 01:38:22,238: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:38:22.240064177Z [2024-04-06 01:38:22,239: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:22.240158917Z [2024-04-06 01:38:22,240: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:22.240400729Z [2024-04-06 01:38:22,240: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:22.240556421Z [2024-04-06 01:38:22,240: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:38:22.240944732Z [2024-04-06 01:38:22,240: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:38:22.240991959Z [2024-04-06 01:38:22,240: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:22.262868039Z [2024-04-06 01:38:22,262: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:38:22.265146227Z [2024-04-06 01:38:22,263: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:38:22.267394832Z [2024-04-06 01:38:22,267: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:38:22.272763682Z [2024-04-06 01:38:22,272: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:22.276278746Z [2024-04-06 01:38:22,275: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2fe9a77-f65b-4549-9ccf-cd2c2ed449c9] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f2fe9a77-f65b-4549-9ccf-cd2c2ed449c9') 2024-04-06T01:38:22.276294516Z Traceback (most recent call last): 2024-04-06T01:38:22.276298487Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:38:22.276302063Z R = retval = fun(*args, **kwargs) 2024-04-06T01:38:22.276305319Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:38:22.276308623Z return self.run(*args, **kwargs) 2024-04-06T01:38:22.276312825Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:38:22.276316440Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:38:22.276319632Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:38:22.276323239Z raise AirflowException(msg) 2024-04-06T01:38:22.276326831Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f2fe9a77-f65b-4549-9ccf-cd2c2ed449c9 2024-04-06T01:38:22.326162587Z [2024-04-06 01:38:22,324: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:38:22.330693486Z [2024-04-06 01:38:22,330: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:38:22.330873975Z [2024-04-06 01:38:22,330: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:38:22.331208186Z [2024-04-06 01:38:22,331: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:22.331367403Z [2024-04-06 01:38:22,331: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:38:22.332304562Z [2024-04-06 01:38:22,332: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:38:22.332537205Z [2024-04-06 01:38:22,332: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:38:22.338222517Z [2024-04-06 01:38:22,336: ERROR/ForkPoolWorker-16] [86491bf7-b831-4d69-bf47-bcef861f8f73] Failed to execute task Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:38:22.338234241Z Traceback (most recent call last): 2024-04-06T01:38:22.338237853Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:38:22.338241350Z args.func(args) 2024-04-06T01:38:22.338244913Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:38:22.338248204Z return func(*args, **kwargs) 2024-04-06T01:38:22.338250966Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:38:22.338258557Z return f(*args, **kwargs) 2024-04-06T01:38:22.338265386Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:38:22.338268345Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:38:22.338271161Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:38:22.338273964Z raise AirflowException( 2024-04-06T01:38:22.338280823Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:38:22.412637210Z [2024-04-06 01:38:22,412: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86491bf7-b831-4d69-bf47-bcef861f8f73] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 86491bf7-b831-4d69-bf47-bcef861f8f73') 2024-04-06T01:38:22.412651837Z Traceback (most recent call last): 2024-04-06T01:38:22.412655715Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:38:22.412659190Z R = retval = fun(*args, **kwargs) 2024-04-06T01:38:22.412662210Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:38:22.412665204Z return self.run(*args, **kwargs) 2024-04-06T01:38:22.412668936Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:38:22.412672713Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:38:22.412675582Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:38:22.412692704Z raise AirflowException(msg) 2024-04-06T01:38:22.412696433Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 86491bf7-b831-4d69-bf47-bcef861f8f73 2024-04-06T01:39:00.433384908Z [2024-04-06 01:39:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a892be8a-0338-4221-b5fe-22210b3a3163] received 2024-04-06T01:39:00.436986389Z [2024-04-06 01:39:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd233376-e6fa-49ac-9767-84653872e017] received 2024-04-06T01:39:00.441998033Z [2024-04-06 01:39:00,441: INFO/ForkPoolWorker-15] [a892be8a-0338-4221-b5fe-22210b3a3163] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:39:00.451097177Z [2024-04-06 01:39:00,450: INFO/ForkPoolWorker-16] [bd233376-e6fa-49ac-9767-84653872e017] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:39:00.459249315Z [2024-04-06 01:39:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3f08210-c732-4e29-a37f-4e17fef2322a] received 2024-04-06T01:39:00.461001530Z [2024-04-06 01:39:00,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f70cdfb-3c99-48ba-8f5b-1b814d5a9df0] received 2024-04-06T01:39:00.487091056Z [2024-04-06 01:39:00,486: INFO/ForkPoolWorker-2] [3f70cdfb-3c99-48ba-8f5b-1b814d5a9df0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:39:00.490872565Z [2024-04-06 01:39:00,490: INFO/ForkPoolWorker-1] [e3f08210-c732-4e29-a37f-4e17fef2322a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:39:01.063176806Z [2024-04-06 01:39:01,044: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:39:01.145785322Z [2024-04-06 01:39:01,142: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:39:01.211738658Z [2024-04-06 01:39:01,207: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:39:01.486263452Z [2024-04-06 01:39:01,459: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:39:04.211576503Z [2024-04-06 01:39:04,211: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:39:04.216346630Z [2024-04-06 01:39:04,215: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:04.483120691Z [2024-04-06 01:39:04,482: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:39:04.493595799Z [2024-04-06 01:39:04,493: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:04.493626355Z [2024-04-06 01:39:04,493: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:04.493733015Z [2024-04-06 01:39:04,493: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:04.493771628Z [2024-04-06 01:39:04,493: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:39:04.494040336Z [2024-04-06 01:39:04,493: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:39:04.494071050Z [2024-04-06 01:39:04,494: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:04.612171726Z [2024-04-06 01:39:04,611: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:39:05.337069657Z [2024-04-06 01:39:05,336: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:39:05.342319446Z [2024-04-06 01:39:05,341: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:05.481010550Z [2024-04-06 01:39:05,480: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:39:05.482084044Z [2024-04-06 01:39:05,481: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:05.482273921Z [2024-04-06 01:39:05,482: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:05.482472540Z [2024-04-06 01:39:05,482: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:05.482623643Z [2024-04-06 01:39:05,482: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:39:05.483080940Z [2024-04-06 01:39:05,482: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:39:05.483363647Z [2024-04-06 01:39:05,483: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:05.589946089Z [2024-04-06 01:39:05,589: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:39:06.119011432Z [2024-04-06 01:39:06,118: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:39:06.154395555Z [2024-04-06 01:39:06,152: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:06.321138703Z [2024-04-06 01:39:06,320: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:39:06.325190799Z [2024-04-06 01:39:06,324: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:06.335400806Z [2024-04-06 01:39:06,335: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:39:06.341013808Z [2024-04-06 01:39:06,340: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:06.341211366Z [2024-04-06 01:39:06,340: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:06.341505201Z [2024-04-06 01:39:06,341: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:06.342039349Z [2024-04-06 01:39:06,341: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:39:06.347825406Z [2024-04-06 01:39:06,347: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:39:06.348384530Z [2024-04-06 01:39:06,347: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:06.367810097Z [2024-04-06 01:39:06,367: WARNING/ForkPoolWorker-15] Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:39:06.378475358Z [2024-04-06 01:39:06,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:39:06.385336393Z [2024-04-06 01:39:06,385: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:39:06.396906678Z [2024-04-06 01:39:06,396: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:06.428680537Z [2024-04-06 01:39:06,428: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:39:06.435810292Z [2024-04-06 01:39:06,435: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:06.435828675Z [2024-04-06 01:39:06,435: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:06.436004438Z [2024-04-06 01:39:06,435: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:06.436042903Z [2024-04-06 01:39:06,435: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:39:06.436311816Z [2024-04-06 01:39:06,436: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:39:06.436328906Z [2024-04-06 01:39:06,436: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:06.445129681Z [2024-04-06 01:39:06,444: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:39:06.446147497Z [2024-04-06 01:39:06,445: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:39:06.446968664Z [2024-04-06 01:39:06,446: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:39:06.449457996Z [2024-04-06 01:39:06,449: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:06.487357317Z [2024-04-06 01:39:06,487: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:39:06.496882126Z [2024-04-06 01:39:06,496: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:06.500391096Z [2024-04-06 01:39:06,496: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:06.500658319Z [2024-04-06 01:39:06,500: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:06.502074162Z [2024-04-06 01:39:06,500: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:39:06.502389898Z [2024-04-06 01:39:06,502: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:39:06.502505562Z [2024-04-06 01:39:06,502: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:06.518000056Z [2024-04-06 01:39:06,517: ERROR/ForkPoolWorker-15] [a892be8a-0338-4221-b5fe-22210b3a3163] Failed to execute task Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:39:06.518030902Z Traceback (most recent call last): 2024-04-06T01:39:06.518035983Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:39:06.518039552Z args.func(args) 2024-04-06T01:39:06.518043336Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:39:06.518047083Z return func(*args, **kwargs) 2024-04-06T01:39:06.518050051Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:39:06.518053055Z return f(*args, **kwargs) 2024-04-06T01:39:06.518056171Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:39:06.518059188Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:39:06.518062171Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:39:06.518065195Z raise AirflowException( 2024-04-06T01:39:06.518068973Z airflow.exceptions.AirflowException: Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:39:06.534074067Z [2024-04-06 01:39:06,533: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:39:06.545618103Z [2024-04-06 01:39:06,545: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:06.545634403Z [2024-04-06 01:39:06,545: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:06.547294138Z [2024-04-06 01:39:06,545: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:06.547343651Z [2024-04-06 01:39:06,547: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:39:06.547556068Z [2024-04-06 01:39:06,547: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:39:06.547581727Z [2024-04-06 01:39:06,547: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:06.555705213Z [2024-04-06 01:39:06,555: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a892be8a-0338-4221-b5fe-22210b3a3163] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a892be8a-0338-4221-b5fe-22210b3a3163') 2024-04-06T01:39:06.555728246Z Traceback (most recent call last): 2024-04-06T01:39:06.555731856Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:39:06.555734751Z R = retval = fun(*args, **kwargs) 2024-04-06T01:39:06.555737660Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:39:06.555755048Z return self.run(*args, **kwargs) 2024-04-06T01:39:06.555758867Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:39:06.555763877Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:39:06.555766727Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:39:06.555769988Z raise AirflowException(msg) 2024-04-06T01:39:06.555773587Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a892be8a-0338-4221-b5fe-22210b3a3163 2024-04-06T01:39:06.560596584Z [2024-04-06 01:39:06,555: ERROR/ForkPoolWorker-16] [bd233376-e6fa-49ac-9767-84653872e017] Failed to execute task Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:39:06.560611236Z Traceback (most recent call last): 2024-04-06T01:39:06.560615177Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:39:06.560618820Z args.func(args) 2024-04-06T01:39:06.560622706Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:39:06.560626032Z return func(*args, **kwargs) 2024-04-06T01:39:06.560644426Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:39:06.560648120Z return f(*args, **kwargs) 2024-04-06T01:39:06.560651288Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:39:06.560654516Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:39:06.560657363Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:39:06.560660177Z raise AirflowException( 2024-04-06T01:39:06.560663996Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:39:06.634147367Z [2024-04-06 01:39:06,633: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd233376-e6fa-49ac-9767-84653872e017] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bd233376-e6fa-49ac-9767-84653872e017') 2024-04-06T01:39:06.634164010Z Traceback (most recent call last): 2024-04-06T01:39:06.634167747Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:39:06.634170663Z R = retval = fun(*args, **kwargs) 2024-04-06T01:39:06.634173516Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:39:06.634176217Z return self.run(*args, **kwargs) 2024-04-06T01:39:06.634189903Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:39:06.634193168Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:39:06.634196122Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:39:06.634199400Z raise AirflowException(msg) 2024-04-06T01:39:06.634202807Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bd233376-e6fa-49ac-9767-84653872e017 2024-04-06T01:39:07.590985517Z [2024-04-06 01:39:07,590: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3f70cdfb-3c99-48ba-8f5b-1b814d5a9df0] succeeded in 7.1278104170000915s: None 2024-04-06T01:39:07.751882922Z [2024-04-06 01:39:07,751: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e3f08210-c732-4e29-a37f-4e17fef2322a] succeeded in 7.277816051999935s: None 2024-04-06T01:39:18.312495781Z [2024-04-06 01:39:18,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f04dea4-3a6f-4321-9909-d2a2c011503e] received 2024-04-06T01:39:18.323195569Z [2024-04-06 01:39:18,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80c26df4-7ca6-49f3-af52-ba9745499e15] received 2024-04-06T01:39:18.329101541Z [2024-04-06 01:39:18,328: INFO/ForkPoolWorker-15] [0f04dea4-3a6f-4321-9909-d2a2c011503e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:39:18.332784613Z [2024-04-06 01:39:18,332: INFO/ForkPoolWorker-16] [80c26df4-7ca6-49f3-af52-ba9745499e15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:39:18.891695802Z [2024-04-06 01:39:18,887: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:39:18.962566768Z [2024-04-06 01:39:18,956: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:39:20.229126030Z [2024-04-06 01:39:20,228: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:39:20.232965538Z [2024-04-06 01:39:20,232: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:20.280853123Z [2024-04-06 01:39:20,280: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:39:20.283088862Z [2024-04-06 01:39:20,282: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:20.283211185Z [2024-04-06 01:39:20,283: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:20.283596351Z [2024-04-06 01:39:20,283: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:20.283695380Z [2024-04-06 01:39:20,283: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:39:20.284086223Z [2024-04-06 01:39:20,283: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:39:20.284356138Z [2024-04-06 01:39:20,284: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:20.293319199Z [2024-04-06 01:39:20,292: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:39:20.294010820Z [2024-04-06 01:39:20,293: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:39:20.294860843Z [2024-04-06 01:39:20,294: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:39:20.298086398Z [2024-04-06 01:39:20,297: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:20.359902425Z [2024-04-06 01:39:20,359: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:39:20.362648472Z [2024-04-06 01:39:20,362: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:20.362762591Z [2024-04-06 01:39:20,362: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:20.362982067Z [2024-04-06 01:39:20,362: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:20.363078476Z [2024-04-06 01:39:20,362: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:39:20.363384373Z [2024-04-06 01:39:20,363: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:39:20.363464949Z [2024-04-06 01:39:20,363: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:20.367358821Z [2024-04-06 01:39:20,366: ERROR/ForkPoolWorker-15] [0f04dea4-3a6f-4321-9909-d2a2c011503e] Failed to execute task Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:39:20.367413701Z Traceback (most recent call last): 2024-04-06T01:39:20.367421339Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:39:20.367428248Z args.func(args) 2024-04-06T01:39:20.367435128Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:39:20.367443283Z return func(*args, **kwargs) 2024-04-06T01:39:20.367450010Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:39:20.367455986Z return f(*args, **kwargs) 2024-04-06T01:39:20.367462112Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:39:20.367468276Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:39:20.367474705Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:39:20.367480858Z raise AirflowException( 2024-04-06T01:39:20.367487971Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:39:20.413307512Z [2024-04-06 01:39:20,412: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0f04dea4-3a6f-4321-9909-d2a2c011503e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0f04dea4-3a6f-4321-9909-d2a2c011503e') 2024-04-06T01:39:20.413351861Z Traceback (most recent call last): 2024-04-06T01:39:20.413358269Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:39:20.413362952Z R = retval = fun(*args, **kwargs) 2024-04-06T01:39:20.413367611Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:39:20.413372227Z return self.run(*args, **kwargs) 2024-04-06T01:39:20.413377273Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:39:20.413382590Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:39:20.413387602Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:39:20.413394395Z raise AirflowException(msg) 2024-04-06T01:39:20.413400089Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0f04dea4-3a6f-4321-9909-d2a2c011503e 2024-04-06T01:39:20.469922169Z [2024-04-06 01:39:20,469: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:39:20.474598103Z [2024-04-06 01:39:20,474: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:20.506779358Z [2024-04-06 01:39:20,506: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:39:20.508236079Z [2024-04-06 01:39:20,507: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:20.508254395Z [2024-04-06 01:39:20,508: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:20.508327699Z [2024-04-06 01:39:20,508: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:20.508346070Z [2024-04-06 01:39:20,508: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:39:20.508568755Z [2024-04-06 01:39:20,508: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:39:20.508586038Z [2024-04-06 01:39:20,508: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:20.520477541Z [2024-04-06 01:39:20,520: WARNING/ForkPoolWorker-16] Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:39:20.521931231Z [2024-04-06 01:39:20,520: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:39:20.522769573Z [2024-04-06 01:39:20,522: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:39:20.525753310Z [2024-04-06 01:39:20,525: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:20.561503500Z [2024-04-06 01:39:20,561: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:39:20.562863743Z [2024-04-06 01:39:20,562: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:39:20.563050546Z [2024-04-06 01:39:20,562: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:39:20.563308583Z [2024-04-06 01:39:20,563: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:20.563366278Z [2024-04-06 01:39:20,563: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:39:20.563685984Z [2024-04-06 01:39:20,563: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:39:20.563734880Z [2024-04-06 01:39:20,563: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:39:20.567382291Z [2024-04-06 01:39:20,566: ERROR/ForkPoolWorker-16] [80c26df4-7ca6-49f3-af52-ba9745499e15] Failed to execute task Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:39:20.567396044Z Traceback (most recent call last): 2024-04-06T01:39:20.567399993Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:39:20.567403557Z args.func(args) 2024-04-06T01:39:20.567407398Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:39:20.567411992Z return func(*args, **kwargs) 2024-04-06T01:39:20.567414953Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:39:20.567418248Z return f(*args, **kwargs) 2024-04-06T01:39:20.567421292Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:39:20.567424311Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:39:20.567427314Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:39:20.567430243Z raise AirflowException( 2024-04-06T01:39:20.567435066Z airflow.exceptions.AirflowException: Dag 'vim_status_99757926-e4d9-470a-8811-67fd70635e04' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:39:20.627183116Z [2024-04-06 01:39:20,626: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80c26df4-7ca6-49f3-af52-ba9745499e15] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 80c26df4-7ca6-49f3-af52-ba9745499e15') 2024-04-06T01:39:20.627196646Z Traceback (most recent call last): 2024-04-06T01:39:20.627200214Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:39:20.627203169Z R = retval = fun(*args, **kwargs) 2024-04-06T01:39:20.627205902Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:39:20.627208613Z return self.run(*args, **kwargs) 2024-04-06T01:39:20.627211709Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:39:20.627215712Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:39:20.627218325Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:39:20.627235077Z raise AirflowException(msg) 2024-04-06T01:39:20.627238363Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 80c26df4-7ca6-49f3-af52-ba9745499e15 2024-04-06T01:40:00.666663712Z [2024-04-06 01:40:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7788d7e5-6aa3-47f2-a721-438658af941c] received 2024-04-06T01:40:00.670536262Z [2024-04-06 01:40:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a284a94b-8b8e-450d-b0ca-6ae899d6b42c] received 2024-04-06T01:40:00.672485806Z [2024-04-06 01:40:00,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ce9b2b8-e904-4623-bae0-ef498be66ae9] received 2024-04-06T01:40:00.674919643Z [2024-04-06 01:40:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03cff490-d63d-499f-883a-853a35a50fc2] received 2024-04-06T01:40:00.687409968Z [2024-04-06 01:40:00,687: INFO/ForkPoolWorker-16] [a284a94b-8b8e-450d-b0ca-6ae899d6b42c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:00.687581693Z [2024-04-06 01:40:00,687: INFO/ForkPoolWorker-2] [03cff490-d63d-499f-883a-853a35a50fc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:40:00.691840732Z [2024-04-06 01:40:00,691: INFO/ForkPoolWorker-1] [8ce9b2b8-e904-4623-bae0-ef498be66ae9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:40:00.708775409Z [2024-04-06 01:40:00,688: INFO/ForkPoolWorker-15] [7788d7e5-6aa3-47f2-a721-438658af941c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:40:01.223363650Z [2024-04-06 01:40:01,218: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:40:01.353758061Z [2024-04-06 01:40:01,347: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:01.419262829Z [2024-04-06 01:40:01,407: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:40:01.593033522Z [2024-04-06 01:40:01,589: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:40:01.824195099Z [2024-04-06 01:40:01,821: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:03.969613555Z [2024-04-06 01:40:03,969: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ce9b2b8-e904-4623-bae0-ef498be66ae9] succeeded in 3.2940011110001706s: None 2024-04-06T01:40:04.540757416Z [2024-04-06 01:40:04,540: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:04.544332199Z [2024-04-06 01:40:04,543: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:04.716064794Z [2024-04-06 01:40:04,715: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:04.717293135Z [2024-04-06 01:40:04,717: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:04.717412201Z [2024-04-06 01:40:04,717: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:04.717587168Z [2024-04-06 01:40:04,717: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:04.717671693Z [2024-04-06 01:40:04,717: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:04.718003927Z [2024-04-06 01:40:04,717: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:40:04.718142068Z [2024-04-06 01:40:04,718: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:04.841184471Z [2024-04-06 01:40:04,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:04.924569596Z [2024-04-06 01:40:04,924: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:40:04.954128469Z [2024-04-06 01:40:04,953: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:05.131241436Z [2024-04-06 01:40:05,131: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:40:05.135404953Z [2024-04-06 01:40:05,135: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:05.135426641Z [2024-04-06 01:40:05,135: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:05.135552712Z [2024-04-06 01:40:05,135: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:05.135583420Z [2024-04-06 01:40:05,135: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:40:05.135782729Z [2024-04-06 01:40:05,135: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:05.135825890Z [2024-04-06 01:40:05,135: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:05.273002559Z [2024-04-06 01:40:05,272: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:40:05.289707829Z [2024-04-06 01:40:05,277: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:05.359902617Z [2024-04-06 01:40:05,359: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:40:05.362332788Z [2024-04-06 01:40:05,362: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:05.362568770Z [2024-04-06 01:40:05,362: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:05.362935955Z [2024-04-06 01:40:05,362: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:05.364747805Z [2024-04-06 01:40:05,362: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:40:05.365233703Z [2024-04-06 01:40:05,365: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:40:05.365444833Z [2024-04-06 01:40:05,365: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:05.528211046Z [2024-04-06 01:40:05,527: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:05.629708313Z [2024-04-06 01:40:05,629: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:06.672989188Z [2024-04-06 01:40:06,672: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a284a94b-8b8e-450d-b0ca-6ae899d6b42c] succeeded in 5.999946626999872s: None 2024-04-06T01:40:07.113370467Z [2024-04-06 01:40:07,112: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7788d7e5-6aa3-47f2-a721-438658af941c] succeeded in 6.4435219629999665s: None 2024-04-06T01:40:07.473494389Z [2024-04-06 01:40:07,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dae2ee3-f2dc-4ea0-a92e-d638b440a625] received 2024-04-06T01:40:07.482212344Z [2024-04-06 01:40:07,481: INFO/ForkPoolWorker-15] [0dae2ee3-f2dc-4ea0-a92e-d638b440a625] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:07.819802130Z [2024-04-06 01:40:07,816: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:08.701972727Z [2024-04-06 01:40:08,699: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[03cff490-d63d-499f-883a-853a35a50fc2] succeeded in 8.02186921700013s: None 2024-04-06T01:40:09.539484330Z [2024-04-06 01:40:09,538: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:09.550409741Z [2024-04-06 01:40:09,545: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:09.591116944Z [2024-04-06 01:40:09,590: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:09.596423416Z [2024-04-06 01:40:09,595: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:09.596611553Z [2024-04-06 01:40:09,596: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:09.597135784Z [2024-04-06 01:40:09,596: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:09.597349081Z [2024-04-06 01:40:09,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:09.599891526Z [2024-04-06 01:40:09,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:09.600178596Z [2024-04-06 01:40:09,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:09.765638535Z [2024-04-06 01:40:09,765: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:10.654874005Z [2024-04-06 01:40:10,654: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0dae2ee3-f2dc-4ea0-a92e-d638b440a625] succeeded in 3.177757348000114s: None 2024-04-06T01:40:11.182141541Z [2024-04-06 01:40:11,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0f5dcfb-bb57-4fff-84dd-bf410478ec0e] received 2024-04-06T01:40:11.193500603Z [2024-04-06 01:40:11,193: INFO/ForkPoolWorker-15] [f0f5dcfb-bb57-4fff-84dd-bf410478ec0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:40:11.570533789Z [2024-04-06 01:40:11,565: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:13.276473459Z [2024-04-06 01:40:13,276: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:13.280213116Z [2024-04-06 01:40:13,279: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:13.325205912Z [2024-04-06 01:40:13,323: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:13.335383222Z [2024-04-06 01:40:13,330: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:13.335459870Z [2024-04-06 01:40:13,334: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:13.350146695Z [2024-04-06 01:40:13,334: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:13.350197073Z [2024-04-06 01:40:13,334: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:13.350203078Z [2024-04-06 01:40:13,335: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:13.350209046Z [2024-04-06 01:40:13,335: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:13.489427640Z [2024-04-06 01:40:13,489: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:14.168842132Z [2024-04-06 01:40:14,168: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0f5dcfb-bb57-4fff-84dd-bf410478ec0e] succeeded in 2.984584813999845s: None 2024-04-06T01:40:14.289984894Z [2024-04-06 01:40:14,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd1d9188-442a-482d-8976-b33b040d92c6] received 2024-04-06T01:40:14.295733456Z [2024-04-06 01:40:14,295: INFO/ForkPoolWorker-15] [dd1d9188-442a-482d-8976-b33b040d92c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:14.776083075Z [2024-04-06 01:40:14,771: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:16.571003547Z [2024-04-06 01:40:16,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:16.574682184Z [2024-04-06 01:40:16,574: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:16.623932836Z [2024-04-06 01:40:16,623: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:16.626603615Z [2024-04-06 01:40:16,626: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:16.626629227Z [2024-04-06 01:40:16,626: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:16.626769847Z [2024-04-06 01:40:16,626: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:16.626791402Z [2024-04-06 01:40:16,626: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:16.626995476Z [2024-04-06 01:40:16,626: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:16.627007346Z [2024-04-06 01:40:16,626: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:16.730902015Z [2024-04-06 01:40:16,730: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:17.482969316Z [2024-04-06 01:40:17,481: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd1d9188-442a-482d-8976-b33b040d92c6] succeeded in 3.19230762899997s: None 2024-04-06T01:40:44.138848764Z [2024-04-06 01:40:44,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6dd72cf8-6d22-4060-81a9-3bcaf4b13301] received 2024-04-06T01:40:44.150095754Z [2024-04-06 01:40:44,149: INFO/ForkPoolWorker-15] [6dd72cf8-6d22-4060-81a9-3bcaf4b13301] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:40:44.512368826Z [2024-04-06 01:40:44,507: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:40:46.025721262Z [2024-04-06 01:40:46,025: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:46.028939761Z [2024-04-06 01:40:46,028: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:46.078896612Z [2024-04-06 01:40:46,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:46.080725602Z [2024-04-06 01:40:46,080: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:46.080870660Z [2024-04-06 01:40:46,080: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:46.081017290Z [2024-04-06 01:40:46,080: INFO/ForkPoolWorker-15] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:40:46.081333651Z [2024-04-06 01:40:46,081: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:40:46.081511160Z [2024-04-06 01:40:46,081: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:46.081992300Z [2024-04-06 01:40:46,081: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:40:46.082171011Z [2024-04-06 01:40:46,082: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:46.087134328Z [2024-04-06 01:40:46,086: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:40:46.166209007Z [2024-04-06 01:40:46,165: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:47.093161329Z [2024-04-06 01:40:47,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e033673-6639-4ab8-8f7b-1728c39454d3] received 2024-04-06T01:40:47.102433947Z [2024-04-06 01:40:47,102: INFO/ForkPoolWorker-16] [0e033673-6639-4ab8-8f7b-1728c39454d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:40:47.435417801Z [2024-04-06 01:40:47,431: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:40:48.202172518Z [2024-04-06 01:40:48,200: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6dd72cf8-6d22-4060-81a9-3bcaf4b13301] succeeded in 4.0574488019999535s: None 2024-04-06T01:40:49.030821698Z [2024-04-06 01:40:49,030: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:40:49.034131420Z [2024-04-06 01:40:49,033: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:49.065624682Z [2024-04-06 01:40:49,065: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:40:49.067594465Z [2024-04-06 01:40:49,067: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:49.067700098Z [2024-04-06 01:40:49,067: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:49.067809953Z [2024-04-06 01:40:49,067: INFO/ForkPoolWorker-16] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:40:49.068008336Z [2024-04-06 01:40:49,067: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:40:49.068144552Z [2024-04-06 01:40:49,067: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:40:49.068457803Z [2024-04-06 01:40:49,068: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:40:49.068571187Z [2024-04-06 01:40:49,068: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:49.072736616Z [2024-04-06 01:40:49,072: INFO/ForkPoolWorker-16] Creating DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:40:49.181257872Z [2024-04-06 01:40:49,181: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:50.699961086Z [2024-04-06 01:40:50,699: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e033673-6639-4ab8-8f7b-1728c39454d3] succeeded in 3.604494812999974s: None 2024-04-06T01:40:50.764439158Z [2024-04-06 01:40:50,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[291c43fa-eb9c-4bc4-b541-4558a9e54693] received 2024-04-06T01:40:50.789976076Z [2024-04-06 01:40:50,789: INFO/ForkPoolWorker-15] [291c43fa-eb9c-4bc4-b541-4558a9e54693] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:51.205410432Z [2024-04-06 01:40:51,201: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:52.631538403Z [2024-04-06 01:40:52,631: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:52.635538187Z [2024-04-06 01:40:52,635: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:52.672006199Z [2024-04-06 01:40:52,671: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:52.674132454Z [2024-04-06 01:40:52,673: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:52.674289947Z [2024-04-06 01:40:52,674: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:52.674513874Z [2024-04-06 01:40:52,674: INFO/ForkPoolWorker-15] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:40:52.675506016Z [2024-04-06 01:40:52,674: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:40:52.675716739Z [2024-04-06 01:40:52,675: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:52.676132979Z [2024-04-06 01:40:52,675: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:52.676394309Z [2024-04-06 01:40:52,676: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:52.683411406Z [2024-04-06 01:40:52,683: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:40:52.763821102Z [2024-04-06 01:40:52,763: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:53.339789470Z [2024-04-06 01:40:53,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11b717dd-687f-43f0-8d12-22d148026d43] received 2024-04-06T01:40:53.358531066Z [2024-04-06 01:40:53,357: INFO/ForkPoolWorker-16] [11b717dd-687f-43f0-8d12-22d148026d43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'split_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:53.422480785Z [2024-04-06 01:40:53,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[291c43fa-eb9c-4bc4-b541-4558a9e54693] succeeded in 2.6475346050001463s: None 2024-04-06T01:40:53.702141574Z [2024-04-06 01:40:53,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:55.158996324Z [2024-04-06 01:40:55,158: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:40:55.162567227Z [2024-04-06 01:40:55,161: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:55.211802994Z [2024-04-06 01:40:55,211: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:40:55.216426429Z [2024-04-06 01:40:55,216: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:55.217005120Z [2024-04-06 01:40:55,216: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:55.217015101Z [2024-04-06 01:40:55,216: INFO/ForkPoolWorker-16] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:40:55.217132708Z [2024-04-06 01:40:55,216: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:40:55.217164903Z [2024-04-06 01:40:55,217: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:40:55.217417943Z [2024-04-06 01:40:55,217: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:55.217429751Z [2024-04-06 01:40:55,217: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:55.227376715Z [2024-04-06 01:40:55,227: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:40:55.342729860Z [2024-04-06 01:40:55,342: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:55.957499559Z [2024-04-06 01:40:55,957: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[11b717dd-687f-43f0-8d12-22d148026d43] succeeded in 2.6159941169999s: None 2024-04-06T01:40:55.994784146Z [2024-04-06 01:40:55,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[943d46bd-0a15-4b04-adbd-152e1882c8ab] received 2024-04-06T01:40:56.012423719Z [2024-04-06 01:40:56,012: INFO/ForkPoolWorker-15] [943d46bd-0a15-4b04-adbd-152e1882c8ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'collect_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:40:56.390319287Z [2024-04-06 01:40:56,385: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:57.729033751Z [2024-04-06 01:40:57,728: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:57.733391689Z [2024-04-06 01:40:57,732: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:57.763214624Z [2024-04-06 01:40:57,763: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:57.764344175Z [2024-04-06 01:40:57,764: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:40:57.764478731Z [2024-04-06 01:40:57,764: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:40:57.764556360Z [2024-04-06 01:40:57,764: INFO/ForkPoolWorker-15] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:40:57.764769455Z [2024-04-06 01:40:57,764: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:40:57.764879742Z [2024-04-06 01:40:57,764: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:57.765136548Z [2024-04-06 01:40:57,765: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:57.765315775Z [2024-04-06 01:40:57,765: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:40:57.771603771Z [2024-04-06 01:40:57,771: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:40:57.851767127Z [2024-04-06 01:40:57,851: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:58.603618551Z [2024-04-06 01:40:58,603: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[943d46bd-0a15-4b04-adbd-152e1882c8ab] succeeded in 2.6058306340000854s: None 2024-04-06T01:40:59.459235313Z [2024-04-06 01:40:59,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5f12fa1-07d9-4b7c-b1cc-bdd67f305120] received 2024-04-06T01:40:59.470460633Z [2024-04-06 01:40:59,470: INFO/ForkPoolWorker-15] [f5f12fa1-07d9-4b7c-b1cc-bdd67f305120] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'send_prometheus', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:59.774168003Z [2024-04-06 01:40:59,769: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:41:00.931793813Z [2024-04-06 01:41:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efd1484c-208f-4cde-8d20-db153fc9bc9f] received 2024-04-06T01:41:00.934858680Z [2024-04-06 01:41:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e38dff6-4bec-40a3-a479-426d5816cf31] received 2024-04-06T01:41:00.939162899Z [2024-04-06 01:41:00,938: INFO/ForkPoolWorker-16] [efd1484c-208f-4cde-8d20-db153fc9bc9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:41:00.944452044Z [2024-04-06 01:41:00,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5361d3f-32fa-4c44-8f8b-582fdec1c8a9] received 2024-04-06T01:41:00.947759478Z [2024-04-06 01:41:00,947: INFO/ForkPoolWorker-1] [5e38dff6-4bec-40a3-a479-426d5816cf31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:41:00.949780954Z [2024-04-06 01:41:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cc4b3b8-82c8-42ce-8035-2fc1584bb55c] received 2024-04-06T01:41:00.954148568Z [2024-04-06 01:41:00,953: INFO/ForkPoolWorker-2] [d5361d3f-32fa-4c44-8f8b-582fdec1c8a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:41:00.968311680Z [2024-04-06 01:41:00,967: INFO/ForkPoolWorker-3] [9cc4b3b8-82c8-42ce-8035-2fc1584bb55c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:41:01.563591362Z [2024-04-06 01:41:01,558: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:41:01.669658838Z [2024-04-06 01:41:01,669: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:41:01.673935492Z [2024-04-06 01:41:01,672: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:41:01.829244088Z [2024-04-06 01:41:01,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:41:01.837072857Z [2024-04-06 01:41:01,836: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:41:01.837445837Z [2024-04-06 01:41:01,822: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:41:01.840205486Z [2024-04-06 01:41:01,839: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:41:01.841768856Z [2024-04-06 01:41:01,840: INFO/ForkPoolWorker-15] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:41:01.842708744Z [2024-04-06 01:41:01,842: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:41:01.843141655Z [2024-04-06 01:41:01,843: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:41:01.843560244Z [2024-04-06 01:41:01,843: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:41:01.845214922Z [2024-04-06 01:41:01,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:41:01.856613501Z [2024-04-06 01:41:01,856: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:41:01.984342834Z [2024-04-06 01:41:01,984: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:41:02.088331362Z [2024-04-06 01:41:02,070: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:41:02.293905515Z [2024-04-06 01:41:02,285: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:41:04.397192341Z [2024-04-06 01:41:04,396: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5f12fa1-07d9-4b7c-b1cc-bdd67f305120] succeeded in 4.933788828000161s: None 2024-04-06T01:41:04.872195356Z [2024-04-06 01:41:04,871: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:41:04.877153744Z [2024-04-06 01:41:04,876: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:41:04.999770986Z [2024-04-06 01:41:04,999: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:41:05.015354467Z [2024-04-06 01:41:05,015: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:41:05.016086941Z [2024-04-06 01:41:05,015: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:41:05.016286039Z [2024-04-06 01:41:05,016: INFO/ForkPoolWorker-16] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:41:05.016486921Z [2024-04-06 01:41:05,016: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:41:05.016587163Z [2024-04-06 01:41:05,016: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:41:05.017026186Z [2024-04-06 01:41:05,016: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:41:05.017236492Z [2024-04-06 01:41:05,017: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:41:05.022813769Z [2024-04-06 01:41:05,022: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:41:05.350648037Z [2024-04-06 01:41:05,350: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:41:05.772392678Z [2024-04-06 01:41:05,771: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:41:05.776651701Z [2024-04-06 01:41:05,776: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:41:05.860576522Z [2024-04-06 01:41:05,860: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:41:05.875429768Z [2024-04-06 01:41:05,875: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:41:05.875584828Z [2024-04-06 01:41:05,875: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:41:05.875657623Z [2024-04-06 01:41:05,875: INFO/ForkPoolWorker-2] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:41:05.876186892Z [2024-04-06 01:41:05,875: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:41:05.878347994Z [2024-04-06 01:41:05,878: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:41:05.880698939Z [2024-04-06 01:41:05,880: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:41:05.881549476Z [2024-04-06 01:41:05,881: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:41:05.944086609Z [2024-04-06 01:41:05,943: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:41:06.186692977Z [2024-04-06 01:41:06,184: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T01:41:06.208583677Z [2024-04-06 01:41:06,206: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:41:06.337128382Z [2024-04-06 01:41:06,330: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:41:06.455884896Z [2024-04-06 01:41:06,455: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:41:06.464769853Z [2024-04-06 01:41:06,464: INFO/ForkPoolWorker-3] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:41:06.464783475Z [2024-04-06 01:41:06,464: INFO/ForkPoolWorker-3] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:41:06.464825023Z [2024-04-06 01:41:06,464: INFO/ForkPoolWorker-3] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:41:06.468552495Z [2024-04-06 01:41:06,464: INFO/ForkPoolWorker-3] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:41:06.468614219Z [2024-04-06 01:41:06,468: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T01:41:06.468846513Z [2024-04-06 01:41:06,468: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:41:06.468882139Z [2024-04-06 01:41:06,468: INFO/ForkPoolWorker-3] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:41:06.478457119Z [2024-04-06 01:41:06,478: INFO/ForkPoolWorker-3] Creating DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:41:06.858472596Z [2024-04-06 01:41:06,858: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:41:07.456548159Z [2024-04-06 01:41:07,456: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:41:07.463000575Z [2024-04-06 01:41:07,462: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:41:07.526657662Z [2024-04-06 01:41:07,526: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:41:07.531821942Z [2024-04-06 01:41:07,531: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:41:07.531863562Z [2024-04-06 01:41:07,531: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:41:07.531962632Z [2024-04-06 01:41:07,531: INFO/ForkPoolWorker-1] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:41:07.532236957Z [2024-04-06 01:41:07,531: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:41:07.532345731Z [2024-04-06 01:41:07,532: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:41:07.532689461Z [2024-04-06 01:41:07,532: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:41:07.533112854Z [2024-04-06 01:41:07,532: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:41:07.538148903Z [2024-04-06 01:41:07,537: INFO/ForkPoolWorker-1] Creating DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:41:07.771793361Z [2024-04-06 01:41:07,771: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:41:08.843148871Z [2024-04-06 01:41:08,842: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9cc4b3b8-82c8-42ce-8035-2fc1584bb55c] succeeded in 7.8910610620000625s: None 2024-04-06T01:41:09.193970504Z [2024-04-06 01:41:09,193: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5361d3f-32fa-4c44-8f8b-582fdec1c8a9] succeeded in 8.246740086000045s: None 2024-04-06T01:41:09.416029251Z [2024-04-06 01:41:09,414: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[efd1484c-208f-4cde-8d20-db153fc9bc9f] succeeded in 8.481624884999974s: None 2024-04-06T01:41:09.588121452Z [2024-04-06 01:41:09,587: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e38dff6-4bec-40a3-a479-426d5816cf31] succeeded in 8.650204278999809s: None 2024-04-06T01:42:00.803463340Z [2024-04-06 01:42:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1fe4178-08f5-4212-bbc8-17d699f77a3f] received 2024-04-06T01:42:00.803492740Z [2024-04-06 01:42:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1640f572-ec1f-4337-9c69-f1a07479be8e] received 2024-04-06T01:42:00.811832024Z [2024-04-06 01:42:00,811: INFO/ForkPoolWorker-15] [e1fe4178-08f5-4212-bbc8-17d699f77a3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:42:00.814989590Z [2024-04-06 01:42:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa583afc-deb8-4b9c-8e7b-c2690fd4365d] received 2024-04-06T01:42:00.816659902Z [2024-04-06 01:42:00,816: INFO/ForkPoolWorker-16] [1640f572-ec1f-4337-9c69-f1a07479be8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:42:00.818823829Z [2024-04-06 01:42:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[096deb59-a850-45ae-b875-b5591bf77420] received 2024-04-06T01:42:00.822462895Z [2024-04-06 01:42:00,822: INFO/ForkPoolWorker-1] [aa583afc-deb8-4b9c-8e7b-c2690fd4365d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:42:00.829101584Z [2024-04-06 01:42:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7beb5c2a-2fef-4221-a6f9-90ab5a2b5b31] received 2024-04-06T01:42:00.841041242Z [2024-04-06 01:42:00,840: INFO/ForkPoolWorker-2] [096deb59-a850-45ae-b875-b5591bf77420] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:42:00.848065709Z [2024-04-06 01:42:00,847: INFO/ForkPoolWorker-3] [7beb5c2a-2fef-4221-a6f9-90ab5a2b5b31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:42:01.414312325Z [2024-04-06 01:42:01,410: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:42:01.571123481Z [2024-04-06 01:42:01,564: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:42:01.677537300Z [2024-04-06 01:42:01,666: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:42:01.693540550Z [2024-04-06 01:42:01,680: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:42:02.148965008Z [2024-04-06 01:42:02,145: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:42:03.374502228Z [2024-04-06 01:42:03,374: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:42:05.180629867Z [2024-04-06 01:42:05,180: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T01:42:05.184087457Z [2024-04-06 01:42:05,183: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:42:05.288384033Z [2024-04-06 01:42:05,288: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:42:05.290155935Z [2024-04-06 01:42:05,289: INFO/ForkPoolWorker-3] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:42:05.290352375Z [2024-04-06 01:42:05,290: INFO/ForkPoolWorker-3] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:42:05.291257294Z [2024-04-06 01:42:05,291: INFO/ForkPoolWorker-3] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:42:05.291820898Z [2024-04-06 01:42:05,291: INFO/ForkPoolWorker-3] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:42:05.291969937Z [2024-04-06 01:42:05,291: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T01:42:05.292307692Z [2024-04-06 01:42:05,292: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:42:05.292453869Z [2024-04-06 01:42:05,292: INFO/ForkPoolWorker-3] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:42:05.305928568Z [2024-04-06 01:42:05,305: INFO/ForkPoolWorker-3] Creating DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:42:05.376006704Z [2024-04-06 01:42:05,375: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1fe4178-08f5-4212-bbc8-17d699f77a3f] succeeded in 4.5731539799999155s: None 2024-04-06T01:42:05.495684267Z [2024-04-06 01:42:05,495: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:42:06.309670460Z [2024-04-06 01:42:06,309: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:42:06.312954069Z [2024-04-06 01:42:06,312: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:42:06.503432644Z [2024-04-06 01:42:06,503: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:42:06.506555890Z [2024-04-06 01:42:06,506: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:42:06.506582109Z [2024-04-06 01:42:06,506: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:42:06.506622992Z [2024-04-06 01:42:06,506: INFO/ForkPoolWorker-1] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:42:06.506779321Z [2024-04-06 01:42:06,506: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:42:06.506815151Z [2024-04-06 01:42:06,506: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:42:06.507027049Z [2024-04-06 01:42:06,506: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:42:06.507042680Z [2024-04-06 01:42:06,506: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:42:06.512513160Z [2024-04-06 01:42:06,512: INFO/ForkPoolWorker-1] Creating DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:42:06.831757040Z [2024-04-06 01:42:06,831: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:42:06.918079227Z [2024-04-06 01:42:06,917: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:42:06.925676006Z [2024-04-06 01:42:06,925: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:42:07.104003419Z [2024-04-06 01:42:07,103: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:42:07.107962749Z [2024-04-06 01:42:07,107: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:42:07.108588374Z [2024-04-06 01:42:07,107: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:42:07.108726778Z [2024-04-06 01:42:07,108: INFO/ForkPoolWorker-2] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:42:07.108912877Z [2024-04-06 01:42:07,108: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:42:07.109082820Z [2024-04-06 01:42:07,108: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:42:07.109327186Z [2024-04-06 01:42:07,109: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:42:07.109440269Z [2024-04-06 01:42:07,109: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:42:07.115549008Z [2024-04-06 01:42:07,115: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:42:07.122983791Z [2024-04-06 01:42:07,122: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:42:07.128704390Z [2024-04-06 01:42:07,128: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:42:07.230707698Z [2024-04-06 01:42:07,230: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:42:07.231954091Z [2024-04-06 01:42:07,231: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:42:07.232104904Z [2024-04-06 01:42:07,231: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:42:07.232291361Z [2024-04-06 01:42:07,232: INFO/ForkPoolWorker-16] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:42:07.232306442Z [2024-04-06 01:42:07,232: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:42:07.232470379Z [2024-04-06 01:42:07,232: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:42:07.232672326Z [2024-04-06 01:42:07,232: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:42:07.236319893Z [2024-04-06 01:42:07,233: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:42:07.236513085Z [2024-04-06 01:42:07,236: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:42:07.248209727Z [2024-04-06 01:42:07,247: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:42:07.355696998Z [2024-04-06 01:42:07,355: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:42:08.301792801Z [2024-04-06 01:42:08,301: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7beb5c2a-2fef-4221-a6f9-90ab5a2b5b31] succeeded in 7.467015879000201s: None 2024-04-06T01:42:08.790148524Z [2024-04-06 01:42:08,789: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa583afc-deb8-4b9c-8e7b-c2690fd4365d] succeeded in 7.97345892400017s: None 2024-04-06T01:42:09.607443112Z [2024-04-06 01:42:09,606: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1640f572-ec1f-4337-9c69-f1a07479be8e] succeeded in 8.801314262999995s: None 2024-04-06T01:42:10.062464385Z [2024-04-06 01:42:10,062: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[096deb59-a850-45ae-b875-b5591bf77420] succeeded in 9.23036191899996s: None 2024-04-06T01:43:01.122626664Z [2024-04-06 01:43:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73dc016a-3d27-4912-96e4-6574e71301e9] received 2024-04-06T01:43:01.130573192Z [2024-04-06 01:43:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[365cf30e-e687-4128-a4d8-e3f78a8cb23c] received 2024-04-06T01:43:01.143348412Z [2024-04-06 01:43:01,143: INFO/ForkPoolWorker-15] [73dc016a-3d27-4912-96e4-6574e71301e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:43:01.149377149Z [2024-04-06 01:43:01,149: INFO/ForkPoolWorker-16] [365cf30e-e687-4128-a4d8-e3f78a8cb23c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:43:01.170611906Z [2024-04-06 01:43:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[279efcb0-ede1-4076-911d-9f2a09e3ab87] received 2024-04-06T01:43:01.174158501Z [2024-04-06 01:43:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fa40f72-e1d4-4cfa-9eea-9557ca1d56d2] received 2024-04-06T01:43:01.189408231Z [2024-04-06 01:43:01,188: INFO/ForkPoolWorker-1] [279efcb0-ede1-4076-911d-9f2a09e3ab87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:43:01.200258115Z [2024-04-06 01:43:01,199: INFO/ForkPoolWorker-2] [5fa40f72-e1d4-4cfa-9eea-9557ca1d56d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:43:01.696503896Z [2024-04-06 01:43:01,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:43:01.740905988Z [2024-04-06 01:43:01,735: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:43:01.837470456Z [2024-04-06 01:43:01,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:43:02.569981671Z [2024-04-06 01:43:02,565: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:43:04.717147077Z [2024-04-06 01:43:04,716: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:43:04.720435764Z [2024-04-06 01:43:04,720: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:43:04.875142483Z [2024-04-06 01:43:04,874: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:43:04.877011847Z [2024-04-06 01:43:04,876: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:43:04.877056589Z [2024-04-06 01:43:04,876: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:43:04.877108403Z [2024-04-06 01:43:04,877: INFO/ForkPoolWorker-2] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:43:04.886327940Z [2024-04-06 01:43:04,877: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:43:04.886388813Z [2024-04-06 01:43:04,886: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:43:04.886663311Z [2024-04-06 01:43:04,886: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:43:04.892173011Z [2024-04-06 01:43:04,891: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:43:04.901105959Z [2024-04-06 01:43:04,900: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:43:05.049935301Z [2024-04-06 01:43:05,049: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:43:05.383113332Z [2024-04-06 01:43:05,382: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:43:05.411133513Z [2024-04-06 01:43:05,410: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:43:05.652857889Z [2024-04-06 01:43:05,652: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:43:05.677411161Z [2024-04-06 01:43:05,677: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:43:05.677434372Z [2024-04-06 01:43:05,677: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:43:05.677475557Z [2024-04-06 01:43:05,677: INFO/ForkPoolWorker-16] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:43:05.677527716Z [2024-04-06 01:43:05,677: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:43:05.677569320Z [2024-04-06 01:43:05,677: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:43:05.677807557Z [2024-04-06 01:43:05,677: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:43:05.677894607Z [2024-04-06 01:43:05,677: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:43:05.716013502Z [2024-04-06 01:43:05,715: INFO/ForkPoolWorker-16] Creating DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:43:05.981758587Z [2024-04-06 01:43:05,981: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:43:05.994818017Z [2024-04-06 01:43:05,994: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:43:05.999846562Z [2024-04-06 01:43:05,998: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:43:06.099630433Z [2024-04-06 01:43:06,099: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:43:06.114138455Z [2024-04-06 01:43:06,109: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:43:06.116409243Z [2024-04-06 01:43:06,116: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:43:06.118808358Z [2024-04-06 01:43:06,116: INFO/ForkPoolWorker-15] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:43:06.119006208Z [2024-04-06 01:43:06,118: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:43:06.119032709Z [2024-04-06 01:43:06,118: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:43:06.119316378Z [2024-04-06 01:43:06,119: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:43:06.119325381Z [2024-04-06 01:43:06,119: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:43:06.156661693Z [2024-04-06 01:43:06,156: INFO/ForkPoolWorker-15] Creating DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:43:06.205277696Z [2024-04-06 01:43:06,204: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:43:06.220184848Z [2024-04-06 01:43:06,219: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:43:06.347036703Z [2024-04-06 01:43:06,346: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:43:06.352736101Z [2024-04-06 01:43:06,352: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:43:06.352786098Z [2024-04-06 01:43:06,352: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:43:06.352791125Z [2024-04-06 01:43:06,352: INFO/ForkPoolWorker-1] Read VIM 575395ca-dce0-4ed2-a78b-1880936a2544 (basic_08_vim_test) 2024-04-06T01:43:06.352943394Z [2024-04-06 01:43:06,352: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '575395ca-dce0-4ed2-a78b-1880936a2544', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-06T01:43:06.352952950Z [2024-04-06 01:43:06,352: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:43:06.353239711Z [2024-04-06 01:43:06,353: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:43:06.353247340Z [2024-04-06 01:43:06,353: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:43:06.358055162Z [2024-04-06 01:43:06,357: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 2024-04-06T01:43:06.518858830Z [2024-04-06 01:43:06,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:43:06.627622433Z [2024-04-06 01:43:06,627: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:43:08.047993004Z [2024-04-06 01:43:08,047: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5fa40f72-e1d4-4cfa-9eea-9557ca1d56d2] succeeded in 6.867920887999844s: None 2024-04-06T01:43:08.563864878Z [2024-04-06 01:43:08,563: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[365cf30e-e687-4128-a4d8-e3f78a8cb23c] succeeded in 7.428541487000075s: None 2024-04-06T01:43:08.825386161Z [2024-04-06 01:43:08,824: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73dc016a-3d27-4912-96e4-6574e71301e9] succeeded in 7.698348614999986s: None 2024-04-06T01:43:09.278268335Z [2024-04-06 01:43:09,277: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[279efcb0-ede1-4076-911d-9f2a09e3ab87] succeeded in 8.09910972800003s: None 2024-04-06T01:44:01.161212858Z [2024-04-06 01:44:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfff197e-0f13-4f51-a6e5-82ce89b0b183] received 2024-04-06T01:44:01.163383379Z [2024-04-06 01:44:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37c6a5d2-bdee-4fbd-84fc-f517b3a82e1c] received 2024-04-06T01:44:01.169793853Z [2024-04-06 01:44:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ef0b2fb-8a0d-40d1-84c0-6706da9c593f] received 2024-04-06T01:44:01.174402896Z [2024-04-06 01:44:01,174: INFO/ForkPoolWorker-15] [cfff197e-0f13-4f51-a6e5-82ce89b0b183] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:44:01.179371576Z [2024-04-06 01:44:01,179: INFO/ForkPoolWorker-1] [5ef0b2fb-8a0d-40d1-84c0-6706da9c593f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:44:01.182452753Z [2024-04-06 01:44:01,182: INFO/ForkPoolWorker-16] [37c6a5d2-bdee-4fbd-84fc-f517b3a82e1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:44:01.186353068Z [2024-04-06 01:44:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f5e2910-b23f-429f-9e0c-5e00fae16689] received 2024-04-06T01:44:01.199048222Z [2024-04-06 01:44:01,198: INFO/ForkPoolWorker-2] [2f5e2910-b23f-429f-9e0c-5e00fae16689] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:44:01.204265940Z [2024-04-06 01:44:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce503042-bca8-43e9-bc94-5cd6af8f9619] received 2024-04-06T01:44:01.237636343Z [2024-04-06 01:44:01,237: INFO/ForkPoolWorker-3] [ce503042-bca8-43e9-bc94-5cd6af8f9619] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:44:01.536578492Z [2024-04-06 01:44:01,527: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:44:01.909103490Z [2024-04-06 01:44:01,904: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:44:01.974370932Z [2024-04-06 01:44:01,969: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:44:02.299749568Z [2024-04-06 01:44:02,295: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:44:02.301142268Z [2024-04-06 01:44:02,296: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:44:03.604983548Z [2024-04-06 01:44:03,604: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:44:03.831238711Z [2024-04-06 01:44:03,830: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T01:44:03.840419189Z [2024-04-06 01:44:03,838: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:03.885140444Z [2024-04-06 01:44:03,884: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:44:03.886568836Z [2024-04-06 01:44:03,886: INFO/ForkPoolWorker-3] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:03.886715028Z [2024-04-06 01:44:03,886: INFO/ForkPoolWorker-3] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:03.886910007Z [2024-04-06 01:44:03,886: INFO/ForkPoolWorker-3] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:03.887019433Z [2024-04-06 01:44:03,886: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T01:44:03.887329105Z [2024-04-06 01:44:03,887: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:44:03.887750518Z [2024-04-06 01:44:03,887: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:03.987007625Z [2024-04-06 01:44:03,986: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:44:04.929471222Z [2024-04-06 01:44:04,929: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[37c6a5d2-bdee-4fbd-84fc-f517b3a82e1c] succeeded in 3.7538731889999326s: None 2024-04-06T01:44:05.022639773Z [2024-04-06 01:44:05,022: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:44:05.026623532Z [2024-04-06 01:44:05,026: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:05.087655191Z [2024-04-06 01:44:05,087: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:44:05.089927116Z [2024-04-06 01:44:05,089: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:05.090054138Z [2024-04-06 01:44:05,089: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:05.090207064Z [2024-04-06 01:44:05,090: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:05.090274692Z [2024-04-06 01:44:05,090: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:44:05.090526894Z [2024-04-06 01:44:05,090: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:44:05.090688592Z [2024-04-06 01:44:05,090: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:05.166589044Z [2024-04-06 01:44:05,166: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:44:05.577106054Z [2024-04-06 01:44:05,576: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:44:05.580573710Z [2024-04-06 01:44:05,580: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:05.637535343Z [2024-04-06 01:44:05,637: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:44:05.647953228Z [2024-04-06 01:44:05,647: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:05.648199311Z [2024-04-06 01:44:05,648: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:05.648473266Z [2024-04-06 01:44:05,648: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:05.648636603Z [2024-04-06 01:44:05,648: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:44:05.649043527Z [2024-04-06 01:44:05,648: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:44:05.649207475Z [2024-04-06 01:44:05,649: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:05.661353914Z [2024-04-06 01:44:05,661: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:44:05.662551456Z [2024-04-06 01:44:05,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:44:05.663713193Z [2024-04-06 01:44:05,663: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:44:05.666954344Z [2024-04-06 01:44:05,666: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:05.759273078Z [2024-04-06 01:44:05,759: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:44:05.760336330Z [2024-04-06 01:44:05,760: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:05.760421393Z [2024-04-06 01:44:05,760: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:05.760606169Z [2024-04-06 01:44:05,760: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:05.760675421Z [2024-04-06 01:44:05,760: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:44:05.760897795Z [2024-04-06 01:44:05,760: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:44:05.761304147Z [2024-04-06 01:44:05,761: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:05.764425634Z [2024-04-06 01:44:05,763: ERROR/ForkPoolWorker-15] [cfff197e-0f13-4f51-a6e5-82ce89b0b183] Failed to execute task Dag 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:44:05.764438286Z Traceback (most recent call last): 2024-04-06T01:44:05.764442143Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:44:05.764446211Z args.func(args) 2024-04-06T01:44:05.764449782Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:44:05.764453496Z return func(*args, **kwargs) 2024-04-06T01:44:05.764456430Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:44:05.764459471Z return f(*args, **kwargs) 2024-04-06T01:44:05.764462462Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:44:05.764465465Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:44:05.764468347Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:44:05.764471239Z raise AirflowException( 2024-04-06T01:44:05.764474841Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:44:05.883517265Z [2024-04-06 01:44:05,882: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfff197e-0f13-4f51-a6e5-82ce89b0b183] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cfff197e-0f13-4f51-a6e5-82ce89b0b183') 2024-04-06T01:44:05.883534540Z Traceback (most recent call last): 2024-04-06T01:44:05.883538607Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:44:05.883541665Z R = retval = fun(*args, **kwargs) 2024-04-06T01:44:05.883544904Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:44:05.883548210Z return self.run(*args, **kwargs) 2024-04-06T01:44:05.883551924Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:44:05.883555375Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:44:05.883558280Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:44:05.883561797Z raise AirflowException(msg) 2024-04-06T01:44:05.883609663Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cfff197e-0f13-4f51-a6e5-82ce89b0b183 2024-04-06T01:44:05.917307817Z [2024-04-06 01:44:05,916: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:44:05.920044915Z [2024-04-06 01:44:05,919: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:05.982671043Z [2024-04-06 01:44:05,982: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:44:05.983723322Z [2024-04-06 01:44:05,983: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:05.983771280Z [2024-04-06 01:44:05,983: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:05.983936673Z [2024-04-06 01:44:05,983: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:05.983989712Z [2024-04-06 01:44:05,983: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:44:05.984272774Z [2024-04-06 01:44:05,984: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:44:05.984433611Z [2024-04-06 01:44:05,984: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:05.989910363Z [2024-04-06 01:44:05,989: WARNING/ForkPoolWorker-2] Dag 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:44:05.990716372Z [2024-04-06 01:44:05,990: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:44:05.991474130Z [2024-04-06 01:44:05,991: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:44:05.995279866Z [2024-04-06 01:44:05,995: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:06.042900745Z [2024-04-06 01:44:06,042: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:44:06.044655628Z [2024-04-06 01:44:06,044: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:06.044769070Z [2024-04-06 01:44:06,044: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:06.045053074Z [2024-04-06 01:44:06,044: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:06.045117162Z [2024-04-06 01:44:06,045: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:44:06.045396884Z [2024-04-06 01:44:06,045: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:44:06.045515103Z [2024-04-06 01:44:06,045: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:06.050866742Z [2024-04-06 01:44:06,050: ERROR/ForkPoolWorker-2] [2f5e2910-b23f-429f-9e0c-5e00fae16689] Failed to execute task Dag 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:44:06.050879711Z Traceback (most recent call last): 2024-04-06T01:44:06.050883538Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:44:06.050886867Z args.func(args) 2024-04-06T01:44:06.050890405Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:44:06.050905186Z return func(*args, **kwargs) 2024-04-06T01:44:06.050908257Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:44:06.050910922Z return f(*args, **kwargs) 2024-04-06T01:44:06.050913611Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:44:06.050916244Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:44:06.050919043Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:44:06.050921721Z raise AirflowException( 2024-04-06T01:44:06.050925032Z airflow.exceptions.AirflowException: Dag 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:44:06.116593094Z [2024-04-06 01:44:06,116: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2f5e2910-b23f-429f-9e0c-5e00fae16689] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2f5e2910-b23f-429f-9e0c-5e00fae16689') 2024-04-06T01:44:06.116607118Z Traceback (most recent call last): 2024-04-06T01:44:06.116611184Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:44:06.116614377Z R = retval = fun(*args, **kwargs) 2024-04-06T01:44:06.116617485Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:44:06.116620627Z return self.run(*args, **kwargs) 2024-04-06T01:44:06.116624179Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:44:06.116627785Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:44:06.116630989Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:44:06.116634888Z raise AirflowException(msg) 2024-04-06T01:44:06.116638799Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2f5e2910-b23f-429f-9e0c-5e00fae16689 2024-04-06T01:44:07.183245880Z [2024-04-06 01:44:07,181: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ce503042-bca8-43e9-bc94-5cd6af8f9619] succeeded in 5.974222464999912s: None 2024-04-06T01:44:07.579486568Z [2024-04-06 01:44:07,578: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ef0b2fb-8a0d-40d1-84c0-6706da9c593f] succeeded in 6.407844517000058s: None 2024-04-06T01:44:16.943900878Z [2024-04-06 01:44:16,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df9bab30-ad38-4ba6-9c81-26b68de85cbc] received 2024-04-06T01:44:16.952918898Z [2024-04-06 01:44:16,952: INFO/ForkPoolWorker-15] [df9bab30-ad38-4ba6-9c81-26b68de85cbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:44:16.958993580Z [2024-04-06 01:44:16,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0da021d6-a186-428c-a13c-f18dd1bfca73] received 2024-04-06T01:44:16.970990399Z [2024-04-06 01:44:16,970: INFO/ForkPoolWorker-16] [0da021d6-a186-428c-a13c-f18dd1bfca73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:44:17.282786750Z [2024-04-06 01:44:17,279: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:44:17.299472563Z [2024-04-06 01:44:17,295: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:44:18.568635299Z [2024-04-06 01:44:18,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:44:18.571741502Z [2024-04-06 01:44:18,571: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:18.615509034Z [2024-04-06 01:44:18,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:44:18.617343204Z [2024-04-06 01:44:18,616: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:18.617356886Z [2024-04-06 01:44:18,616: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:18.617371798Z [2024-04-06 01:44:18,617: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:18.617375888Z [2024-04-06 01:44:18,617: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:44:18.618017613Z [2024-04-06 01:44:18,617: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:44:18.618029007Z [2024-04-06 01:44:18,617: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:18.630613932Z [2024-04-06 01:44:18,629: WARNING/ForkPoolWorker-15] Dag 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:44:18.630636150Z [2024-04-06 01:44:18,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:44:18.635300989Z [2024-04-06 01:44:18,630: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:44:18.635319263Z [2024-04-06 01:44:18,633: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:18.695089418Z [2024-04-06 01:44:18,687: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:44:18.695109335Z [2024-04-06 01:44:18,688: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:18.695113948Z [2024-04-06 01:44:18,688: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:18.695118562Z [2024-04-06 01:44:18,688: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:18.695122910Z [2024-04-06 01:44:18,688: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:44:18.695126241Z [2024-04-06 01:44:18,689: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:44:18.695129494Z [2024-04-06 01:44:18,689: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:18.695143147Z [2024-04-06 01:44:18,692: ERROR/ForkPoolWorker-15] [df9bab30-ad38-4ba6-9c81-26b68de85cbc] Failed to execute task Dag 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:44:18.695146345Z Traceback (most recent call last): 2024-04-06T01:44:18.695149312Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:44:18.695153362Z args.func(args) 2024-04-06T01:44:18.695156433Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:44:18.695159456Z return func(*args, **kwargs) 2024-04-06T01:44:18.695162409Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:44:18.695165428Z return f(*args, **kwargs) 2024-04-06T01:44:18.695168465Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:44:18.695171885Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:44:18.695175110Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:44:18.695178260Z raise AirflowException( 2024-04-06T01:44:18.695181572Z airflow.exceptions.AirflowException: Dag 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:44:18.733474752Z [2024-04-06 01:44:18,729: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df9bab30-ad38-4ba6-9c81-26b68de85cbc] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id df9bab30-ad38-4ba6-9c81-26b68de85cbc') 2024-04-06T01:44:18.733496365Z Traceback (most recent call last): 2024-04-06T01:44:18.733502256Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:44:18.733505859Z R = retval = fun(*args, **kwargs) 2024-04-06T01:44:18.733508916Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:44:18.733511933Z return self.run(*args, **kwargs) 2024-04-06T01:44:18.733515332Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:44:18.733519088Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:44:18.733522042Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:44:18.733525621Z raise AirflowException(msg) 2024-04-06T01:44:18.733529230Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id df9bab30-ad38-4ba6-9c81-26b68de85cbc 2024-04-06T01:44:18.755450512Z [2024-04-06 01:44:18,755: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:44:18.759187317Z [2024-04-06 01:44:18,758: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:18.800168555Z [2024-04-06 01:44:18,799: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:44:18.801786192Z [2024-04-06 01:44:18,801: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:18.801991412Z [2024-04-06 01:44:18,801: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:18.802037992Z [2024-04-06 01:44:18,801: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:18.802073538Z [2024-04-06 01:44:18,801: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:44:18.802356016Z [2024-04-06 01:44:18,802: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:44:18.802440894Z [2024-04-06 01:44:18,802: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:18.809463314Z [2024-04-06 01:44:18,809: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:44:18.810785785Z [2024-04-06 01:44:18,809: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:44:18.811672136Z [2024-04-06 01:44:18,811: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:44:18.814383147Z [2024-04-06 01:44:18,814: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:18.843736543Z [2024-04-06 01:44:18,843: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:44:18.845099375Z [2024-04-06 01:44:18,844: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:44:18.845112165Z [2024-04-06 01:44:18,845: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:44:18.845380649Z [2024-04-06 01:44:18,845: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:18.845477482Z [2024-04-06 01:44:18,845: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:44:18.845936948Z [2024-04-06 01:44:18,845: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:44:18.846187696Z [2024-04-06 01:44:18,845: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:44:18.850220135Z [2024-04-06 01:44:18,849: ERROR/ForkPoolWorker-16] [0da021d6-a186-428c-a13c-f18dd1bfca73] Failed to execute task Dag 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:44:18.850235748Z Traceback (most recent call last): 2024-04-06T01:44:18.850239823Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:44:18.850243578Z args.func(args) 2024-04-06T01:44:18.850247133Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:44:18.850251256Z return func(*args, **kwargs) 2024-04-06T01:44:18.850254275Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:44:18.850257239Z return f(*args, **kwargs) 2024-04-06T01:44:18.850271948Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:44:18.850287234Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:44:18.850290296Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:44:18.850293168Z raise AirflowException( 2024-04-06T01:44:18.850296823Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:44:18.906461576Z [2024-04-06 01:44:18,905: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0da021d6-a186-428c-a13c-f18dd1bfca73] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0da021d6-a186-428c-a13c-f18dd1bfca73') 2024-04-06T01:44:18.906490136Z Traceback (most recent call last): 2024-04-06T01:44:18.906494440Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:44:18.906497833Z R = retval = fun(*args, **kwargs) 2024-04-06T01:44:18.906500804Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:44:18.906503894Z return self.run(*args, **kwargs) 2024-04-06T01:44:18.906507104Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:44:18.906511428Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:44:18.906514456Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:44:18.906517939Z raise AirflowException(msg) 2024-04-06T01:44:18.906521555Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0da021d6-a186-428c-a13c-f18dd1bfca73 2024-04-06T01:45:01.147613624Z [2024-04-06 01:45:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2f47e35-a1e3-47b2-b582-a75aaeb9c63a] received 2024-04-06T01:45:01.159673898Z [2024-04-06 01:45:01,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e77b35ec-72a0-43cf-b9ed-aa2baa88fc8a] received 2024-04-06T01:45:01.169772325Z [2024-04-06 01:45:01,169: INFO/ForkPoolWorker-16] [e77b35ec-72a0-43cf-b9ed-aa2baa88fc8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:45:01.173334191Z [2024-04-06 01:45:01,173: INFO/ForkPoolWorker-15] [b2f47e35-a1e3-47b2-b582-a75aaeb9c63a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:45:01.174945579Z [2024-04-06 01:45:01,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17e6b355-4088-4bd4-b398-1b6949b99f1f] received 2024-04-06T01:45:01.201015322Z [2024-04-06 01:45:01,200: INFO/ForkPoolWorker-1] [17e6b355-4088-4bd4-b398-1b6949b99f1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:45:01.736251053Z [2024-04-06 01:45:01,732: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:45:01.835373836Z [2024-04-06 01:45:01,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:45:02.067613403Z [2024-04-06 01:45:02,062: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:45:04.934673155Z [2024-04-06 01:45:04,934: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:45:04.938970388Z [2024-04-06 01:45:04,937: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:04.996543191Z [2024-04-06 01:45:04,996: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:45:05.002052614Z [2024-04-06 01:45:04,999: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:45:05.002236085Z [2024-04-06 01:45:05,002: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:45:05.002419986Z [2024-04-06 01:45:05,002: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:05.002529751Z [2024-04-06 01:45:05,002: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:45:05.002826613Z [2024-04-06 01:45:05,002: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:45:05.002958975Z [2024-04-06 01:45:05,002: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:45:05.069281591Z [2024-04-06 01:45:05,068: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:45:05.072364924Z [2024-04-06 01:45:05,071: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:05.092796542Z [2024-04-06 01:45:05,092: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:05.171491642Z [2024-04-06 01:45:05,171: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:45:05.178004640Z [2024-04-06 01:45:05,177: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:45:05.178127173Z [2024-04-06 01:45:05,177: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:45:05.182122326Z [2024-04-06 01:45:05,178: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:05.190172527Z [2024-04-06 01:45:05,182: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:45:05.196649241Z [2024-04-06 01:45:05,196: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:45:05.196898912Z [2024-04-06 01:45:05,196: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:45:05.251395901Z [2024-04-06 01:45:05,251: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:45:05.255544208Z [2024-04-06 01:45:05,254: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:05.321693358Z [2024-04-06 01:45:05,321: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:05.333310481Z [2024-04-06 01:45:05,333: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:45:05.337531101Z [2024-04-06 01:45:05,337: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:45:05.337799588Z [2024-04-06 01:45:05,337: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:45:05.339201622Z [2024-04-06 01:45:05,338: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:05.339359332Z [2024-04-06 01:45:05,339: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:45:05.339707150Z [2024-04-06 01:45:05,339: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:45:05.339875565Z [2024-04-06 01:45:05,339: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:45:05.546069590Z [2024-04-06 01:45:05,545: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:06.382037135Z [2024-04-06 01:45:06,381: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2f47e35-a1e3-47b2-b582-a75aaeb9c63a] succeeded in 5.230120730999943s: None 2024-04-06T01:45:06.716816257Z [2024-04-06 01:45:06,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d94bba60-0b63-457b-9354-e0bbd2ff4940] received 2024-04-06T01:45:06.732829329Z [2024-04-06 01:45:06,732: INFO/ForkPoolWorker-15] [d94bba60-0b63-457b-9354-e0bbd2ff4940] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:45:07.095509276Z [2024-04-06 01:45:07,092: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:45:07.562385680Z [2024-04-06 01:45:07,561: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e77b35ec-72a0-43cf-b9ed-aa2baa88fc8a] succeeded in 6.399162009000065s: None 2024-04-06T01:45:07.614868945Z [2024-04-06 01:45:07,614: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[17e6b355-4088-4bd4-b398-1b6949b99f1f] succeeded in 6.434403320999991s: None 2024-04-06T01:45:08.324471125Z [2024-04-06 01:45:08,324: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:45:08.329570923Z [2024-04-06 01:45:08,329: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:08.355953635Z [2024-04-06 01:45:08,355: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:45:08.357337993Z [2024-04-06 01:45:08,357: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:45:08.357421735Z [2024-04-06 01:45:08,357: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:45:08.357569072Z [2024-04-06 01:45:08,357: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:08.357653384Z [2024-04-06 01:45:08,357: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:45:08.357979908Z [2024-04-06 01:45:08,357: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:45:08.358085346Z [2024-04-06 01:45:08,357: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:45:08.434699483Z [2024-04-06 01:45:08,434: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:09.188871695Z [2024-04-06 01:45:09,187: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d94bba60-0b63-457b-9354-e0bbd2ff4940] succeeded in 2.4681364380001014s: None 2024-04-06T01:45:09.477004783Z [2024-04-06 01:45:09,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0f17175-861b-4f59-bc54-68c4d3995540] received 2024-04-06T01:45:09.488921253Z [2024-04-06 01:45:09,488: INFO/ForkPoolWorker-15] [b0f17175-861b-4f59-bc54-68c4d3995540] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:45:09.856029791Z [2024-04-06 01:45:09,852: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:45:11.143590629Z [2024-04-06 01:45:11,143: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:45:11.146939767Z [2024-04-06 01:45:11,146: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:11.171215264Z [2024-04-06 01:45:11,170: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:45:11.172511441Z [2024-04-06 01:45:11,172: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:45:11.172527339Z [2024-04-06 01:45:11,172: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:45:11.172648079Z [2024-04-06 01:45:11,172: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:11.172678542Z [2024-04-06 01:45:11,172: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:45:11.172921193Z [2024-04-06 01:45:11,172: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:45:11.172935503Z [2024-04-06 01:45:11,172: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:45:11.294284212Z [2024-04-06 01:45:11,293: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:12.987644354Z [2024-04-06 01:45:12,986: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0f17175-861b-4f59-bc54-68c4d3995540] succeeded in 3.5073194280000735s: None 2024-04-06T01:45:13.467523797Z [2024-04-06 01:45:13,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11c41120-a717-4f70-8051-cfd73543bdea] received 2024-04-06T01:45:13.482681949Z [2024-04-06 01:45:13,482: INFO/ForkPoolWorker-15] [11c41120-a717-4f70-8051-cfd73543bdea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:45:13.842963549Z [2024-04-06 01:45:13,839: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:45:15.182791384Z [2024-04-06 01:45:15,182: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:45:15.188460719Z [2024-04-06 01:45:15,188: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:15.236732536Z [2024-04-06 01:45:15,236: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:45:15.240034935Z [2024-04-06 01:45:15,239: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:45:15.242016620Z [2024-04-06 01:45:15,239: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:45:15.242029337Z [2024-04-06 01:45:15,239: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:15.242033249Z [2024-04-06 01:45:15,240: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:45:15.242040341Z [2024-04-06 01:45:15,240: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:45:15.242044346Z [2024-04-06 01:45:15,240: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:45:15.356890630Z [2024-04-06 01:45:15,356: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:15.943102405Z [2024-04-06 01:45:15,942: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11c41120-a717-4f70-8051-cfd73543bdea] succeeded in 2.4680106700000124s: None 2024-04-06T01:46:00.414642550Z [2024-04-06 01:46:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38a69a49-671e-4498-a6de-a706dfd9d256] received 2024-04-06T01:46:00.421107888Z [2024-04-06 01:46:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26b69cd0-5112-495d-8704-6acec45ffb50] received 2024-04-06T01:46:00.432480279Z [2024-04-06 01:46:00,431: INFO/ForkPoolWorker-15] [38a69a49-671e-4498-a6de-a706dfd9d256] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:46:00.432565534Z [2024-04-06 01:46:00,432: INFO/ForkPoolWorker-16] [26b69cd0-5112-495d-8704-6acec45ffb50] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:46:00.436451698Z [2024-04-06 01:46:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edbf4268-98e2-4588-961f-44462b33b631] received 2024-04-06T01:46:00.450169534Z [2024-04-06 01:46:00,449: INFO/ForkPoolWorker-1] [edbf4268-98e2-4588-961f-44462b33b631] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:46:00.801658734Z [2024-04-06 01:46:00,797: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:46:00.863212328Z [2024-04-06 01:46:00,857: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:46:00.978971197Z [2024-04-06 01:46:00,963: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:46:01.354818748Z [2024-04-06 01:46:01,354: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:46:02.660876023Z [2024-04-06 01:46:02,660: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26b69cd0-5112-495d-8704-6acec45ffb50] succeeded in 2.235983061999832s: None 2024-04-06T01:46:03.340108308Z [2024-04-06 01:46:03,339: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:46:03.344287807Z [2024-04-06 01:46:03,343: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:46:03.404037653Z [2024-04-06 01:46:03,403: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:46:03.405797296Z [2024-04-06 01:46:03,405: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:46:03.406555900Z [2024-04-06 01:46:03,405: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:46:03.406714309Z [2024-04-06 01:46:03,406: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:46:03.406798726Z [2024-04-06 01:46:03,406: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:46:03.407041984Z [2024-04-06 01:46:03,406: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:46:03.407448645Z [2024-04-06 01:46:03,407: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:46:03.441534816Z [2024-04-06 01:46:03,441: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:46:03.447593000Z [2024-04-06 01:46:03,447: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:46:03.502196425Z [2024-04-06 01:46:03,501: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:46:03.517681951Z [2024-04-06 01:46:03,517: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:46:03.522550584Z [2024-04-06 01:46:03,522: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:46:03.522580130Z [2024-04-06 01:46:03,522: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:46:03.522721906Z [2024-04-06 01:46:03,522: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:46:03.522815721Z [2024-04-06 01:46:03,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:46:03.523019103Z [2024-04-06 01:46:03,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:46:03.523025530Z [2024-04-06 01:46:03,522: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:46:03.687884819Z [2024-04-06 01:46:03,687: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:46:05.493798385Z [2024-04-06 01:46:05,493: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38a69a49-671e-4498-a6de-a706dfd9d256] succeeded in 5.074067689000003s: None 2024-04-06T01:46:05.632619425Z [2024-04-06 01:46:05,632: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[edbf4268-98e2-4588-961f-44462b33b631] succeeded in 5.19366525800001s: None 2024-04-06T01:47:00.248314745Z [2024-04-06 01:47:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21fab0d9-29e6-4ab4-92ad-0290f6a50a73] received 2024-04-06T01:47:00.254546131Z [2024-04-06 01:47:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33e0b415-c1a7-48ab-9a2e-c25b72908c9e] received 2024-04-06T01:47:00.262331801Z [2024-04-06 01:47:00,260: INFO/ForkPoolWorker-15] [21fab0d9-29e6-4ab4-92ad-0290f6a50a73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:47:00.262597878Z [2024-04-06 01:47:00,262: INFO/ForkPoolWorker-16] [33e0b415-c1a7-48ab-9a2e-c25b72908c9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:47:00.533470331Z [2024-04-06 01:47:00,529: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:47:00.548556818Z [2024-04-06 01:47:00,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:47:01.965374764Z [2024-04-06 01:47:01,965: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:47:01.968964598Z [2024-04-06 01:47:01,968: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:47:02.013021431Z [2024-04-06 01:47:02,012: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:47:02.014433494Z [2024-04-06 01:47:02,014: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:47:02.014482398Z [2024-04-06 01:47:02,014: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:47:02.014602900Z [2024-04-06 01:47:02,014: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:47:02.014657050Z [2024-04-06 01:47:02,014: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:47:02.018516199Z [2024-04-06 01:47:02,018: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:47:02.018574941Z [2024-04-06 01:47:02,018: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:47:02.036395730Z [2024-04-06 01:47:02,036: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:47:02.041116254Z [2024-04-06 01:47:02,040: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:47:02.128011439Z [2024-04-06 01:47:02,127: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:47:02.134726675Z [2024-04-06 01:47:02,133: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:47:02.134769368Z [2024-04-06 01:47:02,134: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:47:02.134970724Z [2024-04-06 01:47:02,134: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:47:02.135028222Z [2024-04-06 01:47:02,134: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:47:02.135173157Z [2024-04-06 01:47:02,134: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:47:02.135188809Z [2024-04-06 01:47:02,134: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:47:02.171077495Z [2024-04-06 01:47:02,170: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:47:02.306597769Z [2024-04-06 01:47:02,306: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:47:04.143080259Z [2024-04-06 01:47:04,142: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33e0b415-c1a7-48ab-9a2e-c25b72908c9e] succeeded in 3.8867437619999237s: None 2024-04-06T01:47:04.449016483Z [2024-04-06 01:47:04,448: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21fab0d9-29e6-4ab4-92ad-0290f6a50a73] succeeded in 4.198042922000013s: None 2024-04-06T01:48:00.969932273Z [2024-04-06 01:48:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6181681d-5f7a-4678-8a68-e16610d1135e] received 2024-04-06T01:48:00.972494986Z [2024-04-06 01:48:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ade278f8-813d-4d26-9bfe-6dd0d3c4ee6b] received 2024-04-06T01:48:00.985627030Z [2024-04-06 01:48:00,985: INFO/ForkPoolWorker-16] [ade278f8-813d-4d26-9bfe-6dd0d3c4ee6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:48:00.986777799Z [2024-04-06 01:48:00,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71f4abcf-bacc-4e8a-9834-f74969ae8155] received 2024-04-06T01:48:01.012077559Z [2024-04-06 01:48:01,011: INFO/ForkPoolWorker-1] [71f4abcf-bacc-4e8a-9834-f74969ae8155] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:48:01.018597121Z [2024-04-06 01:48:01,018: INFO/ForkPoolWorker-15] [6181681d-5f7a-4678-8a68-e16610d1135e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:48:01.435518953Z [2024-04-06 01:48:01,428: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:48:01.473974151Z [2024-04-06 01:48:01,464: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:48:01.521554373Z [2024-04-06 01:48:01,515: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:48:01.932512418Z [2024-04-06 01:48:01,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:48:02.974223143Z [2024-04-06 01:48:02,971: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6181681d-5f7a-4678-8a68-e16610d1135e] succeeded in 1.995922801000006s: None 2024-04-06T01:48:03.304250816Z [2024-04-06 01:48:03,303: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:48:03.308148552Z [2024-04-06 01:48:03,307: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:48:03.374572956Z [2024-04-06 01:48:03,374: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:48:03.376535240Z [2024-04-06 01:48:03,375: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:48:03.376576661Z [2024-04-06 01:48:03,376: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:48:03.376669273Z [2024-04-06 01:48:03,376: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:48:03.376887621Z [2024-04-06 01:48:03,376: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:48:03.377306559Z [2024-04-06 01:48:03,377: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:48:03.377744583Z [2024-04-06 01:48:03,377: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:48:03.462022964Z [2024-04-06 01:48:03,461: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:48:03.583782375Z [2024-04-06 01:48:03,583: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:48:03.587170689Z [2024-04-06 01:48:03,586: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:48:03.642838554Z [2024-04-06 01:48:03,642: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:48:03.647047238Z [2024-04-06 01:48:03,646: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:48:03.647066015Z [2024-04-06 01:48:03,646: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:48:03.647206012Z [2024-04-06 01:48:03,646: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:48:03.647244305Z [2024-04-06 01:48:03,647: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:48:03.647512768Z [2024-04-06 01:48:03,647: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:48:03.647665988Z [2024-04-06 01:48:03,647: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:48:03.784537845Z [2024-04-06 01:48:03,784: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:48:05.541002622Z [2024-04-06 01:48:05,540: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ade278f8-813d-4d26-9bfe-6dd0d3c4ee6b] succeeded in 4.565525159999879s: None 2024-04-06T01:48:05.969001493Z [2024-04-06 01:48:05,968: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[71f4abcf-bacc-4e8a-9834-f74969ae8155] succeeded in 4.976144773999977s: None 2024-04-06T01:49:00.279994662Z [2024-04-06 01:49:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e94698e-4441-450f-bf67-85e81952a304] received 2024-04-06T01:49:00.284885439Z [2024-04-06 01:49:00,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96ad2dde-1d0a-4f4b-ba00-30c02ec35507] received 2024-04-06T01:49:00.293784447Z [2024-04-06 01:49:00,293: INFO/ForkPoolWorker-15] [5e94698e-4441-450f-bf67-85e81952a304] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:49:00.294044956Z [2024-04-06 01:49:00,293: INFO/ForkPoolWorker-16] [96ad2dde-1d0a-4f4b-ba00-30c02ec35507] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:49:00.574859887Z [2024-04-06 01:49:00,571: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:49:00.604942415Z [2024-04-06 01:49:00,600: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:49:02.482873209Z [2024-04-06 01:49:02,482: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:49:02.487628507Z [2024-04-06 01:49:02,487: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:49:02.568025055Z [2024-04-06 01:49:02,567: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:49:02.571020186Z [2024-04-06 01:49:02,570: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:49:02.573976287Z [2024-04-06 01:49:02,570: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:49:02.574209653Z [2024-04-06 01:49:02,573: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:49:02.574322323Z [2024-04-06 01:49:02,574: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:49:02.575117443Z [2024-04-06 01:49:02,574: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:49:02.576918098Z [2024-04-06 01:49:02,575: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:49:02.639171720Z [2024-04-06 01:49:02,638: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:49:02.651857673Z [2024-04-06 01:49:02,651: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:49:02.673162555Z [2024-04-06 01:49:02,672: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:49:02.778494873Z [2024-04-06 01:49:02,778: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:49:02.783711168Z [2024-04-06 01:49:02,783: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:49:02.783849920Z [2024-04-06 01:49:02,783: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:49:02.784075201Z [2024-04-06 01:49:02,783: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:49:02.789711168Z [2024-04-06 01:49:02,789: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:49:02.792057371Z [2024-04-06 01:49:02,791: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:49:02.795097257Z [2024-04-06 01:49:02,794: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:49:03.017118281Z [2024-04-06 01:49:03,016: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:49:05.061603144Z [2024-04-06 01:49:05,061: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5e94698e-4441-450f-bf67-85e81952a304] succeeded in 4.777543347000119s: None 2024-04-06T01:49:05.712237084Z [2024-04-06 01:49:05,711: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[96ad2dde-1d0a-4f4b-ba00-30c02ec35507] succeeded in 5.42447752399994s: None 2024-04-06T01:50:00.814030856Z [2024-04-06 01:50:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6f5aea7-202c-4d2f-bdbe-adc6d7850b2b] received 2024-04-06T01:50:00.818466176Z [2024-04-06 01:50:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf82a052-15ff-4169-bacf-e4bc204ae287] received 2024-04-06T01:50:00.831700479Z [2024-04-06 01:50:00,831: INFO/ForkPoolWorker-15] [b6f5aea7-202c-4d2f-bdbe-adc6d7850b2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:50:00.843496622Z [2024-04-06 01:50:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf3895f6-5e86-4558-9f44-8b36d2b841bb] received 2024-04-06T01:50:00.856745022Z [2024-04-06 01:50:00,856: INFO/ForkPoolWorker-16] [cf82a052-15ff-4169-bacf-e4bc204ae287] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:50:00.857229291Z [2024-04-06 01:50:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb72f4b7-5415-4bf4-9e88-cdd79766ef01] received 2024-04-06T01:50:00.870602848Z [2024-04-06 01:50:00,870: INFO/ForkPoolWorker-1] [cf3895f6-5e86-4558-9f44-8b36d2b841bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:50:00.871667911Z [2024-04-06 01:50:00,871: INFO/ForkPoolWorker-2] [fb72f4b7-5415-4bf4-9e88-cdd79766ef01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:50:01.333363226Z [2024-04-06 01:50:01,322: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:50:01.530409356Z [2024-04-06 01:50:01,521: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:50:01.573798703Z [2024-04-06 01:50:01,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:50:01.825634200Z [2024-04-06 01:50:01,817: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:50:01.873352111Z [2024-04-06 01:50:01,873: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:03.170824609Z [2024-04-06 01:50:03,170: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cf82a052-15ff-4169-bacf-e4bc204ae287] succeeded in 2.342709283000204s: None 2024-04-06T01:50:03.723315662Z [2024-04-06 01:50:03,722: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:50:03.732829917Z [2024-04-06 01:50:03,732: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:03.822953847Z [2024-04-06 01:50:03,822: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:50:03.826490450Z [2024-04-06 01:50:03,826: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:50:03.827115367Z [2024-04-06 01:50:03,826: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:50:03.827358770Z [2024-04-06 01:50:03,827: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:03.827623627Z [2024-04-06 01:50:03,827: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:50:03.827943707Z [2024-04-06 01:50:03,827: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:50:03.828046263Z [2024-04-06 01:50:03,827: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:50:03.965975544Z [2024-04-06 01:50:03,964: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:04.745576784Z [2024-04-06 01:50:04,745: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:50:04.760240050Z [2024-04-06 01:50:04,759: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:04.893743509Z [2024-04-06 01:50:04,893: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:50:04.896335359Z [2024-04-06 01:50:04,896: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:50:04.896460961Z [2024-04-06 01:50:04,896: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:50:04.896626428Z [2024-04-06 01:50:04,896: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:04.896715151Z [2024-04-06 01:50:04,896: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:50:04.910190061Z [2024-04-06 01:50:04,909: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:50:04.910896164Z [2024-04-06 01:50:04,910: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:50:05.029759821Z [2024-04-06 01:50:05,029: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:05.235989351Z [2024-04-06 01:50:05,225: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:50:05.245505830Z [2024-04-06 01:50:05,244: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:05.354960819Z [2024-04-06 01:50:05,354: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:50:05.363105329Z [2024-04-06 01:50:05,362: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:50:05.363226899Z [2024-04-06 01:50:05,363: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:50:05.363436933Z [2024-04-06 01:50:05,363: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:05.363554732Z [2024-04-06 01:50:05,363: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:50:05.370551712Z [2024-04-06 01:50:05,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:50:05.371276605Z [2024-04-06 01:50:05,370: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:50:05.484342000Z [2024-04-06 01:50:05,484: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:06.054734826Z [2024-04-06 01:50:06,054: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf3895f6-5e86-4558-9f44-8b36d2b841bb] succeeded in 5.208083724000062s: None 2024-04-06T01:50:06.258998787Z [2024-04-06 01:50:06,258: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6f5aea7-202c-4d2f-bdbe-adc6d7850b2b] succeeded in 5.437929229000019s: None 2024-04-06T01:50:07.043178109Z [2024-04-06 01:50:07,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc899ed7-773d-497f-99e5-6116258b8bac] received 2024-04-06T01:50:07.052489165Z [2024-04-06 01:50:07,052: INFO/ForkPoolWorker-15] [cc899ed7-773d-497f-99e5-6116258b8bac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:50:07.424741281Z [2024-04-06 01:50:07,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:50:07.438362418Z [2024-04-06 01:50:07,436: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fb72f4b7-5415-4bf4-9e88-cdd79766ef01] succeeded in 6.576560541999925s: None 2024-04-06T01:50:08.569328382Z [2024-04-06 01:50:08,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:50:08.572562420Z [2024-04-06 01:50:08,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:08.612297309Z [2024-04-06 01:50:08,612: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:50:08.621044191Z [2024-04-06 01:50:08,613: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:50:08.621060471Z [2024-04-06 01:50:08,613: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:50:08.621065242Z [2024-04-06 01:50:08,614: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:08.621069681Z [2024-04-06 01:50:08,614: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:50:08.621072841Z [2024-04-06 01:50:08,614: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:50:08.621075945Z [2024-04-06 01:50:08,614: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:50:08.703440165Z [2024-04-06 01:50:08,703: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:09.389960117Z [2024-04-06 01:50:09,389: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc899ed7-773d-497f-99e5-6116258b8bac] succeeded in 2.3447007120000762s: None 2024-04-06T01:50:09.631519397Z [2024-04-06 01:50:09,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77acd554-ecc1-478f-bccc-fcff26ef3cf2] received 2024-04-06T01:50:09.645727605Z [2024-04-06 01:50:09,645: INFO/ForkPoolWorker-15] [77acd554-ecc1-478f-bccc-fcff26ef3cf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:50:09.944669472Z [2024-04-06 01:50:09,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:50:11.023071483Z [2024-04-06 01:50:11,022: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:50:11.026408025Z [2024-04-06 01:50:11,025: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:11.061721652Z [2024-04-06 01:50:11,061: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:50:11.062947616Z [2024-04-06 01:50:11,062: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:50:11.063007937Z [2024-04-06 01:50:11,062: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:50:11.063527894Z [2024-04-06 01:50:11,063: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:11.063599304Z [2024-04-06 01:50:11,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:50:11.063765268Z [2024-04-06 01:50:11,063: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:50:11.063808224Z [2024-04-06 01:50:11,063: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:50:11.163305029Z [2024-04-06 01:50:11,162: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:11.810311229Z [2024-04-06 01:50:11,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6984d141-ab3a-4280-974e-327f5a143dc3] received 2024-04-06T01:50:11.833916546Z [2024-04-06 01:50:11,831: INFO/ForkPoolWorker-16] [6984d141-ab3a-4280-974e-327f5a143dc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:50:11.874501289Z [2024-04-06 01:50:11,874: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77acd554-ecc1-478f-bccc-fcff26ef3cf2] succeeded in 2.2378269470000305s: None 2024-04-06T01:50:12.251249630Z [2024-04-06 01:50:12,247: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:50:13.509243114Z [2024-04-06 01:50:13,508: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:50:13.512575438Z [2024-04-06 01:50:13,512: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:13.538596371Z [2024-04-06 01:50:13,538: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:50:13.540111353Z [2024-04-06 01:50:13,539: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:50:13.540440764Z [2024-04-06 01:50:13,540: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:50:13.540629634Z [2024-04-06 01:50:13,540: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:13.540756174Z [2024-04-06 01:50:13,540: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:50:13.541036938Z [2024-04-06 01:50:13,540: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:50:13.541182858Z [2024-04-06 01:50:13,541: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:50:13.620064958Z [2024-04-06 01:50:13,618: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:14.247216282Z [2024-04-06 01:50:14,246: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6984d141-ab3a-4280-974e-327f5a143dc3] succeeded in 2.432034652000084s: None 2024-04-06T01:51:01.261665954Z [2024-04-06 01:51:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8b8f87f-a593-4a91-ab7a-9f3fbc6cc7ee] received 2024-04-06T01:51:01.277567026Z [2024-04-06 01:51:01,277: INFO/ForkPoolWorker-15] [e8b8f87f-a593-4a91-ab7a-9f3fbc6cc7ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:51:01.281317320Z [2024-04-06 01:51:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e5866d1-dfc9-4277-938d-17d8361e9f91] received 2024-04-06T01:51:01.291415080Z [2024-04-06 01:51:01,291: INFO/ForkPoolWorker-16] [8e5866d1-dfc9-4277-938d-17d8361e9f91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:51:01.604849725Z [2024-04-06 01:51:01,601: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:51:01.662881773Z [2024-04-06 01:51:01,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:51:03.010968942Z [2024-04-06 01:51:03,010: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:51:03.020691651Z [2024-04-06 01:51:03,020: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:51:03.035360743Z [2024-04-06 01:51:03,035: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:51:03.038738041Z [2024-04-06 01:51:03,038: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:51:03.064219053Z [2024-04-06 01:51:03,063: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:51:03.065531480Z [2024-04-06 01:51:03,065: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:51:03.065658927Z [2024-04-06 01:51:03,065: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:51:03.066103073Z [2024-04-06 01:51:03,065: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:51:03.066732395Z [2024-04-06 01:51:03,066: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:51:03.067191066Z [2024-04-06 01:51:03,067: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:51:03.067325195Z [2024-04-06 01:51:03,067: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:51:03.077515605Z [2024-04-06 01:51:03,077: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:51:03.078587045Z [2024-04-06 01:51:03,078: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:51:03.078714934Z [2024-04-06 01:51:03,078: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:51:03.078890710Z [2024-04-06 01:51:03,078: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:51:03.079008888Z [2024-04-06 01:51:03,078: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:51:03.079382059Z [2024-04-06 01:51:03,079: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:51:03.079476685Z [2024-04-06 01:51:03,079: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:51:03.170340636Z [2024-04-06 01:51:03,170: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:51:03.179967948Z [2024-04-06 01:51:03,179: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:51:04.726742300Z [2024-04-06 01:51:04,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8b8f87f-a593-4a91-ab7a-9f3fbc6cc7ee] succeeded in 3.461712959999886s: None 2024-04-06T01:51:05.308204314Z [2024-04-06 01:51:05,307: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e5866d1-dfc9-4277-938d-17d8361e9f91] succeeded in 4.024286932999985s: None 2024-04-06T01:52:00.585339342Z [2024-04-06 01:52:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85de58c3-d8c8-4856-bc59-820f8870be99] received 2024-04-06T01:52:00.587786036Z [2024-04-06 01:52:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e06b8897-f2f8-4b9c-b9c8-cf2d299dac48] received 2024-04-06T01:52:00.600838819Z [2024-04-06 01:52:00,600: INFO/ForkPoolWorker-15] [85de58c3-d8c8-4856-bc59-820f8870be99] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:52:00.601494662Z [2024-04-06 01:52:00,601: INFO/ForkPoolWorker-16] [e06b8897-f2f8-4b9c-b9c8-cf2d299dac48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:52:00.614064101Z [2024-04-06 01:52:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc795500-e996-40f7-98b6-cdc8ad961cb1] received 2024-04-06T01:52:00.633763981Z [2024-04-06 01:52:00,633: INFO/ForkPoolWorker-1] [bc795500-e996-40f7-98b6-cdc8ad961cb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:52:00.944182891Z [2024-04-06 01:52:00,940: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:52:01.148611997Z [2024-04-06 01:52:01,144: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:52:01.171291380Z [2024-04-06 01:52:01,167: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:52:01.216615111Z [2024-04-06 01:52:01,216: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:52:01.975258621Z [2024-04-06 01:52:01,974: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85de58c3-d8c8-4856-bc59-820f8870be99] succeeded in 1.3849918500000058s: None 2024-04-06T01:52:02.914671068Z [2024-04-06 01:52:02,914: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:52:02.919544070Z [2024-04-06 01:52:02,919: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:52:02.989804675Z [2024-04-06 01:52:02,989: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:52:02.994716045Z [2024-04-06 01:52:02,994: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:52:02.994735842Z [2024-04-06 01:52:02,994: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:52:02.994840447Z [2024-04-06 01:52:02,994: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:52:02.994868178Z [2024-04-06 01:52:02,994: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:52:02.995099326Z [2024-04-06 01:52:02,994: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:52:02.995114053Z [2024-04-06 01:52:02,995: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:52:03.096918190Z [2024-04-06 01:52:03,096: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:52:03.117737989Z [2024-04-06 01:52:03,117: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:52:03.123642488Z [2024-04-06 01:52:03,123: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:52:03.178592460Z [2024-04-06 01:52:03,178: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:52:03.181179262Z [2024-04-06 01:52:03,180: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:52:03.181200937Z [2024-04-06 01:52:03,181: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:52:03.181318137Z [2024-04-06 01:52:03,181: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:52:03.181330527Z [2024-04-06 01:52:03,181: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:52:03.181670651Z [2024-04-06 01:52:03,181: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:52:03.181684878Z [2024-04-06 01:52:03,181: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:52:03.299312483Z [2024-04-06 01:52:03,299: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:52:04.790647907Z [2024-04-06 01:52:04,790: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e06b8897-f2f8-4b9c-b9c8-cf2d299dac48] succeeded in 4.199265839999953s: None 2024-04-06T01:52:05.797919137Z [2024-04-06 01:52:05,796: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bc795500-e996-40f7-98b6-cdc8ad961cb1] succeeded in 5.1748016760000155s: None 2024-04-06T01:53:00.870014356Z [2024-04-06 01:53:00,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc20f2d1-4329-4205-a78c-295f01eeeb0e] received 2024-04-06T01:53:00.888368875Z [2024-04-06 01:53:00,888: INFO/ForkPoolWorker-15] [bc20f2d1-4329-4205-a78c-295f01eeeb0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:53:00.925452752Z [2024-04-06 01:53:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad1932f6-d4af-4a10-9589-38ef7ca03198] received 2024-04-06T01:53:00.941458104Z [2024-04-06 01:53:00,941: INFO/ForkPoolWorker-16] [ad1932f6-d4af-4a10-9589-38ef7ca03198] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:53:01.403397083Z [2024-04-06 01:53:01,394: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:53:01.423356294Z [2024-04-06 01:53:01,419: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:53:03.215643589Z [2024-04-06 01:53:03,215: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:53:03.225950989Z [2024-04-06 01:53:03,219: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:53:03.225990252Z [2024-04-06 01:53:03,222: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:53:03.233715795Z [2024-04-06 01:53:03,231: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:53:03.265062944Z [2024-04-06 01:53:03,264: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:53:03.268735260Z [2024-04-06 01:53:03,268: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:53:03.268823057Z [2024-04-06 01:53:03,268: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:53:03.269011640Z [2024-04-06 01:53:03,268: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:53:03.269093651Z [2024-04-06 01:53:03,268: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:53:03.270382754Z [2024-04-06 01:53:03,270: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:53:03.270457595Z [2024-04-06 01:53:03,270: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:53:03.290433465Z [2024-04-06 01:53:03,290: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:53:03.294771514Z [2024-04-06 01:53:03,294: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:53:03.294945917Z [2024-04-06 01:53:03,294: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:53:03.295135933Z [2024-04-06 01:53:03,294: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:53:03.295218839Z [2024-04-06 01:53:03,295: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:53:03.295658652Z [2024-04-06 01:53:03,295: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:53:03.295765176Z [2024-04-06 01:53:03,295: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:53:03.364791978Z [2024-04-06 01:53:03,364: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:53:03.404145377Z [2024-04-06 01:53:03,403: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:53:05.303328560Z [2024-04-06 01:53:05,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc20f2d1-4329-4205-a78c-295f01eeeb0e] succeeded in 4.4288885389998995s: None 2024-04-06T01:53:05.725602610Z [2024-04-06 01:53:05,725: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad1932f6-d4af-4a10-9589-38ef7ca03198] succeeded in 4.7970271419999335s: None 2024-04-06T01:54:00.310993763Z [2024-04-06 01:54:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca124b73-12e9-45aa-b691-2ffd0c605640] received 2024-04-06T01:54:00.313197791Z [2024-04-06 01:54:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e89e5849-fd31-4a4c-b875-fc3fb12c22d8] received 2024-04-06T01:54:00.315218044Z [2024-04-06 01:54:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20805d6a-ab08-46e8-95b7-338800f414cd] received 2024-04-06T01:54:00.337958401Z [2024-04-06 01:54:00,337: INFO/ForkPoolWorker-15] [ca124b73-12e9-45aa-b691-2ffd0c605640] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:54:00.338460827Z [2024-04-06 01:54:00,337: INFO/ForkPoolWorker-16] [e89e5849-fd31-4a4c-b875-fc3fb12c22d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:54:00.347965514Z [2024-04-06 01:54:00,347: INFO/ForkPoolWorker-1] [20805d6a-ab08-46e8-95b7-338800f414cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:54:00.668861162Z [2024-04-06 01:54:00,664: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:54:00.669770323Z [2024-04-06 01:54:00,665: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:54:00.727854309Z [2024-04-06 01:54:00,722: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:54:01.049224082Z [2024-04-06 01:54:01,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:54:01.831422136Z [2024-04-06 01:54:01,830: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca124b73-12e9-45aa-b691-2ffd0c605640] succeeded in 1.5165867559999242s: None 2024-04-06T01:54:02.626526897Z [2024-04-06 01:54:02,626: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:54:02.630032974Z [2024-04-06 01:54:02,629: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:54:02.707702028Z [2024-04-06 01:54:02,707: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:54:02.710061193Z [2024-04-06 01:54:02,709: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:54:02.710100935Z [2024-04-06 01:54:02,710: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:54:02.710248854Z [2024-04-06 01:54:02,710: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:54:02.710303289Z [2024-04-06 01:54:02,710: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:54:02.710547091Z [2024-04-06 01:54:02,710: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:54:02.710988214Z [2024-04-06 01:54:02,710: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:54:02.858102864Z [2024-04-06 01:54:02,857: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:54:03.282842946Z [2024-04-06 01:54:03,282: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:54:03.292203863Z [2024-04-06 01:54:03,291: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:54:03.355459450Z [2024-04-06 01:54:03,355: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:54:03.359032918Z [2024-04-06 01:54:03,358: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:54:03.359069175Z [2024-04-06 01:54:03,358: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:54:03.359141673Z [2024-04-06 01:54:03,358: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:54:03.359205283Z [2024-04-06 01:54:03,359: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:54:03.359427094Z [2024-04-06 01:54:03,359: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:54:03.359471922Z [2024-04-06 01:54:03,359: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:54:03.467519441Z [2024-04-06 01:54:03,467: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:54:05.094325307Z [2024-04-06 01:54:05,093: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e89e5849-fd31-4a4c-b875-fc3fb12c22d8] succeeded in 4.7744391760002145s: None 2024-04-06T01:54:05.499117719Z [2024-04-06 01:54:05,498: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20805d6a-ab08-46e8-95b7-338800f414cd] succeeded in 5.175336828000127s: None 2024-04-06T01:55:01.198123522Z [2024-04-06 01:55:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35c2946e-1e82-41b5-bb0a-2d19faba45a1] received 2024-04-06T01:55:01.202386371Z [2024-04-06 01:55:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97008b10-eaa7-4c29-9912-bfc4cff6e92e] received 2024-04-06T01:55:01.207082344Z [2024-04-06 01:55:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c262c7ce-bfa6-4f02-af66-91639f5b53d4] received 2024-04-06T01:55:01.223894486Z [2024-04-06 01:55:01,223: INFO/ForkPoolWorker-15] [35c2946e-1e82-41b5-bb0a-2d19faba45a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:55:01.228496906Z [2024-04-06 01:55:01,228: INFO/ForkPoolWorker-16] [97008b10-eaa7-4c29-9912-bfc4cff6e92e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:55:01.230149915Z [2024-04-06 01:55:01,228: INFO/ForkPoolWorker-1] [c262c7ce-bfa6-4f02-af66-91639f5b53d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:55:01.584558125Z [2024-04-06 01:55:01,580: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:55:01.618047075Z [2024-04-06 01:55:01,614: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:55:01.902022147Z [2024-04-06 01:55:01,894: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:55:03.472250884Z [2024-04-06 01:55:03,471: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:55:03.477708638Z [2024-04-06 01:55:03,477: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:03.510547451Z [2024-04-06 01:55:03,510: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:55:03.511787133Z [2024-04-06 01:55:03,511: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:55:03.511940155Z [2024-04-06 01:55:03,511: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:55:03.512311351Z [2024-04-06 01:55:03,511: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:03.512468531Z [2024-04-06 01:55:03,512: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:55:03.512773236Z [2024-04-06 01:55:03,512: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:55:03.513761733Z [2024-04-06 01:55:03,513: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:55:03.576063591Z [2024-04-06 01:55:03,575: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:55:03.580172394Z [2024-04-06 01:55:03,579: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:03.597997016Z [2024-04-06 01:55:03,597: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:03.635072062Z [2024-04-06 01:55:03,634: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:55:03.637185474Z [2024-04-06 01:55:03,636: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:55:03.642250958Z [2024-04-06 01:55:03,642: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:55:03.642557843Z [2024-04-06 01:55:03,642: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:03.642673416Z [2024-04-06 01:55:03,642: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:55:03.643553916Z [2024-04-06 01:55:03,643: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:55:03.644539194Z [2024-04-06 01:55:03,644: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:55:03.870004406Z [2024-04-06 01:55:03,869: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:04.399187201Z [2024-04-06 01:55:04,398: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97008b10-eaa7-4c29-9912-bfc4cff6e92e] succeeded in 3.194396592999965s: None 2024-04-06T01:55:04.400544231Z [2024-04-06 01:55:04,400: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:55:04.403992473Z [2024-04-06 01:55:04,403: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:04.479589868Z [2024-04-06 01:55:04,479: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:55:04.484924810Z [2024-04-06 01:55:04,482: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:55:04.485136967Z [2024-04-06 01:55:04,484: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:55:04.485362933Z [2024-04-06 01:55:04,485: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:04.485651294Z [2024-04-06 01:55:04,485: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:55:04.489965776Z [2024-04-06 01:55:04,489: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:55:04.490129266Z [2024-04-06 01:55:04,489: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:55:04.599728924Z [2024-04-06 01:55:04,599: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:05.234914666Z [2024-04-06 01:55:05,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f376083-8b24-45ad-92d5-ee21cd115626] received 2024-04-06T01:55:05.258429781Z [2024-04-06 01:55:05,258: INFO/ForkPoolWorker-16] [8f376083-8b24-45ad-92d5-ee21cd115626] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:55:05.634655860Z [2024-04-06 01:55:05,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35c2946e-1e82-41b5-bb0a-2d19faba45a1] succeeded in 4.429191424000237s: None 2024-04-06T01:55:05.677421186Z [2024-04-06 01:55:05,673: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:55:06.806340436Z [2024-04-06 01:55:06,805: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:55:06.809662435Z [2024-04-06 01:55:06,809: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:06.843883273Z [2024-04-06 01:55:06,843: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:55:06.845613960Z [2024-04-06 01:55:06,845: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:55:06.846016771Z [2024-04-06 01:55:06,845: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:55:06.846326688Z [2024-04-06 01:55:06,846: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:06.846529405Z [2024-04-06 01:55:06,846: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:55:06.846834070Z [2024-04-06 01:55:06,846: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:55:06.847000567Z [2024-04-06 01:55:06,846: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:55:06.948505773Z [2024-04-06 01:55:06,948: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:07.353040108Z [2024-04-06 01:55:07,352: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c262c7ce-bfa6-4f02-af66-91639f5b53d4] succeeded in 6.142572996000126s: None 2024-04-06T01:55:07.632724678Z [2024-04-06 01:55:07,632: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8f376083-8b24-45ad-92d5-ee21cd115626] succeeded in 2.393940964000194s: None 2024-04-06T01:55:07.650579796Z [2024-04-06 01:55:07,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41603358-6f0b-4c21-8b6b-4e0fa5176793] received 2024-04-06T01:55:07.657162900Z [2024-04-06 01:55:07,656: INFO/ForkPoolWorker-15] [41603358-6f0b-4c21-8b6b-4e0fa5176793] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:55:07.960796497Z [2024-04-06 01:55:07,957: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:55:09.251448378Z [2024-04-06 01:55:09,250: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:55:09.261436829Z [2024-04-06 01:55:09,253: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:09.291454385Z [2024-04-06 01:55:09,291: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:55:09.293630222Z [2024-04-06 01:55:09,293: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:55:09.293856495Z [2024-04-06 01:55:09,293: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:55:09.294194287Z [2024-04-06 01:55:09,293: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:09.294361158Z [2024-04-06 01:55:09,294: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:55:09.294822708Z [2024-04-06 01:55:09,294: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:55:09.295681340Z [2024-04-06 01:55:09,295: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:55:09.388847469Z [2024-04-06 01:55:09,388: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:09.912394317Z [2024-04-06 01:55:09,911: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41603358-6f0b-4c21-8b6b-4e0fa5176793] succeeded in 2.2600217570002314s: None 2024-04-06T01:55:10.190221845Z [2024-04-06 01:55:10,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b322b6bd-746b-4447-9d8e-c925029af700] received 2024-04-06T01:55:10.207243086Z [2024-04-06 01:55:10,206: INFO/ForkPoolWorker-15] [b322b6bd-746b-4447-9d8e-c925029af700] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:55:10.499525646Z [2024-04-06 01:55:10,496: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:55:11.947929562Z [2024-04-06 01:55:11,947: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:55:11.951682022Z [2024-04-06 01:55:11,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:12.020468532Z [2024-04-06 01:55:12,020: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:55:12.022010459Z [2024-04-06 01:55:12,021: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:55:12.022157165Z [2024-04-06 01:55:12,021: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:55:12.022460264Z [2024-04-06 01:55:12,022: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:12.022575296Z [2024-04-06 01:55:12,022: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:55:12.023018844Z [2024-04-06 01:55:12,022: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:55:12.023200608Z [2024-04-06 01:55:12,022: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:55:12.140227180Z [2024-04-06 01:55:12,139: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:12.874839988Z [2024-04-06 01:55:12,873: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b322b6bd-746b-4447-9d8e-c925029af700] succeeded in 2.6772671730000184s: None 2024-04-06T01:56:01.075122306Z [2024-04-06 01:56:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cd0c42d-f0f4-4cb1-9065-ab3cfb0efb50] received 2024-04-06T01:56:01.086697839Z [2024-04-06 01:56:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[343d77e1-ab1a-4bfe-a3e5-117709c229f3] received 2024-04-06T01:56:01.092917034Z [2024-04-06 01:56:01,088: INFO/ForkPoolWorker-15] [8cd0c42d-f0f4-4cb1-9065-ab3cfb0efb50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:56:01.098118939Z [2024-04-06 01:56:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[918e3f99-712a-4194-8004-cfebd9be7de3] received 2024-04-06T01:56:01.099410380Z [2024-04-06 01:56:01,099: INFO/ForkPoolWorker-16] [343d77e1-ab1a-4bfe-a3e5-117709c229f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:56:01.111419524Z [2024-04-06 01:56:01,111: INFO/ForkPoolWorker-1] [918e3f99-712a-4194-8004-cfebd9be7de3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:56:01.519272200Z [2024-04-06 01:56:01,515: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:56:01.580642072Z [2024-04-06 01:56:01,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:56:01.811203986Z [2024-04-06 01:56:01,806: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:56:02.075678548Z [2024-04-06 01:56:02,075: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:56:03.210350779Z [2024-04-06 01:56:03,209: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[918e3f99-712a-4194-8004-cfebd9be7de3] succeeded in 2.107484563000071s: None 2024-04-06T01:56:03.650806266Z [2024-04-06 01:56:03,650: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:56:03.654338262Z [2024-04-06 01:56:03,653: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:56:03.717927477Z [2024-04-06 01:56:03,717: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:56:03.719090570Z [2024-04-06 01:56:03,718: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:56:03.719254367Z [2024-04-06 01:56:03,719: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:56:03.719554072Z [2024-04-06 01:56:03,719: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:56:03.719822327Z [2024-04-06 01:56:03,719: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:56:03.720149549Z [2024-04-06 01:56:03,720: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:56:03.720532053Z [2024-04-06 01:56:03,720: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:56:03.814852403Z [2024-04-06 01:56:03,814: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:56:04.400805305Z [2024-04-06 01:56:04,400: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:56:04.407191842Z [2024-04-06 01:56:04,406: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:56:04.457111148Z [2024-04-06 01:56:04,456: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:56:04.458148363Z [2024-04-06 01:56:04,457: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:56:04.458229112Z [2024-04-06 01:56:04,458: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:56:04.458366908Z [2024-04-06 01:56:04,458: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:56:04.458438821Z [2024-04-06 01:56:04,458: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:56:04.458659515Z [2024-04-06 01:56:04,458: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:56:04.458751184Z [2024-04-06 01:56:04,458: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:56:04.530623717Z [2024-04-06 01:56:04,530: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:56:06.172088944Z [2024-04-06 01:56:06,171: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8cd0c42d-f0f4-4cb1-9065-ab3cfb0efb50] succeeded in 5.092099276000226s: None 2024-04-06T01:56:07.146331388Z [2024-04-06 01:56:07,145: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[343d77e1-ab1a-4bfe-a3e5-117709c229f3] succeeded in 6.055599204000373s: None 2024-04-06T01:57:00.959012396Z [2024-04-06 01:57:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25ee221e-c11f-43c3-a44a-4e55d25d7cc6] received 2024-04-06T01:57:00.968170847Z [2024-04-06 01:57:00,967: INFO/ForkPoolWorker-15] [25ee221e-c11f-43c3-a44a-4e55d25d7cc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:57:00.977353051Z [2024-04-06 01:57:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5944c543-d338-4302-bd60-b12a09f65cb4] received 2024-04-06T01:57:00.994237405Z [2024-04-06 01:57:00,993: INFO/ForkPoolWorker-16] [5944c543-d338-4302-bd60-b12a09f65cb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:57:01.387487468Z [2024-04-06 01:57:01,384: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:57:01.392585339Z [2024-04-06 01:57:01,389: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:57:02.822705877Z [2024-04-06 01:57:02,822: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:57:02.827529369Z [2024-04-06 01:57:02,827: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:57:02.866693875Z [2024-04-06 01:57:02,866: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:57:02.867811310Z [2024-04-06 01:57:02,867: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:57:02.867894700Z [2024-04-06 01:57:02,867: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:57:02.868181359Z [2024-04-06 01:57:02,867: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:57:02.868263086Z [2024-04-06 01:57:02,868: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:57:02.868596643Z [2024-04-06 01:57:02,868: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:57:02.868606201Z [2024-04-06 01:57:02,868: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:57:02.927549145Z [2024-04-06 01:57:02,927: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:57:02.931164312Z [2024-04-06 01:57:02,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:57:02.941040308Z [2024-04-06 01:57:02,940: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:57:02.967092849Z [2024-04-06 01:57:02,966: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:57:02.968114905Z [2024-04-06 01:57:02,967: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:57:02.968164883Z [2024-04-06 01:57:02,968: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:57:02.968329172Z [2024-04-06 01:57:02,968: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:57:02.968371370Z [2024-04-06 01:57:02,968: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:57:02.968601539Z [2024-04-06 01:57:02,968: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:57:02.968754798Z [2024-04-06 01:57:02,968: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:57:03.070310410Z [2024-04-06 01:57:03,070: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:57:04.737647869Z [2024-04-06 01:57:04,737: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25ee221e-c11f-43c3-a44a-4e55d25d7cc6] succeeded in 3.776509864000218s: None 2024-04-06T01:57:05.441377718Z [2024-04-06 01:57:05,440: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5944c543-d338-4302-bd60-b12a09f65cb4] succeeded in 4.46185651199994s: None 2024-04-06T01:58:00.235451327Z [2024-04-06 01:58:00,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efc3d5ce-b0fa-4f24-be7c-4db2acacac90] received 2024-04-06T01:58:00.244573808Z [2024-04-06 01:58:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b65c2d32-e754-4c4d-83fa-86cb9be4214c] received 2024-04-06T01:58:00.247693128Z [2024-04-06 01:58:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96e2f0a6-a966-41e8-9b83-f953e25b6a91] received 2024-04-06T01:58:00.261994882Z [2024-04-06 01:58:00,261: INFO/ForkPoolWorker-15] [efc3d5ce-b0fa-4f24-be7c-4db2acacac90] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:58:00.267315833Z [2024-04-06 01:58:00,267: INFO/ForkPoolWorker-16] [b65c2d32-e754-4c4d-83fa-86cb9be4214c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:58:00.273630747Z [2024-04-06 01:58:00,273: INFO/ForkPoolWorker-1] [96e2f0a6-a966-41e8-9b83-f953e25b6a91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:58:00.564417693Z [2024-04-06 01:58:00,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:58:00.611184039Z [2024-04-06 01:58:00,606: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:58:00.658654394Z [2024-04-06 01:58:00,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:58:00.986924033Z [2024-04-06 01:58:00,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:58:01.825867107Z [2024-04-06 01:58:01,825: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[efc3d5ce-b0fa-4f24-be7c-4db2acacac90] succeeded in 1.5824951119998332s: None 2024-04-06T01:58:02.299710160Z [2024-04-06 01:58:02,299: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:58:02.310636796Z [2024-04-06 01:58:02,310: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:58:02.345252612Z [2024-04-06 01:58:02,344: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:58:02.349573851Z [2024-04-06 01:58:02,349: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:58:02.457314410Z [2024-04-06 01:58:02,457: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:58:02.457884391Z [2024-04-06 01:58:02,457: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:58:02.458427536Z [2024-04-06 01:58:02,458: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:58:02.458463529Z [2024-04-06 01:58:02,458: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:58:02.458586360Z [2024-04-06 01:58:02,458: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:58:02.458647676Z [2024-04-06 01:58:02,458: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:58:02.458818246Z [2024-04-06 01:58:02,458: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:58:02.458844560Z [2024-04-06 01:58:02,458: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:58:02.464776807Z [2024-04-06 01:58:02,464: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:58:02.466092401Z [2024-04-06 01:58:02,465: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:58:02.470263344Z [2024-04-06 01:58:02,467: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:58:02.470339529Z [2024-04-06 01:58:02,470: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:58:02.470704299Z [2024-04-06 01:58:02,470: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:58:02.474626959Z [2024-04-06 01:58:02,474: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:58:02.584127182Z [2024-04-06 01:58:02,583: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:58:02.596676043Z [2024-04-06 01:58:02,596: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:58:05.142020618Z [2024-04-06 01:58:05,141: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b65c2d32-e754-4c4d-83fa-86cb9be4214c] succeeded in 4.894639109999844s: None 2024-04-06T01:58:06.344710259Z [2024-04-06 01:58:06,344: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[96e2f0a6-a966-41e8-9b83-f953e25b6a91] succeeded in 6.092921481999838s: None 2024-04-06T01:59:00.483631217Z [2024-04-06 01:59:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d41b5458-ee18-4bd5-89cc-76d7ceb41d3a] received 2024-04-06T01:59:00.487100960Z [2024-04-06 01:59:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50d4db5e-7016-4cc0-8c7a-73fa10f1549c] received 2024-04-06T01:59:00.502034499Z [2024-04-06 01:59:00,501: INFO/ForkPoolWorker-16] [50d4db5e-7016-4cc0-8c7a-73fa10f1549c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:59:00.507371107Z [2024-04-06 01:59:00,506: INFO/ForkPoolWorker-15] [d41b5458-ee18-4bd5-89cc-76d7ceb41d3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:59:00.823144723Z [2024-04-06 01:59:00,816: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:59:00.839565206Z [2024-04-06 01:59:00,835: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:59:02.426911523Z [2024-04-06 01:59:02,426: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:59:02.430254899Z [2024-04-06 01:59:02,429: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:59:02.457111278Z [2024-04-06 01:59:02,456: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:59:02.458486679Z [2024-04-06 01:59:02,458: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:59:02.458504675Z [2024-04-06 01:59:02,458: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:59:02.458634259Z [2024-04-06 01:59:02,458: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:59:02.458652608Z [2024-04-06 01:59:02,458: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:59:02.458891507Z [2024-04-06 01:59:02,458: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:59:02.458902994Z [2024-04-06 01:59:02,458: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:59:02.617700179Z [2024-04-06 01:59:02,617: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:59:02.754507649Z [2024-04-06 01:59:02,754: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:59:02.757920194Z [2024-04-06 01:59:02,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:59:02.818872882Z [2024-04-06 01:59:02,818: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:59:02.820747006Z [2024-04-06 01:59:02,820: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T01:59:02.820766471Z [2024-04-06 01:59:02,820: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T01:59:02.820918978Z [2024-04-06 01:59:02,820: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:59:02.820933832Z [2024-04-06 01:59:02,820: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:59:02.821154978Z [2024-04-06 01:59:02,821: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:59:02.821184411Z [2024-04-06 01:59:02,821: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T01:59:02.927576022Z [2024-04-06 01:59:02,927: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:59:05.196502256Z [2024-04-06 01:59:05,195: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[50d4db5e-7016-4cc0-8c7a-73fa10f1549c] succeeded in 4.706987550000122s: None 2024-04-06T01:59:05.365265544Z [2024-04-06 01:59:05,364: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d41b5458-ee18-4bd5-89cc-76d7ceb41d3a] succeeded in 4.873102199999721s: None 2024-04-06T02:00:00.842936025Z [2024-04-06 02:00:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba9983ed-a324-4517-ab73-b31ca57d56b9] received 2024-04-06T02:00:00.848292361Z [2024-04-06 02:00:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ff2498d-102d-4609-a759-b6dfe7e1a9b8] received 2024-04-06T02:00:00.863440816Z [2024-04-06 02:00:00,862: INFO/ForkPoolWorker-15] [ba9983ed-a324-4517-ab73-b31ca57d56b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:00:00.866842049Z [2024-04-06 02:00:00,866: INFO/ForkPoolWorker-16] [5ff2498d-102d-4609-a759-b6dfe7e1a9b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:00:00.881881913Z [2024-04-06 02:00:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[473804d3-d417-4d5e-a70a-cf3b84c02baa] received 2024-04-06T02:00:00.891283885Z [2024-04-06 02:00:00,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3a0e477-3a26-4644-b9b1-b66efe874bd4] received 2024-04-06T02:00:00.906043076Z [2024-04-06 02:00:00,905: INFO/ForkPoolWorker-2] [a3a0e477-3a26-4644-b9b1-b66efe874bd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:00:00.915630945Z [2024-04-06 02:00:00,914: INFO/ForkPoolWorker-1] [473804d3-d417-4d5e-a70a-cf3b84c02baa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:00:01.360727926Z [2024-04-06 02:00:01,351: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:00:01.425879938Z [2024-04-06 02:00:01,421: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:00:01.555590006Z [2024-04-06 02:00:01,547: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:00:01.942264573Z [2024-04-06 02:00:01,913: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:00:02.415967194Z [2024-04-06 02:00:02,415: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:03.547403081Z [2024-04-06 02:00:03,546: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ff2498d-102d-4609-a759-b6dfe7e1a9b8] succeeded in 2.689908591999938s: None 2024-04-06T02:00:03.723936138Z [2024-04-06 02:00:03,723: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:00:03.728830582Z [2024-04-06 02:00:03,728: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:03.791123862Z [2024-04-06 02:00:03,790: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:00:03.794984962Z [2024-04-06 02:00:03,794: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:00:03.795207209Z [2024-04-06 02:00:03,795: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:00:03.795499167Z [2024-04-06 02:00:03,795: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:03.795659028Z [2024-04-06 02:00:03,795: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:00:03.796237538Z [2024-04-06 02:00:03,795: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:00:03.796424479Z [2024-04-06 02:00:03,796: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:00:04.013733952Z [2024-04-06 02:00:04,013: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:04.088528236Z [2024-04-06 02:00:04,088: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:00:04.103730128Z [2024-04-06 02:00:04,103: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:04.203766509Z [2024-04-06 02:00:04,203: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:00:04.210959934Z [2024-04-06 02:00:04,210: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:00:04.211524319Z [2024-04-06 02:00:04,211: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:00:04.214149156Z [2024-04-06 02:00:04,213: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:04.214277659Z [2024-04-06 02:00:04,214: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:00:04.214574469Z [2024-04-06 02:00:04,214: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:00:04.218107950Z [2024-04-06 02:00:04,217: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:00:04.716787224Z [2024-04-06 02:00:04,716: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:05.133888924Z [2024-04-06 02:00:05,133: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:00:05.137127743Z [2024-04-06 02:00:05,136: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:05.201991179Z [2024-04-06 02:00:05,201: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:00:05.203754179Z [2024-04-06 02:00:05,203: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:00:05.203942113Z [2024-04-06 02:00:05,203: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:00:05.204225758Z [2024-04-06 02:00:05,203: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:05.204406032Z [2024-04-06 02:00:05,204: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:00:05.204698850Z [2024-04-06 02:00:05,204: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:00:05.206044083Z [2024-04-06 02:00:05,204: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:00:05.325939653Z [2024-04-06 02:00:05,325: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:05.946697734Z [2024-04-06 02:00:05,946: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba9983ed-a324-4517-ab73-b31ca57d56b9] succeeded in 5.096344555000087s: None 2024-04-06T02:00:06.269109350Z [2024-04-06 02:00:06,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9f50862-6dc6-4c85-8843-4ed94c4136a7] received 2024-04-06T02:00:06.294401580Z [2024-04-06 02:00:06,294: INFO/ForkPoolWorker-15] [b9f50862-6dc6-4c85-8843-4ed94c4136a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:00:06.422212377Z [2024-04-06 02:00:06,421: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[473804d3-d417-4d5e-a70a-cf3b84c02baa] succeeded in 5.532434813000236s: None 2024-04-06T02:00:06.634197383Z [2024-04-06 02:00:06,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:00:07.805526260Z [2024-04-06 02:00:07,805: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:00:07.809001135Z [2024-04-06 02:00:07,808: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:07.838608272Z [2024-04-06 02:00:07,837: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:00:07.839654769Z [2024-04-06 02:00:07,839: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:00:07.839689572Z [2024-04-06 02:00:07,839: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:00:07.839793226Z [2024-04-06 02:00:07,839: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:07.839830944Z [2024-04-06 02:00:07,839: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:00:07.840082555Z [2024-04-06 02:00:07,839: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:00:07.840101228Z [2024-04-06 02:00:07,840: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:00:07.854175081Z [2024-04-06 02:00:07,853: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a3a0e477-3a26-4644-b9b1-b66efe874bd4] succeeded in 6.960107994999817s: None 2024-04-06T02:00:07.941669213Z [2024-04-06 02:00:07,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:08.769184187Z [2024-04-06 02:00:08,768: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9f50862-6dc6-4c85-8843-4ed94c4136a7] succeeded in 2.492124087999855s: None 2024-04-06T02:00:09.756613898Z [2024-04-06 02:00:09,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92b8bff3-20b2-45e2-8767-593eb15c04d1] received 2024-04-06T02:00:09.767539227Z [2024-04-06 02:00:09,767: INFO/ForkPoolWorker-15] [92b8bff3-20b2-45e2-8767-593eb15c04d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:00:10.041705296Z [2024-04-06 02:00:10,038: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:00:11.334118263Z [2024-04-06 02:00:11,333: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:00:11.338761715Z [2024-04-06 02:00:11,338: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:11.376346363Z [2024-04-06 02:00:11,376: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:00:11.378937954Z [2024-04-06 02:00:11,378: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:00:11.379011242Z [2024-04-06 02:00:11,378: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:00:11.379282835Z [2024-04-06 02:00:11,379: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:11.379433937Z [2024-04-06 02:00:11,379: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:00:11.380135191Z [2024-04-06 02:00:11,379: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:00:11.380313251Z [2024-04-06 02:00:11,380: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:00:11.484600875Z [2024-04-06 02:00:11,484: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:12.114605668Z [2024-04-06 02:00:12,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65c0beef-4029-4a16-bfb5-99b77d865c4a] received 2024-04-06T02:00:12.122478368Z [2024-04-06 02:00:12,122: INFO/ForkPoolWorker-16] [65c0beef-4029-4a16-bfb5-99b77d865c4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:00:12.175151448Z [2024-04-06 02:00:12,174: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92b8bff3-20b2-45e2-8767-593eb15c04d1] succeeded in 2.41439458800005s: None 2024-04-06T02:00:12.441664809Z [2024-04-06 02:00:12,438: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:00:13.615859523Z [2024-04-06 02:00:13,615: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:00:13.619261282Z [2024-04-06 02:00:13,618: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:13.661217647Z [2024-04-06 02:00:13,660: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:00:13.663118454Z [2024-04-06 02:00:13,662: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:00:13.663380142Z [2024-04-06 02:00:13,663: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:00:13.663801144Z [2024-04-06 02:00:13,663: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:13.664041849Z [2024-04-06 02:00:13,663: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:00:13.664610965Z [2024-04-06 02:00:13,664: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:00:13.664617014Z [2024-04-06 02:00:13,664: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:00:13.764982723Z [2024-04-06 02:00:13,764: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:14.367713615Z [2024-04-06 02:00:14,367: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65c0beef-4029-4a16-bfb5-99b77d865c4a] succeeded in 2.2513721330001317s: None 2024-04-06T02:01:00.659721781Z [2024-04-06 02:01:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48e0bca3-a4de-4389-9968-db60c6d4daaf] received 2024-04-06T02:01:00.661028472Z [2024-04-06 02:01:00,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a04043d-2e14-42fc-aed0-c75c0f54f2da] received 2024-04-06T02:01:00.677538182Z [2024-04-06 02:01:00,677: INFO/ForkPoolWorker-15] [48e0bca3-a4de-4389-9968-db60c6d4daaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:01:00.686771940Z [2024-04-06 02:01:00,686: INFO/ForkPoolWorker-16] [5a04043d-2e14-42fc-aed0-c75c0f54f2da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:01:01.094902951Z [2024-04-06 02:01:01,090: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:01:01.224699839Z [2024-04-06 02:01:01,217: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:01:03.237351994Z [2024-04-06 02:01:03,236: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:01:03.243098111Z [2024-04-06 02:01:03,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:01:03.336821819Z [2024-04-06 02:01:03,333: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:01:03.338225778Z [2024-04-06 02:01:03,338: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:01:03.338452222Z [2024-04-06 02:01:03,338: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:01:03.338606578Z [2024-04-06 02:01:03,338: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:01:03.340964140Z [2024-04-06 02:01:03,340: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:01:03.342202182Z [2024-04-06 02:01:03,342: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:01:03.342296368Z [2024-04-06 02:01:03,342: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:01:03.345133914Z [2024-04-06 02:01:03,344: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:01:03.369204699Z [2024-04-06 02:01:03,368: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:01:03.471044221Z [2024-04-06 02:01:03,470: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:01:03.472579068Z [2024-04-06 02:01:03,472: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:01:03.473514758Z [2024-04-06 02:01:03,472: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:01:03.473669146Z [2024-04-06 02:01:03,473: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:01:03.473758566Z [2024-04-06 02:01:03,473: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:01:03.474446087Z [2024-04-06 02:01:03,474: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:01:03.475096687Z [2024-04-06 02:01:03,474: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:01:03.526734252Z [2024-04-06 02:01:03,526: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:01:03.609748694Z [2024-04-06 02:01:03,609: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:01:06.915626096Z [2024-04-06 02:01:06,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48e0bca3-a4de-4389-9968-db60c6d4daaf] succeeded in 6.252323337999769s: None 2024-04-06T02:01:07.522195391Z [2024-04-06 02:01:07,521: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a04043d-2e14-42fc-aed0-c75c0f54f2da] succeeded in 6.85323931899984s: None 2024-04-06T02:02:01.130590788Z [2024-04-06 02:02:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[382d31ed-7e33-45ec-9dc0-118e21093bba] received 2024-04-06T02:02:01.133491095Z [2024-04-06 02:02:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02476348-bd52-46cf-a212-cd98d13f2138] received 2024-04-06T02:02:01.139192944Z [2024-04-06 02:02:01,138: INFO/ForkPoolWorker-15] [382d31ed-7e33-45ec-9dc0-118e21093bba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:02:01.150550984Z [2024-04-06 02:02:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[704d528a-a5a3-4ec3-ae61-f0f0e2b2d87c] received 2024-04-06T02:02:01.161793928Z [2024-04-06 02:02:01,159: INFO/ForkPoolWorker-16] [02476348-bd52-46cf-a212-cd98d13f2138] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:02:01.178379140Z [2024-04-06 02:02:01,177: INFO/ForkPoolWorker-1] [704d528a-a5a3-4ec3-ae61-f0f0e2b2d87c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:02:01.559218019Z [2024-04-06 02:02:01,554: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:02:01.562138505Z [2024-04-06 02:02:01,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:02:01.609787592Z [2024-04-06 02:02:01,606: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:02:01.938865408Z [2024-04-06 02:02:01,938: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:02:02.830975593Z [2024-04-06 02:02:02,830: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02476348-bd52-46cf-a212-cd98d13f2138] succeeded in 1.6953305649999493s: None 2024-04-06T02:02:03.406657768Z [2024-04-06 02:02:03,406: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:02:03.410689380Z [2024-04-06 02:02:03,410: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:02:03.478877187Z [2024-04-06 02:02:03,478: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:02:03.481104985Z [2024-04-06 02:02:03,480: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:02:03.481532540Z [2024-04-06 02:02:03,481: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:02:03.481892089Z [2024-04-06 02:02:03,481: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:02:03.482312886Z [2024-04-06 02:02:03,482: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:02:03.482913367Z [2024-04-06 02:02:03,482: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:02:03.483137914Z [2024-04-06 02:02:03,482: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:02:03.563748901Z [2024-04-06 02:02:03,563: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:02:03.597936656Z [2024-04-06 02:02:03,597: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:02:03.604989790Z [2024-04-06 02:02:03,604: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:02:03.679276586Z [2024-04-06 02:02:03,679: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:02:03.682763812Z [2024-04-06 02:02:03,682: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:02:03.685874984Z [2024-04-06 02:02:03,682: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:02:03.686098461Z [2024-04-06 02:02:03,685: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:02:03.687208374Z [2024-04-06 02:02:03,686: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:02:03.687488928Z [2024-04-06 02:02:03,687: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:02:03.688999754Z [2024-04-06 02:02:03,688: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:02:03.808663060Z [2024-04-06 02:02:03,808: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:02:06.185153322Z [2024-04-06 02:02:06,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[382d31ed-7e33-45ec-9dc0-118e21093bba] succeeded in 5.052304892999928s: None 2024-04-06T02:02:07.244993302Z [2024-04-06 02:02:07,244: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[704d528a-a5a3-4ec3-ae61-f0f0e2b2d87c] succeeded in 6.09002763799981s: None 2024-04-06T02:03:00.217446706Z [2024-04-06 02:03:00,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a06d51f2-f5a7-4e2b-8f54-5fdf9d31d2fd] received 2024-04-06T02:03:00.218990191Z [2024-04-06 02:03:00,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3162883b-15cf-4863-8704-3821d96eccf1] received 2024-04-06T02:03:00.243025705Z [2024-04-06 02:03:00,242: INFO/ForkPoolWorker-16] [3162883b-15cf-4863-8704-3821d96eccf1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:03:00.245988993Z [2024-04-06 02:03:00,243: INFO/ForkPoolWorker-15] [a06d51f2-f5a7-4e2b-8f54-5fdf9d31d2fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:03:00.531398266Z [2024-04-06 02:03:00,527: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:03:00.566119687Z [2024-04-06 02:03:00,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:03:01.886228293Z [2024-04-06 02:03:01,885: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:03:01.889895200Z [2024-04-06 02:03:01,889: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:03:01.942695404Z [2024-04-06 02:03:01,942: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:03:01.947558171Z [2024-04-06 02:03:01,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:03:01.955927569Z [2024-04-06 02:03:01,955: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:03:01.958861180Z [2024-04-06 02:03:01,958: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:03:01.959122241Z [2024-04-06 02:03:01,958: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:03:01.959448159Z [2024-04-06 02:03:01,959: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:03:01.959631181Z [2024-04-06 02:03:01,959: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:03:01.960133246Z [2024-04-06 02:03:01,959: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:03:01.960855092Z [2024-04-06 02:03:01,960: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:03:02.013239164Z [2024-04-06 02:03:02,012: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:03:02.014440232Z [2024-04-06 02:03:02,014: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:03:02.014499299Z [2024-04-06 02:03:02,014: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:03:02.014666502Z [2024-04-06 02:03:02,014: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:03:02.014727070Z [2024-04-06 02:03:02,014: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:03:02.015036709Z [2024-04-06 02:03:02,014: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:03:02.015084682Z [2024-04-06 02:03:02,015: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:03:02.054798790Z [2024-04-06 02:03:02,054: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:03:02.142021724Z [2024-04-06 02:03:02,141: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:03:03.864738435Z [2024-04-06 02:03:03,864: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a06d51f2-f5a7-4e2b-8f54-5fdf9d31d2fd] succeeded in 3.6384114769998632s: None 2024-04-06T02:03:04.233151715Z [2024-04-06 02:03:04,232: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3162883b-15cf-4863-8704-3821d96eccf1] succeeded in 4.008658444000048s: None 2024-04-06T02:04:00.811337106Z [2024-04-06 02:04:00,811: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3d9e04e-856d-46d7-a4e5-bbf49bb38728] received 2024-04-06T02:04:00.820060613Z [2024-04-06 02:04:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[936e94a4-402e-4209-b802-3be7c28c23fe] received 2024-04-06T02:04:00.828101285Z [2024-04-06 02:04:00,827: INFO/ForkPoolWorker-15] [b3d9e04e-856d-46d7-a4e5-bbf49bb38728] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:04:00.836773651Z [2024-04-06 02:04:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b3187c9-fa5b-4f54-af6c-2e19a24d24e2] received 2024-04-06T02:04:00.849899067Z [2024-04-06 02:04:00,849: INFO/ForkPoolWorker-16] [936e94a4-402e-4209-b802-3be7c28c23fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:04:00.868009621Z [2024-04-06 02:04:00,867: INFO/ForkPoolWorker-1] [7b3187c9-fa5b-4f54-af6c-2e19a24d24e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:04:01.209004903Z [2024-04-06 02:04:01,205: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:04:01.363864307Z [2024-04-06 02:04:01,353: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:04:01.470809369Z [2024-04-06 02:04:01,470: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:04:01.669957020Z [2024-04-06 02:04:01,652: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:04:02.309494700Z [2024-04-06 02:04:02,309: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3d9e04e-856d-46d7-a4e5-bbf49bb38728] succeeded in 1.4940601200000856s: None 2024-04-06T02:04:03.527803458Z [2024-04-06 02:04:03,527: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:04:03.532127328Z [2024-04-06 02:04:03,531: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:04:03.571673132Z [2024-04-06 02:04:03,571: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:04:03.573129510Z [2024-04-06 02:04:03,572: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:04:03.573143984Z [2024-04-06 02:04:03,573: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:04:03.573381179Z [2024-04-06 02:04:03,573: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:04:03.573464255Z [2024-04-06 02:04:03,573: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:04:03.573795444Z [2024-04-06 02:04:03,573: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:04:03.574396916Z [2024-04-06 02:04:03,573: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:04:03.655385033Z [2024-04-06 02:04:03,655: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:04:03.660405651Z [2024-04-06 02:04:03,660: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:04:03.664564479Z [2024-04-06 02:04:03,664: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:04:03.713941930Z [2024-04-06 02:04:03,713: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:04:03.715049082Z [2024-04-06 02:04:03,714: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:04:03.715175545Z [2024-04-06 02:04:03,715: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:04:03.715365152Z [2024-04-06 02:04:03,715: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:04:03.715466650Z [2024-04-06 02:04:03,715: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:04:03.715970134Z [2024-04-06 02:04:03,715: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:04:03.716195303Z [2024-04-06 02:04:03,716: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:04:03.869429076Z [2024-04-06 02:04:03,869: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:04:06.406183004Z [2024-04-06 02:04:06,405: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[936e94a4-402e-4209-b802-3be7c28c23fe] succeeded in 5.567069055000047s: None 2024-04-06T02:04:08.313352349Z [2024-04-06 02:04:08,312: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7b3187c9-fa5b-4f54-af6c-2e19a24d24e2] succeeded in 7.4695762999999715s: None 2024-04-06T02:05:01.081461784Z [2024-04-06 02:05:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76be6586-8cca-46ff-894c-9c2356d558c1] received 2024-04-06T02:05:01.085306326Z [2024-04-06 02:05:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cd2f5d6-7765-4127-ab3a-f576737ff781] received 2024-04-06T02:05:01.088931784Z [2024-04-06 02:05:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57a945d1-9ab0-4506-bc8b-a6123f9d7ba7] received 2024-04-06T02:05:01.107330353Z [2024-04-06 02:05:01,106: INFO/ForkPoolWorker-1] [57a945d1-9ab0-4506-bc8b-a6123f9d7ba7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:05:01.108847341Z [2024-04-06 02:05:01,108: INFO/ForkPoolWorker-15] [76be6586-8cca-46ff-894c-9c2356d558c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:05:01.112968038Z [2024-04-06 02:05:01,112: INFO/ForkPoolWorker-16] [2cd2f5d6-7765-4127-ab3a-f576737ff781] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:05:01.645922473Z [2024-04-06 02:05:01,642: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:05:01.677533515Z [2024-04-06 02:05:01,659: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:05:01.881018796Z [2024-04-06 02:05:01,868: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:05:04.007983213Z [2024-04-06 02:05:04,007: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:05:04.015005458Z [2024-04-06 02:05:04,012: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:04.077128150Z [2024-04-06 02:05:04,076: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:05:04.085926798Z [2024-04-06 02:05:04,085: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:05:04.086529479Z [2024-04-06 02:05:04,086: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:05:04.086754690Z [2024-04-06 02:05:04,086: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:04.086947058Z [2024-04-06 02:05:04,086: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:05:04.089607096Z [2024-04-06 02:05:04,089: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:05:04.090149082Z [2024-04-06 02:05:04,089: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:05:04.132888215Z [2024-04-06 02:05:04,132: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:05:04.139801882Z [2024-04-06 02:05:04,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:04.192087750Z [2024-04-06 02:05:04,191: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:04.231518086Z [2024-04-06 02:05:04,231: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:05:04.235019360Z [2024-04-06 02:05:04,234: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:05:04.235038702Z [2024-04-06 02:05:04,234: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:05:04.235162485Z [2024-04-06 02:05:04,235: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:04.235183283Z [2024-04-06 02:05:04,235: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:05:04.235418329Z [2024-04-06 02:05:04,235: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:05:04.235439658Z [2024-04-06 02:05:04,235: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:05:04.356143931Z [2024-04-06 02:05:04,354: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:04.368273553Z [2024-04-06 02:05:04,365: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:05:04.382600510Z [2024-04-06 02:05:04,382: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:04.510964575Z [2024-04-06 02:05:04,510: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:05:04.521985950Z [2024-04-06 02:05:04,521: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:05:04.522083108Z [2024-04-06 02:05:04,521: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:05:04.522231957Z [2024-04-06 02:05:04,522: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:04.522318207Z [2024-04-06 02:05:04,522: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:05:04.522582386Z [2024-04-06 02:05:04,522: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:05:04.529418160Z [2024-04-06 02:05:04,529: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:05:04.775482178Z [2024-04-06 02:05:04,775: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:05.695985370Z [2024-04-06 02:05:05,695: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76be6586-8cca-46ff-894c-9c2356d558c1] succeeded in 4.609941458000321s: None 2024-04-06T02:05:06.353263032Z [2024-04-06 02:05:06,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0faa941a-760f-407d-b3ae-06b5bb66f3d8] received 2024-04-06T02:05:06.364270797Z [2024-04-06 02:05:06,364: INFO/ForkPoolWorker-15] [0faa941a-760f-407d-b3ae-06b5bb66f3d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:05:06.669324961Z [2024-04-06 02:05:06,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:05:06.925991437Z [2024-04-06 02:05:06,925: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2cd2f5d6-7765-4127-ab3a-f576737ff781] succeeded in 5.835736387999987s: None 2024-04-06T02:05:06.936235204Z [2024-04-06 02:05:06,935: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[57a945d1-9ab0-4506-bc8b-a6123f9d7ba7] succeeded in 5.843240975999834s: None 2024-04-06T02:05:07.788132893Z [2024-04-06 02:05:07,787: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:05:07.791647944Z [2024-04-06 02:05:07,791: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:07.833628779Z [2024-04-06 02:05:07,833: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:05:07.835796449Z [2024-04-06 02:05:07,835: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:05:07.836044819Z [2024-04-06 02:05:07,835: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:05:07.836409984Z [2024-04-06 02:05:07,835: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:07.836628238Z [2024-04-06 02:05:07,836: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:05:07.837313110Z [2024-04-06 02:05:07,836: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:05:07.837540399Z [2024-04-06 02:05:07,837: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:05:07.923204870Z [2024-04-06 02:05:07,922: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:08.540599995Z [2024-04-06 02:05:08,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b51cd3b-38a5-4a22-83f3-404cbfb10334] received 2024-04-06T02:05:08.553607633Z [2024-04-06 02:05:08,553: INFO/ForkPoolWorker-16] [6b51cd3b-38a5-4a22-83f3-404cbfb10334] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:05:08.669947466Z [2024-04-06 02:05:08,667: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0faa941a-760f-407d-b3ae-06b5bb66f3d8] succeeded in 2.3130165229999875s: None 2024-04-06T02:05:08.898652426Z [2024-04-06 02:05:08,895: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:05:10.018634058Z [2024-04-06 02:05:10,018: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:05:10.021910982Z [2024-04-06 02:05:10,021: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:10.054640774Z [2024-04-06 02:05:10,054: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:05:10.056315606Z [2024-04-06 02:05:10,056: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:05:10.056325724Z [2024-04-06 02:05:10,056: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:05:10.056519906Z [2024-04-06 02:05:10,056: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:10.056529716Z [2024-04-06 02:05:10,056: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:05:10.057229200Z [2024-04-06 02:05:10,057: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:05:10.057279283Z [2024-04-06 02:05:10,057: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:05:10.136716247Z [2024-04-06 02:05:10,136: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:10.631150120Z [2024-04-06 02:05:10,630: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b51cd3b-38a5-4a22-83f3-404cbfb10334] succeeded in 2.0872045900000558s: None 2024-04-06T02:05:11.402238715Z [2024-04-06 02:05:11,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3d21fab-091f-4e34-868a-93d3fc8fd147] received 2024-04-06T02:05:11.411441975Z [2024-04-06 02:05:11,411: INFO/ForkPoolWorker-15] [f3d21fab-091f-4e34-868a-93d3fc8fd147] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:05:11.721945749Z [2024-04-06 02:05:11,713: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:05:12.891736562Z [2024-04-06 02:05:12,891: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:05:12.897264162Z [2024-04-06 02:05:12,896: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:12.933977820Z [2024-04-06 02:05:12,933: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:05:12.934915959Z [2024-04-06 02:05:12,934: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:05:12.935041043Z [2024-04-06 02:05:12,934: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:05:12.935209030Z [2024-04-06 02:05:12,934: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:12.935272126Z [2024-04-06 02:05:12,935: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:05:12.935544971Z [2024-04-06 02:05:12,935: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:05:12.935660686Z [2024-04-06 02:05:12,935: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:05:13.070397764Z [2024-04-06 02:05:13,070: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:13.728098496Z [2024-04-06 02:05:13,727: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3d21fab-091f-4e34-868a-93d3fc8fd147] succeeded in 2.3223221879998164s: None 2024-04-06T02:06:01.120251948Z [2024-04-06 02:06:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[438e81e1-d1f6-43d2-b8ef-15ebb7f1c43c] received 2024-04-06T02:06:01.123761584Z [2024-04-06 02:06:01,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[502a324b-7ea7-4548-8a3f-8f6c1a1f7eb5] received 2024-04-06T02:06:01.139520118Z [2024-04-06 02:06:01,139: INFO/ForkPoolWorker-15] [438e81e1-d1f6-43d2-b8ef-15ebb7f1c43c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:06:01.153938874Z [2024-04-06 02:06:01,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1199f722-eb4d-42d3-a333-5e858e2691d4] received 2024-04-06T02:06:01.154603010Z [2024-04-06 02:06:01,154: INFO/ForkPoolWorker-16] [502a324b-7ea7-4548-8a3f-8f6c1a1f7eb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:06:01.166841430Z [2024-04-06 02:06:01,166: INFO/ForkPoolWorker-1] [1199f722-eb4d-42d3-a333-5e858e2691d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:06:01.503008242Z [2024-04-06 02:06:01,499: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:06:01.766347070Z [2024-04-06 02:06:01,753: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:06:01.842489251Z [2024-04-06 02:06:01,842: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:06:01.911883964Z [2024-04-06 02:06:01,900: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:06:02.938471351Z [2024-04-06 02:06:02,938: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[438e81e1-d1f6-43d2-b8ef-15ebb7f1c43c] succeeded in 1.8117849449999994s: None 2024-04-06T02:06:03.415301043Z [2024-04-06 02:06:03,414: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:06:03.418792083Z [2024-04-06 02:06:03,418: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:06:03.469575525Z [2024-04-06 02:06:03,469: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:06:03.480679792Z [2024-04-06 02:06:03,480: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:06:03.480704788Z [2024-04-06 02:06:03,480: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:06:03.480869959Z [2024-04-06 02:06:03,480: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:06:03.480920619Z [2024-04-06 02:06:03,480: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:06:03.481225881Z [2024-04-06 02:06:03,481: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:06:03.481264387Z [2024-04-06 02:06:03,481: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:06:03.565504451Z [2024-04-06 02:06:03,565: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:06:03.718105700Z [2024-04-06 02:06:03,717: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:06:03.724475122Z [2024-04-06 02:06:03,723: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:06:03.806301581Z [2024-04-06 02:06:03,806: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:06:03.811439628Z [2024-04-06 02:06:03,810: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:06:03.811618263Z [2024-04-06 02:06:03,811: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:06:03.811813673Z [2024-04-06 02:06:03,811: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:06:03.811870557Z [2024-04-06 02:06:03,811: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:06:03.812520061Z [2024-04-06 02:06:03,812: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:06:03.812633747Z [2024-04-06 02:06:03,812: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:06:03.958346907Z [2024-04-06 02:06:03,958: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:06:06.051572331Z [2024-04-06 02:06:06,051: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[502a324b-7ea7-4548-8a3f-8f6c1a1f7eb5] succeeded in 4.915876221999952s: None 2024-04-06T02:06:07.047103365Z [2024-04-06 02:06:07,046: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1199f722-eb4d-42d3-a333-5e858e2691d4] succeeded in 5.891181024000161s: None 2024-04-06T02:07:00.532158543Z [2024-04-06 02:07:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbb61cd0-56e7-48d0-8982-e8116f7d0ab8] received 2024-04-06T02:07:00.535207672Z [2024-04-06 02:07:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba6eb4d8-2c2a-4335-a32b-fa507bfaaf66] received 2024-04-06T02:07:00.547799866Z [2024-04-06 02:07:00,547: INFO/ForkPoolWorker-16] [ba6eb4d8-2c2a-4335-a32b-fa507bfaaf66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:07:00.553739827Z [2024-04-06 02:07:00,553: INFO/ForkPoolWorker-15] [bbb61cd0-56e7-48d0-8982-e8116f7d0ab8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:07:00.846068836Z [2024-04-06 02:07:00,841: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:07:00.853283128Z [2024-04-06 02:07:00,849: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:07:02.265438813Z [2024-04-06 02:07:02,263: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:07:02.273650801Z [2024-04-06 02:07:02,271: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:07:02.301218627Z [2024-04-06 02:07:02,300: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:07:02.314526463Z [2024-04-06 02:07:02,305: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:07:02.350971757Z [2024-04-06 02:07:02,350: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:07:02.352308332Z [2024-04-06 02:07:02,352: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:07:02.352448665Z [2024-04-06 02:07:02,352: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:07:02.352626742Z [2024-04-06 02:07:02,352: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:07:02.352718705Z [2024-04-06 02:07:02,352: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:07:02.352971939Z [2024-04-06 02:07:02,352: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:07:02.353263284Z [2024-04-06 02:07:02,353: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:07:02.398493854Z [2024-04-06 02:07:02,398: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:07:02.400188173Z [2024-04-06 02:07:02,399: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:07:02.404130822Z [2024-04-06 02:07:02,400: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:07:02.404376749Z [2024-04-06 02:07:02,404: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:07:02.404492360Z [2024-04-06 02:07:02,404: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:07:02.404879561Z [2024-04-06 02:07:02,404: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:07:02.404975379Z [2024-04-06 02:07:02,404: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:07:02.471757794Z [2024-04-06 02:07:02,471: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:07:02.493786976Z [2024-04-06 02:07:02,493: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:07:04.106197919Z [2024-04-06 02:07:04,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bbb61cd0-56e7-48d0-8982-e8116f7d0ab8] succeeded in 3.571435878000102s: None 2024-04-06T02:07:04.686370643Z [2024-04-06 02:07:04,685: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ba6eb4d8-2c2a-4335-a32b-fa507bfaaf66] succeeded in 4.149609075000171s: None 2024-04-06T02:08:00.941389171Z [2024-04-06 02:08:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45a01798-def8-4c9e-ab5c-60482cc241e7] received 2024-04-06T02:08:00.944208135Z [2024-04-06 02:08:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62074ad3-d3e4-4a9c-a514-a09c5a78afbc] received 2024-04-06T02:08:00.956732129Z [2024-04-06 02:08:00,956: INFO/ForkPoolWorker-15] [45a01798-def8-4c9e-ab5c-60482cc241e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:08:00.960673376Z [2024-04-06 02:08:00,960: INFO/ForkPoolWorker-16] [62074ad3-d3e4-4a9c-a514-a09c5a78afbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:08:00.993187671Z [2024-04-06 02:08:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70a3e78e-216c-48ce-b693-0a446e15aca2] received 2024-04-06T02:08:01.013892807Z [2024-04-06 02:08:01,013: INFO/ForkPoolWorker-1] [70a3e78e-216c-48ce-b693-0a446e15aca2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:08:01.499422439Z [2024-04-06 02:08:01,491: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:08:01.508297910Z [2024-04-06 02:08:01,502: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:08:01.819690282Z [2024-04-06 02:08:01,804: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:08:02.300984677Z [2024-04-06 02:08:02,300: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:08:03.133491083Z [2024-04-06 02:08:03,133: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:08:03.137656252Z [2024-04-06 02:08:03,137: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:08:03.216447597Z [2024-04-06 02:08:03,216: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:08:03.220148892Z [2024-04-06 02:08:03,219: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:08:03.220873301Z [2024-04-06 02:08:03,220: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:08:03.221422210Z [2024-04-06 02:08:03,220: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:08:03.221572437Z [2024-04-06 02:08:03,221: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:08:03.222029748Z [2024-04-06 02:08:03,221: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:08:03.223078721Z [2024-04-06 02:08:03,221: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:08:03.340807019Z [2024-04-06 02:08:03,340: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:08:03.570806084Z [2024-04-06 02:08:03,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45a01798-def8-4c9e-ab5c-60482cc241e7] succeeded in 2.624062645000322s: None 2024-04-06T02:08:04.201367090Z [2024-04-06 02:08:04,200: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:08:04.206113702Z [2024-04-06 02:08:04,205: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:08:04.277760530Z [2024-04-06 02:08:04,276: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:08:04.280377980Z [2024-04-06 02:08:04,278: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:08:04.280395986Z [2024-04-06 02:08:04,278: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:08:04.280404235Z [2024-04-06 02:08:04,278: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:08:04.280408657Z [2024-04-06 02:08:04,278: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:08:04.280412227Z [2024-04-06 02:08:04,279: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:08:04.280415790Z [2024-04-06 02:08:04,279: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:08:04.388294815Z [2024-04-06 02:08:04,387: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:08:05.520953077Z [2024-04-06 02:08:05,520: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[70a3e78e-216c-48ce-b693-0a446e15aca2] succeeded in 4.5223351679996995s: None 2024-04-06T02:08:06.148261113Z [2024-04-06 02:08:06,147: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[62074ad3-d3e4-4a9c-a514-a09c5a78afbc] succeeded in 5.20055359700018s: None 2024-04-06T02:09:01.007424600Z [2024-04-06 02:09:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d63d04fd-37e1-472b-b817-d4feda8f40e4] received 2024-04-06T02:09:01.016756684Z [2024-04-06 02:09:01,016: INFO/ForkPoolWorker-15] [d63d04fd-37e1-472b-b817-d4feda8f40e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:09:01.027426587Z [2024-04-06 02:09:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8bcea56-1972-493c-a22b-ce245f871fc9] received 2024-04-06T02:09:01.054283545Z [2024-04-06 02:09:01,053: INFO/ForkPoolWorker-16] [d8bcea56-1972-493c-a22b-ce245f871fc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:09:01.370250194Z [2024-04-06 02:09:01,367: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:09:01.447353050Z [2024-04-06 02:09:01,443: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:09:02.703093530Z [2024-04-06 02:09:02,702: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:09:02.706660281Z [2024-04-06 02:09:02,706: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:09:02.765377115Z [2024-04-06 02:09:02,765: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:09:02.767204083Z [2024-04-06 02:09:02,766: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:09:02.767394539Z [2024-04-06 02:09:02,767: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:09:02.767616961Z [2024-04-06 02:09:02,767: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:09:02.767757111Z [2024-04-06 02:09:02,767: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:09:02.768087495Z [2024-04-06 02:09:02,767: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:09:02.768246673Z [2024-04-06 02:09:02,768: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:09:02.873631947Z [2024-04-06 02:09:02,873: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:09:02.932866410Z [2024-04-06 02:09:02,932: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:09:02.937609504Z [2024-04-06 02:09:02,937: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:09:02.991996189Z [2024-04-06 02:09:02,991: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:09:02.993316089Z [2024-04-06 02:09:02,993: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:09:02.995128686Z [2024-04-06 02:09:02,993: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:09:02.995330196Z [2024-04-06 02:09:02,995: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:09:02.995397050Z [2024-04-06 02:09:02,995: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:09:02.995716318Z [2024-04-06 02:09:02,995: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:09:02.995872399Z [2024-04-06 02:09:02,995: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:09:03.158825544Z [2024-04-06 02:09:03,158: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:09:05.353598870Z [2024-04-06 02:09:05,353: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8bcea56-1972-493c-a22b-ce245f871fc9] succeeded in 4.324195190999944s: None 2024-04-06T02:09:05.739280233Z [2024-04-06 02:09:05,738: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d63d04fd-37e1-472b-b817-d4feda8f40e4] succeeded in 4.72847674500008s: None 2024-04-06T02:10:00.679655915Z [2024-04-06 02:10:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82457bf8-87ab-48d5-a10e-44b6aa3710db] received 2024-04-06T02:10:00.682504428Z [2024-04-06 02:10:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1a47408-d824-4404-a17b-4be9092a611c] received 2024-04-06T02:10:00.690415869Z [2024-04-06 02:10:00,690: INFO/ForkPoolWorker-15] [82457bf8-87ab-48d5-a10e-44b6aa3710db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:10:00.692758146Z [2024-04-06 02:10:00,692: INFO/ForkPoolWorker-16] [b1a47408-d824-4404-a17b-4be9092a611c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:10:00.701919999Z [2024-04-06 02:10:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1969ce0-04e7-4b5b-917c-c3193c9142ec] received 2024-04-06T02:10:00.701938541Z [2024-04-06 02:10:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[829e865d-fd5e-4d73-9b80-b104efb63959] received 2024-04-06T02:10:00.737971094Z [2024-04-06 02:10:00,736: INFO/ForkPoolWorker-2] [829e865d-fd5e-4d73-9b80-b104efb63959] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:10:00.738002727Z [2024-04-06 02:10:00,737: INFO/ForkPoolWorker-1] [c1969ce0-04e7-4b5b-917c-c3193c9142ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:10:01.202680463Z [2024-04-06 02:10:01,198: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:10:01.813037652Z [2024-04-06 02:10:01,808: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:10:01.968453672Z [2024-04-06 02:10:01,947: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:10:02.022664585Z [2024-04-06 02:10:02,002: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:10:02.347982872Z [2024-04-06 02:10:02,347: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:04.467762991Z [2024-04-06 02:10:04,467: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[829e865d-fd5e-4d73-9b80-b104efb63959] succeeded in 3.763822264999817s: None 2024-04-06T02:10:04.738752594Z [2024-04-06 02:10:04,737: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:10:04.749441885Z [2024-04-06 02:10:04,748: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:04.828462703Z [2024-04-06 02:10:04,828: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:10:04.832737479Z [2024-04-06 02:10:04,831: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:04.853008760Z [2024-04-06 02:10:04,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:10:04.856662495Z [2024-04-06 02:10:04,856: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:10:04.858048436Z [2024-04-06 02:10:04,856: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:10:04.858304214Z [2024-04-06 02:10:04,858: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:04.858520302Z [2024-04-06 02:10:04,858: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:10:04.858848274Z [2024-04-06 02:10:04,858: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:10:04.859050060Z [2024-04-06 02:10:04,858: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:10:04.888735495Z [2024-04-06 02:10:04,888: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:10:04.894909112Z [2024-04-06 02:10:04,894: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:10:04.895140408Z [2024-04-06 02:10:04,895: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:10:04.895326143Z [2024-04-06 02:10:04,895: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:04.895467458Z [2024-04-06 02:10:04,895: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:10:04.895865221Z [2024-04-06 02:10:04,895: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:10:04.895999037Z [2024-04-06 02:10:04,895: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:10:05.011951516Z [2024-04-06 02:10:05,011: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:05.018319635Z [2024-04-06 02:10:05,015: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:05.516382356Z [2024-04-06 02:10:05,515: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:10:05.524958211Z [2024-04-06 02:10:05,522: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:05.625547918Z [2024-04-06 02:10:05,625: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:10:05.626636103Z [2024-04-06 02:10:05,626: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:10:05.626663837Z [2024-04-06 02:10:05,626: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:10:05.626809363Z [2024-04-06 02:10:05,626: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:05.626839302Z [2024-04-06 02:10:05,626: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:10:05.629773945Z [2024-04-06 02:10:05,629: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:10:05.629846929Z [2024-04-06 02:10:05,629: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:10:05.831344922Z [2024-04-06 02:10:05,831: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:06.071139717Z [2024-04-06 02:10:06,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82457bf8-87ab-48d5-a10e-44b6aa3710db] succeeded in 5.38689810599999s: None 2024-04-06T02:10:06.388442397Z [2024-04-06 02:10:06,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f940cf7b-d2f8-44c4-99d1-d4c0cbe5f1d2] received 2024-04-06T02:10:06.408203724Z [2024-04-06 02:10:06,407: INFO/ForkPoolWorker-15] [f940cf7b-d2f8-44c4-99d1-d4c0cbe5f1d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:10:06.699466187Z [2024-04-06 02:10:06,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:10:07.791130739Z [2024-04-06 02:10:07,790: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:10:07.794249667Z [2024-04-06 02:10:07,793: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:07.828579721Z [2024-04-06 02:10:07,828: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:10:07.830241305Z [2024-04-06 02:10:07,829: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:10:07.830696884Z [2024-04-06 02:10:07,830: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:10:07.830701719Z [2024-04-06 02:10:07,830: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:07.830797361Z [2024-04-06 02:10:07,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:10:07.831249832Z [2024-04-06 02:10:07,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:10:07.832491517Z [2024-04-06 02:10:07,831: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:10:07.932202882Z [2024-04-06 02:10:07,931: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:08.285942294Z [2024-04-06 02:10:08,280: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1969ce0-04e7-4b5b-917c-c3193c9142ec] succeeded in 7.580727644000035s: None 2024-04-06T02:10:08.513874650Z [2024-04-06 02:10:08,513: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b1a47408-d824-4404-a17b-4be9092a611c] succeeded in 7.828978032999657s: None 2024-04-06T02:10:08.825859751Z [2024-04-06 02:10:08,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ea63718-e06e-49b2-b86e-425f37ae4893] received 2024-04-06T02:10:08.839120115Z [2024-04-06 02:10:08,838: INFO/ForkPoolWorker-16] [5ea63718-e06e-49b2-b86e-425f37ae4893] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:10:08.843611987Z [2024-04-06 02:10:08,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f940cf7b-d2f8-44c4-99d1-d4c0cbe5f1d2] succeeded in 2.452842452999903s: None 2024-04-06T02:10:09.136087725Z [2024-04-06 02:10:09,132: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:10:10.271066785Z [2024-04-06 02:10:10,270: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:10:10.275179142Z [2024-04-06 02:10:10,274: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:10.311265942Z [2024-04-06 02:10:10,310: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:10:10.313362402Z [2024-04-06 02:10:10,313: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:10:10.313999954Z [2024-04-06 02:10:10,313: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:10:10.314296982Z [2024-04-06 02:10:10,313: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:10.314403866Z [2024-04-06 02:10:10,314: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:10:10.315056243Z [2024-04-06 02:10:10,314: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:10:10.315140596Z [2024-04-06 02:10:10,314: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:10:10.426193778Z [2024-04-06 02:10:10,425: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:11.018389154Z [2024-04-06 02:10:11,017: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ea63718-e06e-49b2-b86e-425f37ae4893] succeeded in 2.1901524750001045s: None 2024-04-06T02:10:11.556349438Z [2024-04-06 02:10:11,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edb1d474-fe6d-467a-bf8c-7b7a6279cc06] received 2024-04-06T02:10:11.564103216Z [2024-04-06 02:10:11,563: INFO/ForkPoolWorker-15] [edb1d474-fe6d-467a-bf8c-7b7a6279cc06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:10:11.898184421Z [2024-04-06 02:10:11,894: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:10:13.062273433Z [2024-04-06 02:10:13,061: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:10:13.065523285Z [2024-04-06 02:10:13,064: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:13.097451818Z [2024-04-06 02:10:13,097: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:10:13.098765560Z [2024-04-06 02:10:13,098: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:10:13.098853036Z [2024-04-06 02:10:13,098: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:10:13.099174042Z [2024-04-06 02:10:13,098: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:13.099190069Z [2024-04-06 02:10:13,098: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:10:13.099456797Z [2024-04-06 02:10:13,099: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:10:13.099575004Z [2024-04-06 02:10:13,099: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:10:13.193439767Z [2024-04-06 02:10:13,192: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:13.857044889Z [2024-04-06 02:10:13,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[edb1d474-fe6d-467a-bf8c-7b7a6279cc06] succeeded in 2.2989608610000687s: None 2024-04-06T02:11:01.009949197Z [2024-04-06 02:11:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71ac8565-a16b-47ec-8bfc-e78cc977f9e1] received 2024-04-06T02:11:01.012050782Z [2024-04-06 02:11:01,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f619ef5b-4474-496b-902b-7d2b69621f71] received 2024-04-06T02:11:01.027039510Z [2024-04-06 02:11:01,026: INFO/ForkPoolWorker-15] [71ac8565-a16b-47ec-8bfc-e78cc977f9e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:11:01.035828739Z [2024-04-06 02:11:01,035: INFO/ForkPoolWorker-16] [f619ef5b-4474-496b-902b-7d2b69621f71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:11:01.427894112Z [2024-04-06 02:11:01,424: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:11:01.479096312Z [2024-04-06 02:11:01,475: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:11:02.845028620Z [2024-04-06 02:11:02,844: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:11:02.848348143Z [2024-04-06 02:11:02,847: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:11:02.896400063Z [2024-04-06 02:11:02,896: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:11:02.898757805Z [2024-04-06 02:11:02,898: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:11:02.898943063Z [2024-04-06 02:11:02,898: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:11:02.899206728Z [2024-04-06 02:11:02,898: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:11:02.899328853Z [2024-04-06 02:11:02,899: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:11:02.899653187Z [2024-04-06 02:11:02,899: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:11:02.900234301Z [2024-04-06 02:11:02,899: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:11:02.975342832Z [2024-04-06 02:11:02,975: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:11:02.989506708Z [2024-04-06 02:11:02,989: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:11:02.992785155Z [2024-04-06 02:11:02,992: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:11:03.042169094Z [2024-04-06 02:11:03,041: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:11:03.050114946Z [2024-04-06 02:11:03,049: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:11:03.050784115Z [2024-04-06 02:11:03,050: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:11:03.050988666Z [2024-04-06 02:11:03,050: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:11:03.051087432Z [2024-04-06 02:11:03,050: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:11:03.051364296Z [2024-04-06 02:11:03,051: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:11:03.051473415Z [2024-04-06 02:11:03,051: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:11:03.157200199Z [2024-04-06 02:11:03,156: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:11:05.347269079Z [2024-04-06 02:11:05,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71ac8565-a16b-47ec-8bfc-e78cc977f9e1] succeeded in 4.329729035000128s: None 2024-04-06T02:11:05.373224377Z [2024-04-06 02:11:05,372: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f619ef5b-4474-496b-902b-7d2b69621f71] succeeded in 4.35752523300016s: None 2024-04-06T02:12:00.320683670Z [2024-04-06 02:12:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[964d5f56-876c-4549-9e12-a21e074ce7d7] received 2024-04-06T02:12:00.329350518Z [2024-04-06 02:12:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86408658-3327-488e-9e78-d48df1c71810] received 2024-04-06T02:12:00.331119644Z [2024-04-06 02:12:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92aedbf6-4ccd-46d1-9519-499b8851c56f] received 2024-04-06T02:12:00.340218317Z [2024-04-06 02:12:00,339: INFO/ForkPoolWorker-1] [92aedbf6-4ccd-46d1-9519-499b8851c56f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:12:00.341164443Z [2024-04-06 02:12:00,340: INFO/ForkPoolWorker-15] [964d5f56-876c-4549-9e12-a21e074ce7d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:12:00.342184111Z [2024-04-06 02:12:00,341: INFO/ForkPoolWorker-16] [86408658-3327-488e-9e78-d48df1c71810] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:12:00.614382017Z [2024-04-06 02:12:00,610: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:12:00.640873676Z [2024-04-06 02:12:00,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:12:00.653886093Z [2024-04-06 02:12:00,650: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:12:01.040487942Z [2024-04-06 02:12:01,040: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:12:02.027975599Z [2024-04-06 02:12:02,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[964d5f56-876c-4549-9e12-a21e074ce7d7] succeeded in 1.7037530530001277s: None 2024-04-06T02:12:02.030830605Z [2024-04-06 02:12:02,030: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:12:02.034756212Z [2024-04-06 02:12:02,034: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:12:02.086576520Z [2024-04-06 02:12:02,086: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:12:02.096138482Z [2024-04-06 02:12:02,095: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:12:02.096162811Z [2024-04-06 02:12:02,095: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:12:02.097183078Z [2024-04-06 02:12:02,096: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:12:02.097212685Z [2024-04-06 02:12:02,096: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:12:02.097223137Z [2024-04-06 02:12:02,096: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:12:02.097231533Z [2024-04-06 02:12:02,096: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:12:02.263739228Z [2024-04-06 02:12:02,263: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:12:02.273008565Z [2024-04-06 02:12:02,270: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:12:02.276014340Z [2024-04-06 02:12:02,272: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:12:02.327160012Z [2024-04-06 02:12:02,326: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:12:02.346544653Z [2024-04-06 02:12:02,346: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:12:02.346674573Z [2024-04-06 02:12:02,346: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:12:02.346849178Z [2024-04-06 02:12:02,346: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:12:02.347415661Z [2024-04-06 02:12:02,346: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:12:02.348698423Z [2024-04-06 02:12:02,348: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:12:02.350109449Z [2024-04-06 02:12:02,348: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:12:02.429297063Z [2024-04-06 02:12:02,429: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:12:04.141514115Z [2024-04-06 02:12:04,141: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86408658-3327-488e-9e78-d48df1c71810] succeeded in 3.810309041000437s: None 2024-04-06T02:12:04.721598666Z [2024-04-06 02:12:04,721: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[92aedbf6-4ccd-46d1-9519-499b8851c56f] succeeded in 4.388550394000049s: None 2024-04-06T02:13:00.547857994Z [2024-04-06 02:13:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0378c7f1-87f4-403f-9f83-729c7722073b] received 2024-04-06T02:13:00.565666839Z [2024-04-06 02:13:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[233d2a11-c2a4-452b-ac2d-28ca6450645f] received 2024-04-06T02:13:00.577316422Z [2024-04-06 02:13:00,576: INFO/ForkPoolWorker-15] [0378c7f1-87f4-403f-9f83-729c7722073b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:13:00.579247448Z [2024-04-06 02:13:00,578: INFO/ForkPoolWorker-16] [233d2a11-c2a4-452b-ac2d-28ca6450645f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:13:00.943624623Z [2024-04-06 02:13:00,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:13:00.952772574Z [2024-04-06 02:13:00,949: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:13:02.560346656Z [2024-04-06 02:13:02,559: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:13:02.565004971Z [2024-04-06 02:13:02,564: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:13:02.656407383Z [2024-04-06 02:13:02,656: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:13:02.660418656Z [2024-04-06 02:13:02,660: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:13:02.660441116Z [2024-04-06 02:13:02,660: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:13:02.660647224Z [2024-04-06 02:13:02,660: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:13:02.661135851Z [2024-04-06 02:13:02,660: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:13:02.661998474Z [2024-04-06 02:13:02,661: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:13:02.662581881Z [2024-04-06 02:13:02,662: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:13:02.773104913Z [2024-04-06 02:13:02,772: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:13:02.780563477Z [2024-04-06 02:13:02,780: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:13:02.786341928Z [2024-04-06 02:13:02,785: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:13:02.840192250Z [2024-04-06 02:13:02,839: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:13:02.842514127Z [2024-04-06 02:13:02,842: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:13:02.842773985Z [2024-04-06 02:13:02,842: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:13:02.844368418Z [2024-04-06 02:13:02,842: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:13:02.844515693Z [2024-04-06 02:13:02,844: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:13:02.844839566Z [2024-04-06 02:13:02,844: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:13:02.844981273Z [2024-04-06 02:13:02,844: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:13:03.004537083Z [2024-04-06 02:13:03,004: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:13:04.954155188Z [2024-04-06 02:13:04,953: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[233d2a11-c2a4-452b-ac2d-28ca6450645f] succeeded in 4.386440115999903s: None 2024-04-06T02:13:06.065466243Z [2024-04-06 02:13:06,064: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0378c7f1-87f4-403f-9f83-729c7722073b] succeeded in 5.508954890000041s: None 2024-04-06T02:14:00.379497154Z [2024-04-06 02:14:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4a425c2-c54e-4508-b6ef-76d986c1ced2] received 2024-04-06T02:14:00.386416027Z [2024-04-06 02:14:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[522b7e07-8587-40f6-8b27-c57d13569d54] received 2024-04-06T02:14:00.398249218Z [2024-04-06 02:14:00,397: INFO/ForkPoolWorker-16] [522b7e07-8587-40f6-8b27-c57d13569d54] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:14:00.399396482Z [2024-04-06 02:14:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c499586a-b1d7-49f6-98bb-8f9eb093a45b] received 2024-04-06T02:14:00.400327486Z [2024-04-06 02:14:00,399: INFO/ForkPoolWorker-15] [b4a425c2-c54e-4508-b6ef-76d986c1ced2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:14:00.423948259Z [2024-04-06 02:14:00,423: INFO/ForkPoolWorker-1] [c499586a-b1d7-49f6-98bb-8f9eb093a45b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:14:00.740334489Z [2024-04-06 02:14:00,733: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:14:00.836177075Z [2024-04-06 02:14:00,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:14:00.898209744Z [2024-04-06 02:14:00,891: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:14:01.372151558Z [2024-04-06 02:14:01,369: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:14:02.078024250Z [2024-04-06 02:14:02,076: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[522b7e07-8587-40f6-8b27-c57d13569d54] succeeded in 1.6847862780000469s: None 2024-04-06T02:14:02.641110530Z [2024-04-06 02:14:02,640: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:14:02.645628263Z [2024-04-06 02:14:02,645: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:14:02.703445888Z [2024-04-06 02:14:02,703: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:14:02.706727254Z [2024-04-06 02:14:02,706: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:14:02.706808629Z [2024-04-06 02:14:02,706: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:14:02.707096075Z [2024-04-06 02:14:02,706: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:14:02.707252661Z [2024-04-06 02:14:02,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:14:02.707692631Z [2024-04-06 02:14:02,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:14:02.707836932Z [2024-04-06 02:14:02,707: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:14:02.856452177Z [2024-04-06 02:14:02,856: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:14:02.864427375Z [2024-04-06 02:14:02,863: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:14:02.890413429Z [2024-04-06 02:14:02,890: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:14:02.942981082Z [2024-04-06 02:14:02,942: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:14:02.946994957Z [2024-04-06 02:14:02,946: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:14:02.947104299Z [2024-04-06 02:14:02,946: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:14:02.947282961Z [2024-04-06 02:14:02,947: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:14:02.947373355Z [2024-04-06 02:14:02,947: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:14:02.947612626Z [2024-04-06 02:14:02,947: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:14:02.948432563Z [2024-04-06 02:14:02,948: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:14:03.090659624Z [2024-04-06 02:14:03,090: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:14:04.750933201Z [2024-04-06 02:14:04,750: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4a425c2-c54e-4508-b6ef-76d986c1ced2] succeeded in 4.362327173999802s: None 2024-04-06T02:14:05.442427492Z [2024-04-06 02:14:05,442: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c499586a-b1d7-49f6-98bb-8f9eb093a45b] succeeded in 5.0360701640001935s: None 2024-04-06T02:15:00.891301154Z [2024-04-06 02:15:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edd33bd1-e590-4036-9528-234c9219cf34] received 2024-04-06T02:15:00.901511004Z [2024-04-06 02:15:00,901: INFO/ForkPoolWorker-15] [edd33bd1-e590-4036-9528-234c9219cf34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:15:00.916288405Z [2024-04-06 02:15:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f7b6f6b-ca15-4075-9672-3bd22f8dc634] received 2024-04-06T02:15:00.924441827Z [2024-04-06 02:15:00,924: INFO/ForkPoolWorker-16] [6f7b6f6b-ca15-4075-9672-3bd22f8dc634] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:15:00.958633583Z [2024-04-06 02:15:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fc220b9-8689-4889-8627-f8e45594836d] received 2024-04-06T02:15:00.981146163Z [2024-04-06 02:15:00,980: INFO/ForkPoolWorker-1] [7fc220b9-8689-4889-8627-f8e45594836d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:15:01.301743102Z [2024-04-06 02:15:01,298: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:15:01.507122745Z [2024-04-06 02:15:01,502: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:15:01.577163368Z [2024-04-06 02:15:01,573: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:15:03.582080800Z [2024-04-06 02:15:03,577: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:15:03.588911739Z [2024-04-06 02:15:03,588: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:03.658491418Z [2024-04-06 02:15:03,658: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:15:03.663073723Z [2024-04-06 02:15:03,662: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:15:03.663202376Z [2024-04-06 02:15:03,663: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:15:03.663434984Z [2024-04-06 02:15:03,663: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:03.663565909Z [2024-04-06 02:15:03,663: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:15:03.663908240Z [2024-04-06 02:15:03,663: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:15:03.669367247Z [2024-04-06 02:15:03,669: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:15:03.699861749Z [2024-04-06 02:15:03,699: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:15:03.703340775Z [2024-04-06 02:15:03,702: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:03.762752958Z [2024-04-06 02:15:03,761: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:15:03.766635123Z [2024-04-06 02:15:03,766: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:03.769541571Z [2024-04-06 02:15:03,769: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:03.799880894Z [2024-04-06 02:15:03,799: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:15:03.804075429Z [2024-04-06 02:15:03,803: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:15:03.804112103Z [2024-04-06 02:15:03,803: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:15:03.804211939Z [2024-04-06 02:15:03,804: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:03.804272697Z [2024-04-06 02:15:03,804: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:15:03.810358254Z [2024-04-06 02:15:03,810: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:15:03.810446083Z [2024-04-06 02:15:03,810: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:15:03.830201956Z [2024-04-06 02:15:03,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:15:03.834059345Z [2024-04-06 02:15:03,833: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:15:03.834181272Z [2024-04-06 02:15:03,834: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:15:03.834367486Z [2024-04-06 02:15:03,834: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:03.834464422Z [2024-04-06 02:15:03,834: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:15:03.836002628Z [2024-04-06 02:15:03,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:15:03.836224296Z [2024-04-06 02:15:03,836: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:15:03.975562391Z [2024-04-06 02:15:03,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:03.982102835Z [2024-04-06 02:15:03,981: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:05.021605303Z [2024-04-06 02:15:05,021: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[edd33bd1-e590-4036-9528-234c9219cf34] succeeded in 4.126750903999891s: None 2024-04-06T02:15:05.102698405Z [2024-04-06 02:15:05,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11df39be-fafb-4bf5-9ca9-ce251154a698] received 2024-04-06T02:15:05.130689541Z [2024-04-06 02:15:05,130: INFO/ForkPoolWorker-15] [11df39be-fafb-4bf5-9ca9-ce251154a698] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:15:05.492688967Z [2024-04-06 02:15:05,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:15:06.300689405Z [2024-04-06 02:15:06,300: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7fc220b9-8689-4889-8627-f8e45594836d] succeeded in 5.335803263999878s: None 2024-04-06T02:15:06.656391880Z [2024-04-06 02:15:06,656: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:15:06.659738962Z [2024-04-06 02:15:06,659: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:06.707235164Z [2024-04-06 02:15:06,706: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:15:06.709198947Z [2024-04-06 02:15:06,708: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:15:06.709214111Z [2024-04-06 02:15:06,708: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:15:06.709407315Z [2024-04-06 02:15:06,709: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:06.709549050Z [2024-04-06 02:15:06,709: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:15:06.710252154Z [2024-04-06 02:15:06,709: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:15:06.710363799Z [2024-04-06 02:15:06,710: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:15:06.816157425Z [2024-04-06 02:15:06,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:06.882308152Z [2024-04-06 02:15:06,881: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6f7b6f6b-ca15-4075-9672-3bd22f8dc634] succeeded in 5.963494652999998s: None 2024-04-06T02:15:07.485304623Z [2024-04-06 02:15:07,484: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11df39be-fafb-4bf5-9ca9-ce251154a698] succeeded in 2.380696450999949s: None 2024-04-06T02:15:07.774905916Z [2024-04-06 02:15:07,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8c7d224-24fa-4e13-9913-5f1af5ecb5a4] received 2024-04-06T02:15:07.796326997Z [2024-04-06 02:15:07,796: INFO/ForkPoolWorker-15] [d8c7d224-24fa-4e13-9913-5f1af5ecb5a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:15:08.090969786Z [2024-04-06 02:15:08,085: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:15:09.346306360Z [2024-04-06 02:15:09,345: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:15:09.350001581Z [2024-04-06 02:15:09,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:09.386397822Z [2024-04-06 02:15:09,386: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:15:09.389163067Z [2024-04-06 02:15:09,388: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:15:09.389315943Z [2024-04-06 02:15:09,389: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:15:09.389553384Z [2024-04-06 02:15:09,389: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:09.389737746Z [2024-04-06 02:15:09,389: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:15:09.390334041Z [2024-04-06 02:15:09,390: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:15:09.390578528Z [2024-04-06 02:15:09,390: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:15:09.503171698Z [2024-04-06 02:15:09,502: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:10.128119592Z [2024-04-06 02:15:10,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cad0a3e8-2aa3-48d6-80b8-dc738f2343e5] received 2024-04-06T02:15:10.151219587Z [2024-04-06 02:15:10,150: INFO/ForkPoolWorker-16] [cad0a3e8-2aa3-48d6-80b8-dc738f2343e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:15:10.154071510Z [2024-04-06 02:15:10,153: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8c7d224-24fa-4e13-9913-5f1af5ecb5a4] succeeded in 2.3741713179997532s: None 2024-04-06T02:15:10.453936171Z [2024-04-06 02:15:10,450: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:15:11.868133767Z [2024-04-06 02:15:11,867: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:15:11.874420491Z [2024-04-06 02:15:11,874: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:11.906574773Z [2024-04-06 02:15:11,906: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:15:11.907580164Z [2024-04-06 02:15:11,907: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:15:11.907646684Z [2024-04-06 02:15:11,907: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:15:11.907830060Z [2024-04-06 02:15:11,907: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:11.907896831Z [2024-04-06 02:15:11,907: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:15:11.908377018Z [2024-04-06 02:15:11,908: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:15:11.908861663Z [2024-04-06 02:15:11,908: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:15:12.023932775Z [2024-04-06 02:15:12,023: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:12.593923715Z [2024-04-06 02:15:12,593: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cad0a3e8-2aa3-48d6-80b8-dc738f2343e5] succeeded in 2.4599648840003283s: None 2024-04-06T02:16:01.127466683Z [2024-04-06 02:16:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cf12961-d3ad-4d27-a685-d0b3b74069b3] received 2024-04-06T02:16:01.131320924Z [2024-04-06 02:16:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[903c79b7-8103-4112-ba2c-3ec4acb3684b] received 2024-04-06T02:16:01.141480155Z [2024-04-06 02:16:01,141: INFO/ForkPoolWorker-16] [903c79b7-8103-4112-ba2c-3ec4acb3684b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:16:01.158828467Z [2024-04-06 02:16:01,158: INFO/ForkPoolWorker-15] [3cf12961-d3ad-4d27-a685-d0b3b74069b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:16:01.178791415Z [2024-04-06 02:16:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0d6ec64-59d3-41c6-a7f7-a3fca6b4a8db] received 2024-04-06T02:16:01.199784620Z [2024-04-06 02:16:01,199: INFO/ForkPoolWorker-1] [b0d6ec64-59d3-41c6-a7f7-a3fca6b4a8db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:16:01.675619812Z [2024-04-06 02:16:01,670: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:16:01.824241089Z [2024-04-06 02:16:01,819: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:16:01.850550150Z [2024-04-06 02:16:01,846: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:16:02.178037674Z [2024-04-06 02:16:02,177: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:16:03.342162148Z [2024-04-06 02:16:03,341: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[903c79b7-8103-4112-ba2c-3ec4acb3684b] succeeded in 2.208778392000113s: None 2024-04-06T02:16:04.017432107Z [2024-04-06 02:16:04,017: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:16:04.020669599Z [2024-04-06 02:16:04,020: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:16:04.079598611Z [2024-04-06 02:16:04,079: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:16:04.081101991Z [2024-04-06 02:16:04,080: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:16:04.081139986Z [2024-04-06 02:16:04,081: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:16:04.081277013Z [2024-04-06 02:16:04,081: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:16:04.083320626Z [2024-04-06 02:16:04,081: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:16:04.084072105Z [2024-04-06 02:16:04,083: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:16:04.084184569Z [2024-04-06 02:16:04,084: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:16:04.187207630Z [2024-04-06 02:16:04,186: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:16:04.377091984Z [2024-04-06 02:16:04,375: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:16:04.379555466Z [2024-04-06 02:16:04,379: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:16:04.448199603Z [2024-04-06 02:16:04,442: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:16:04.450422539Z [2024-04-06 02:16:04,450: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:16:04.454048065Z [2024-04-06 02:16:04,450: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:16:04.454062086Z [2024-04-06 02:16:04,450: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:16:04.454066257Z [2024-04-06 02:16:04,450: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:16:04.454069484Z [2024-04-06 02:16:04,450: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:16:04.454072538Z [2024-04-06 02:16:04,450: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:16:04.610139801Z [2024-04-06 02:16:04,609: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:16:06.567976288Z [2024-04-06 02:16:06,567: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3cf12961-d3ad-4d27-a685-d0b3b74069b3] succeeded in 5.434688040999845s: None 2024-04-06T02:16:07.014410743Z [2024-04-06 02:16:07,013: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b0d6ec64-59d3-41c6-a7f7-a3fca6b4a8db] succeeded in 5.832909233000009s: None 2024-04-06T02:17:01.158056051Z [2024-04-06 02:17:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[499c9df8-c36b-4a40-b096-547c206d9b71] received 2024-04-06T02:17:01.160626146Z [2024-04-06 02:17:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f298871-b14e-4c03-8fbe-9dc40dde3c27] received 2024-04-06T02:17:01.174625510Z [2024-04-06 02:17:01,174: INFO/ForkPoolWorker-15] [499c9df8-c36b-4a40-b096-547c206d9b71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:17:01.214852524Z [2024-04-06 02:17:01,214: INFO/ForkPoolWorker-16] [7f298871-b14e-4c03-8fbe-9dc40dde3c27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:17:01.545714598Z [2024-04-06 02:17:01,542: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:17:01.680153308Z [2024-04-06 02:17:01,669: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:17:03.018133108Z [2024-04-06 02:17:03,017: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:17:03.021691086Z [2024-04-06 02:17:03,021: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:17:03.056532236Z [2024-04-06 02:17:03,056: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:17:03.069624247Z [2024-04-06 02:17:03,069: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:17:03.069683600Z [2024-04-06 02:17:03,069: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:17:03.069803650Z [2024-04-06 02:17:03,069: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:17:03.069856646Z [2024-04-06 02:17:03,069: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:17:03.070109291Z [2024-04-06 02:17:03,069: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:17:03.070122642Z [2024-04-06 02:17:03,070: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:17:03.220604411Z [2024-04-06 02:17:03,220: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:17:03.304897062Z [2024-04-06 02:17:03,304: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:17:03.313646633Z [2024-04-06 02:17:03,313: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:17:03.390355089Z [2024-04-06 02:17:03,390: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:17:03.394854804Z [2024-04-06 02:17:03,394: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:17:03.397461548Z [2024-04-06 02:17:03,397: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:17:03.397610759Z [2024-04-06 02:17:03,397: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:17:03.398992109Z [2024-04-06 02:17:03,398: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:17:03.399307364Z [2024-04-06 02:17:03,399: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:17:03.399759521Z [2024-04-06 02:17:03,399: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:17:03.627441805Z [2024-04-06 02:17:03,627: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:17:05.897469470Z [2024-04-06 02:17:05,897: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f298871-b14e-4c03-8fbe-9dc40dde3c27] succeeded in 4.728498166999998s: None 2024-04-06T02:17:05.975907935Z [2024-04-06 02:17:05,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[499c9df8-c36b-4a40-b096-547c206d9b71] succeeded in 4.811811238000246s: None 2024-04-06T02:18:01.100128899Z [2024-04-06 02:18:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d47234bd-2e18-4b40-a62a-04146f652916] received 2024-04-06T02:18:01.113071419Z [2024-04-06 02:18:01,112: INFO/ForkPoolWorker-15] [d47234bd-2e18-4b40-a62a-04146f652916] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:18:01.114212435Z [2024-04-06 02:18:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[060a1e27-ab2d-4445-90fa-dcb073cfa973] received 2024-04-06T02:18:01.124679526Z [2024-04-06 02:18:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[116ee16d-2363-46a5-a8e7-a025d846760d] received 2024-04-06T02:18:01.129650114Z [2024-04-06 02:18:01,129: INFO/ForkPoolWorker-16] [060a1e27-ab2d-4445-90fa-dcb073cfa973] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:18:01.165009179Z [2024-04-06 02:18:01,164: INFO/ForkPoolWorker-1] [116ee16d-2363-46a5-a8e7-a025d846760d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:18:01.495381655Z [2024-04-06 02:18:01,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:18:01.783604657Z [2024-04-06 02:18:01,773: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:18:02.005445431Z [2024-04-06 02:18:02,005: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:18:02.110459327Z [2024-04-06 02:18:02,087: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:18:03.395479782Z [2024-04-06 02:18:03,395: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d47234bd-2e18-4b40-a62a-04146f652916] succeeded in 2.288231502999679s: None 2024-04-06T02:18:04.231907829Z [2024-04-06 02:18:04,231: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:18:04.241679087Z [2024-04-06 02:18:04,239: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:18:04.332981584Z [2024-04-06 02:18:04,332: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:18:04.334093952Z [2024-04-06 02:18:04,333: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:18:04.334126923Z [2024-04-06 02:18:04,334: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:18:04.334324132Z [2024-04-06 02:18:04,334: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:18:04.334339841Z [2024-04-06 02:18:04,334: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:18:04.334561894Z [2024-04-06 02:18:04,334: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:18:04.334592615Z [2024-04-06 02:18:04,334: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:18:04.432699485Z [2024-04-06 02:18:04,432: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:18:05.196422849Z [2024-04-06 02:18:05,196: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:18:05.205404144Z [2024-04-06 02:18:05,204: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:18:05.296467797Z [2024-04-06 02:18:05,296: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:18:05.303950736Z [2024-04-06 02:18:05,303: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:18:05.304392586Z [2024-04-06 02:18:05,303: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:18:05.304860486Z [2024-04-06 02:18:05,304: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:18:05.305025170Z [2024-04-06 02:18:05,304: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:18:05.305463332Z [2024-04-06 02:18:05,305: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:18:05.305763671Z [2024-04-06 02:18:05,305: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:18:05.396223427Z [2024-04-06 02:18:05,395: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:18:06.819961009Z [2024-04-06 02:18:06,819: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[060a1e27-ab2d-4445-90fa-dcb073cfa973] succeeded in 5.703864000000067s: None 2024-04-06T02:18:07.671283333Z [2024-04-06 02:18:07,670: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[116ee16d-2363-46a5-a8e7-a025d846760d] succeeded in 6.541073122999933s: None 2024-04-06T02:19:00.962971975Z [2024-04-06 02:19:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[138a14b6-eaf3-499d-b439-37a6d9248d56] received 2024-04-06T02:19:00.974472779Z [2024-04-06 02:19:00,974: INFO/ForkPoolWorker-15] [138a14b6-eaf3-499d-b439-37a6d9248d56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:19:00.976367725Z [2024-04-06 02:19:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b1c9ba4-641e-4cb7-b591-785153729ebf] received 2024-04-06T02:19:00.997454492Z [2024-04-06 02:19:00,996: INFO/ForkPoolWorker-16] [1b1c9ba4-641e-4cb7-b591-785153729ebf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:19:01.464825032Z [2024-04-06 02:19:01,461: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:19:01.474055786Z [2024-04-06 02:19:01,470: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:19:02.901068748Z [2024-04-06 02:19:02,900: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:19:02.904494343Z [2024-04-06 02:19:02,904: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:19:02.905365765Z [2024-04-06 02:19:02,905: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:19:02.908712805Z [2024-04-06 02:19:02,908: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:19:02.943813463Z [2024-04-06 02:19:02,943: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:19:02.945322777Z [2024-04-06 02:19:02,945: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:19:02.945375009Z [2024-04-06 02:19:02,945: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:19:02.945506369Z [2024-04-06 02:19:02,945: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:19:02.945567651Z [2024-04-06 02:19:02,945: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:19:02.945790186Z [2024-04-06 02:19:02,945: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:19:02.945921818Z [2024-04-06 02:19:02,945: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:19:02.967642277Z [2024-04-06 02:19:02,967: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:19:02.973561674Z [2024-04-06 02:19:02,973: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:19:02.973876784Z [2024-04-06 02:19:02,973: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:19:02.974815316Z [2024-04-06 02:19:02,973: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:19:02.975397432Z [2024-04-06 02:19:02,974: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:19:02.975863541Z [2024-04-06 02:19:02,975: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:19:02.976064071Z [2024-04-06 02:19:02,975: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:19:03.054404056Z [2024-04-06 02:19:03,054: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:19:03.097937537Z [2024-04-06 02:19:03,097: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:19:04.982802598Z [2024-04-06 02:19:04,982: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[138a14b6-eaf3-499d-b439-37a6d9248d56] succeeded in 4.016611637000096s: None 2024-04-06T02:19:05.544683980Z [2024-04-06 02:19:05,544: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b1c9ba4-641e-4cb7-b591-785153729ebf] succeeded in 4.565158106000126s: None 2024-04-06T02:19:35.390179136Z [2024-04-06 02:19:35,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69afeeea-a2f8-42b3-92b3-877dec28bdaa] received 2024-04-06T02:19:35.409712586Z [2024-04-06 02:19:35,409: INFO/ForkPoolWorker-15] [69afeeea-a2f8-42b3-92b3-877dec28bdaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:19:35.711884574Z [2024-04-06 02:19:35,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:19:35.865544994Z [2024-04-06 02:19:35,865: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T02:19:35.870024409Z [2024-04-06 02:19:35,869: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:19:35.900704559Z [2024-04-06 02:19:35,900: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:19:35.902165975Z [2024-04-06 02:19:35,901: INFO/ForkPoolWorker-15] Read SDNC 905b1d54-6788-4825-83cc-9a9ec6b99c3f (epa_03) 2024-04-06T02:19:35.902493320Z [2024-04-06 02:19:35,902: INFO/ForkPoolWorker-15] [{'_id': '905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-06T02:19:35.902719691Z [2024-04-06 02:19:35,902: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T02:19:35.903250843Z [2024-04-06 02:19:35,903: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f 2024-04-06T02:19:36.012091929Z [2024-04-06 02:19:36,011: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:19:36.655970684Z [2024-04-06 02:19:36,655: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[69afeeea-a2f8-42b3-92b3-877dec28bdaa] succeeded in 1.2612371770001118s: None 2024-04-06T02:20:00.655305961Z [2024-04-06 02:20:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9eef3e2e-e0e6-44e7-acd4-ab1b59c7f22b] received 2024-04-06T02:20:00.661700087Z [2024-04-06 02:20:00,661: INFO/ForkPoolWorker-15] [9eef3e2e-e0e6-44e7-acd4-ab1b59c7f22b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:20:00.662186219Z [2024-04-06 02:20:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[796950ae-6aaa-48a2-a092-3c7e267b4c2d] received 2024-04-06T02:20:00.663851678Z [2024-04-06 02:20:00,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eccbdba-0592-4d32-a7e6-180e4ebb38dc] received 2024-04-06T02:20:00.671215571Z [2024-04-06 02:20:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3764314c-8364-45b4-9355-46cbbbb86d36] received 2024-04-06T02:20:00.673956944Z [2024-04-06 02:20:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c20af6f4-f001-4eee-8cf2-70550d0a305d] received 2024-04-06T02:20:00.709907961Z [2024-04-06 02:20:00,707: INFO/ForkPoolWorker-3] [c20af6f4-f001-4eee-8cf2-70550d0a305d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:20:00.709926949Z [2024-04-06 02:20:00,708: INFO/ForkPoolWorker-16] [796950ae-6aaa-48a2-a092-3c7e267b4c2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:20:00.714079303Z [2024-04-06 02:20:00,712: INFO/ForkPoolWorker-1] [8eccbdba-0592-4d32-a7e6-180e4ebb38dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:20:00.732488132Z [2024-04-06 02:20:00,731: INFO/ForkPoolWorker-2] [3764314c-8364-45b4-9355-46cbbbb86d36] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:20:01.053619702Z [2024-04-06 02:20:01,049: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:20:01.208982194Z [2024-04-06 02:20:01,205: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:20:01.315137033Z [2024-04-06 02:20:01,311: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:20:01.872883935Z [2024-04-06 02:20:01,867: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:20:01.941580809Z [2024-04-06 02:20:01,935: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:20:02.059762487Z [2024-04-06 02:20:02,059: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:20:02.064145798Z [2024-04-06 02:20:02,063: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:02.130542966Z [2024-04-06 02:20:02,130: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:20:02.131695303Z [2024-04-06 02:20:02,131: INFO/ForkPoolWorker-2] Read SDNC 905b1d54-6788-4825-83cc-9a9ec6b99c3f (epa_03) 2024-04-06T02:20:02.131817228Z [2024-04-06 02:20:02,131: INFO/ForkPoolWorker-2] [{'_id': '905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-06T02:20:02.131889908Z [2024-04-06 02:20:02,131: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:20:02.132114067Z [2024-04-06 02:20:02,132: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f 2024-04-06T02:20:02.307713258Z [2024-04-06 02:20:02,307: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:02.744492697Z [2024-04-06 02:20:02,744: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:20:02.752160887Z [2024-04-06 02:20:02,751: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:02.891405987Z [2024-04-06 02:20:02,891: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T02:20:02.896567731Z [2024-04-06 02:20:02,895: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:02.907178932Z [2024-04-06 02:20:02,906: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:20:02.909399351Z [2024-04-06 02:20:02,909: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:20:02.909581978Z [2024-04-06 02:20:02,909: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:20:02.909787409Z [2024-04-06 02:20:02,909: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:02.909973904Z [2024-04-06 02:20:02,909: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:20:02.910149598Z [2024-04-06 02:20:02,910: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:20:02.910368989Z [2024-04-06 02:20:02,910: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:20:03.043465463Z [2024-04-06 02:20:03,043: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:03.044887164Z [2024-04-06 02:20:03,044: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T02:20:03.050407198Z [2024-04-06 02:20:03,050: INFO/ForkPoolWorker-3] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:20:03.050424390Z [2024-04-06 02:20:03,050: INFO/ForkPoolWorker-3] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:20:03.050567389Z [2024-04-06 02:20:03,050: INFO/ForkPoolWorker-3] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:03.050578725Z [2024-04-06 02:20:03,050: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T02:20:03.050903735Z [2024-04-06 02:20:03,050: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:20:03.050917203Z [2024-04-06 02:20:03,050: INFO/ForkPoolWorker-3] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:20:03.267323435Z [2024-04-06 02:20:03,267: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:03.314537330Z [2024-04-06 02:20:03,314: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:04.558839526Z [2024-04-06 02:20:04,558: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3764314c-8364-45b4-9355-46cbbbb86d36] succeeded in 3.8745642309995674s: None 2024-04-06T02:20:04.707205979Z [2024-04-06 02:20:04,706: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9eef3e2e-e0e6-44e7-acd4-ab1b59c7f22b] succeeded in 4.050613968000107s: None 2024-04-06T02:20:04.793793536Z [2024-04-06 02:20:04,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f77fd75-3994-43ea-b31b-63a504c2216a] received 2024-04-06T02:20:04.804081108Z [2024-04-06 02:20:04,803: INFO/ForkPoolWorker-15] [1f77fd75-3994-43ea-b31b-63a504c2216a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:20:05.535163512Z [2024-04-06 02:20:05,534: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8eccbdba-0592-4d32-a7e6-180e4ebb38dc] succeeded in 4.865919430000304s: None 2024-04-06T02:20:05.724174935Z [2024-04-06 02:20:05,720: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:20:05.747035972Z [2024-04-06 02:20:05,746: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:20:05.762340468Z [2024-04-06 02:20:05,761: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:05.850486573Z [2024-04-06 02:20:05,850: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:20:05.852953248Z [2024-04-06 02:20:05,852: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:20:05.856104446Z [2024-04-06 02:20:05,855: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:20:05.856372265Z [2024-04-06 02:20:05,856: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:05.856529954Z [2024-04-06 02:20:05,856: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:20:05.856868107Z [2024-04-06 02:20:05,856: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:20:05.857136417Z [2024-04-06 02:20:05,857: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:20:06.025571282Z [2024-04-06 02:20:06,025: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:06.430203132Z [2024-04-06 02:20:06,429: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c20af6f4-f001-4eee-8cf2-70550d0a305d] succeeded in 5.745194903000083s: None 2024-04-06T02:20:07.135351642Z [2024-04-06 02:20:07,135: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:20:07.138643860Z [2024-04-06 02:20:07,138: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:07.166296680Z [2024-04-06 02:20:07,166: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:20:07.168007262Z [2024-04-06 02:20:07,167: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:20:07.168029904Z [2024-04-06 02:20:07,167: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:20:07.168033825Z [2024-04-06 02:20:07,167: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:07.168037349Z [2024-04-06 02:20:07,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:20:07.168040253Z [2024-04-06 02:20:07,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:20:07.168043163Z [2024-04-06 02:20:07,167: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:20:07.258085203Z [2024-04-06 02:20:07,257: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:07.922947864Z [2024-04-06 02:20:07,922: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f77fd75-3994-43ea-b31b-63a504c2216a] succeeded in 3.1253357000000506s: None 2024-04-06T02:20:08.548253305Z [2024-04-06 02:20:08,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[650ad183-4e0d-45db-bb3e-f7dc2a8ff0e4] received 2024-04-06T02:20:08.561287748Z [2024-04-06 02:20:08,561: INFO/ForkPoolWorker-15] [650ad183-4e0d-45db-bb3e-f7dc2a8ff0e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:20:08.776398464Z [2024-04-06 02:20:08,773: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[796950ae-6aaa-48a2-a092-3c7e267b4c2d] succeeded in 8.108894413000144s: None 2024-04-06T02:20:08.913038962Z [2024-04-06 02:20:08,909: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:20:10.283061247Z [2024-04-06 02:20:10,282: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:20:10.286807324Z [2024-04-06 02:20:10,286: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:10.320265319Z [2024-04-06 02:20:10,320: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:20:10.321740194Z [2024-04-06 02:20:10,321: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:20:10.321806205Z [2024-04-06 02:20:10,321: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:20:10.322122411Z [2024-04-06 02:20:10,321: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:10.322237146Z [2024-04-06 02:20:10,322: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:20:10.322646620Z [2024-04-06 02:20:10,322: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:20:10.322854348Z [2024-04-06 02:20:10,322: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:20:10.407115239Z [2024-04-06 02:20:10,406: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:11.022671055Z [2024-04-06 02:20:11,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dd81883-669f-48c9-999e-9444f6353f12] received 2024-04-06T02:20:11.030876541Z [2024-04-06 02:20:11,030: INFO/ForkPoolWorker-16] [9dd81883-669f-48c9-999e-9444f6353f12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:20:11.090494463Z [2024-04-06 02:20:11,090: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[650ad183-4e0d-45db-bb3e-f7dc2a8ff0e4] succeeded in 2.540696212000057s: None 2024-04-06T02:20:11.337682032Z [2024-04-06 02:20:11,334: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:20:12.528378721Z [2024-04-06 02:20:12,527: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:20:12.531740048Z [2024-04-06 02:20:12,531: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:12.571512385Z [2024-04-06 02:20:12,571: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:20:12.572907684Z [2024-04-06 02:20:12,572: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:20:12.573160966Z [2024-04-06 02:20:12,572: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:20:12.573503084Z [2024-04-06 02:20:12,573: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:12.573737702Z [2024-04-06 02:20:12,573: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:20:12.574180827Z [2024-04-06 02:20:12,573: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:20:12.574462726Z [2024-04-06 02:20:12,574: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:20:12.690822610Z [2024-04-06 02:20:12,690: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:13.357680544Z [2024-04-06 02:20:13,357: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9dd81883-669f-48c9-999e-9444f6353f12] succeeded in 2.3318785799997386s: None 2024-04-06T02:21:00.612673722Z [2024-04-06 02:21:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc6d93a2-7c81-40de-817c-2672cb1315ad] received 2024-04-06T02:21:00.623394818Z [2024-04-06 02:21:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e8b3761-fd8d-43ad-95df-cbdfe3c3c5d4] received 2024-04-06T02:21:00.629868569Z [2024-04-06 02:21:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a93e1ee-a2fb-45b7-87bc-d2fbfd0cecac] received 2024-04-06T02:21:00.638168935Z [2024-04-06 02:21:00,637: INFO/ForkPoolWorker-15] [cc6d93a2-7c81-40de-817c-2672cb1315ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:21:00.639672593Z [2024-04-06 02:21:00,639: INFO/ForkPoolWorker-16] [6e8b3761-fd8d-43ad-95df-cbdfe3c3c5d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:21:00.645663370Z [2024-04-06 02:21:00,645: INFO/ForkPoolWorker-1] [4a93e1ee-a2fb-45b7-87bc-d2fbfd0cecac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:21:01.048378802Z [2024-04-06 02:21:01,042: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:21:01.099160431Z [2024-04-06 02:21:01,092: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:21:01.139189198Z [2024-04-06 02:21:01,135: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:21:01.341724543Z [2024-04-06 02:21:01,341: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:21:01.345746409Z [2024-04-06 02:21:01,345: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:21:01.403246689Z [2024-04-06 02:21:01,403: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:21:01.409672793Z [2024-04-06 02:21:01,409: INFO/ForkPoolWorker-1] [] 2024-04-06T02:21:01.409693717Z [2024-04-06 02:21:01,409: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:21:01.411046812Z [2024-04-06 02:21:01,410: WARNING/ForkPoolWorker-1] Dag 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:21:01.411236027Z [2024-04-06 02:21:01,411: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:21:01.414758128Z [2024-04-06 02:21:01,414: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:21:01.417153685Z [2024-04-06 02:21:01,416: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:21:01.483873777Z [2024-04-06 02:21:01,483: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:21:01.488761898Z [2024-04-06 02:21:01,488: INFO/ForkPoolWorker-1] [] 2024-04-06T02:21:01.488782691Z [2024-04-06 02:21:01,488: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:21:01.489950733Z [2024-04-06 02:21:01,489: ERROR/ForkPoolWorker-1] [4a93e1ee-a2fb-45b7-87bc-d2fbfd0cecac] Failed to execute task Dag 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f' could not be found; either it does not exist or it failed to parse.. 2024-04-06T02:21:01.489965881Z Traceback (most recent call last): 2024-04-06T02:21:01.489970467Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T02:21:01.489993821Z args.func(args) 2024-04-06T02:21:01.489998081Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T02:21:01.490002002Z return func(*args, **kwargs) 2024-04-06T02:21:01.490005410Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T02:21:01.490008873Z return f(*args, **kwargs) 2024-04-06T02:21:01.490012205Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T02:21:01.490015576Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T02:21:01.490018989Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T02:21:01.490022348Z raise AirflowException( 2024-04-06T02:21:01.490026740Z airflow.exceptions.AirflowException: Dag 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f' could not be found; either it does not exist or it failed to parse. 2024-04-06T02:21:01.512761878Z [2024-04-06 02:21:01,512: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a93e1ee-a2fb-45b7-87bc-d2fbfd0cecac] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4a93e1ee-a2fb-45b7-87bc-d2fbfd0cecac') 2024-04-06T02:21:01.512780665Z Traceback (most recent call last): 2024-04-06T02:21:01.512785064Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T02:21:01.512788597Z R = retval = fun(*args, **kwargs) 2024-04-06T02:21:01.512820837Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T02:21:01.512829332Z return self.run(*args, **kwargs) 2024-04-06T02:21:01.512833772Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T02:21:01.512838099Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T02:21:01.512841571Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T02:21:01.512845734Z raise AirflowException(msg) 2024-04-06T02:21:01.512849961Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4a93e1ee-a2fb-45b7-87bc-d2fbfd0cecac 2024-04-06T02:21:02.733261850Z [2024-04-06 02:21:02,732: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:21:02.736705663Z [2024-04-06 02:21:02,736: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:21:02.737204732Z [2024-04-06 02:21:02,736: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:21:02.740897159Z [2024-04-06 02:21:02,740: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:21:02.768519486Z [2024-04-06 02:21:02,768: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:21:02.770345909Z [2024-04-06 02:21:02,770: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:21:02.770396267Z [2024-04-06 02:21:02,770: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:21:02.770512742Z [2024-04-06 02:21:02,770: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:21:02.770557596Z [2024-04-06 02:21:02,770: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:21:02.770815493Z [2024-04-06 02:21:02,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:21:02.770824927Z [2024-04-06 02:21:02,770: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:21:02.795897481Z [2024-04-06 02:21:02,795: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:21:02.802600517Z [2024-04-06 02:21:02,802: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:21:02.804211583Z [2024-04-06 02:21:02,803: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:21:02.804497779Z [2024-04-06 02:21:02,804: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:21:02.804638390Z [2024-04-06 02:21:02,804: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:21:02.807350118Z [2024-04-06 02:21:02,807: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:21:02.808212975Z [2024-04-06 02:21:02,807: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:21:02.912189033Z [2024-04-06 02:21:02,911: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:21:02.923999985Z [2024-04-06 02:21:02,923: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:21:05.193880100Z [2024-04-06 02:21:05,193: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e8b3761-fd8d-43ad-95df-cbdfe3c3c5d4] succeeded in 4.566303779000009s: None 2024-04-06T02:21:05.943341102Z [2024-04-06 02:21:05,942: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc6d93a2-7c81-40de-817c-2672cb1315ad] succeeded in 5.326078172000052s: None 2024-04-06T02:21:12.945914723Z [2024-04-06 02:21:12,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7679e49-4281-4499-8395-18f29a276bcf] received 2024-04-06T02:21:12.968041975Z [2024-04-06 02:21:12,964: INFO/ForkPoolWorker-15] [a7679e49-4281-4499-8395-18f29a276bcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:21:13.281023029Z [2024-04-06 02:21:13,277: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:21:13.430327492Z [2024-04-06 02:21:13,429: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T02:21:13.434032486Z [2024-04-06 02:21:13,433: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:21:13.491962301Z [2024-04-06 02:21:13,491: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:21:13.493040092Z [2024-04-06 02:21:13,492: INFO/ForkPoolWorker-15] [] 2024-04-06T02:21:13.493072900Z [2024-04-06 02:21:13,492: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T02:21:13.494629027Z [2024-04-06 02:21:13,494: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:21:13.494824732Z [2024-04-06 02:21:13,494: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:21:13.495542733Z [2024-04-06 02:21:13,495: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T02:21:13.497936005Z [2024-04-06 02:21:13,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:21:13.513061659Z [2024-04-06 02:21:13,512: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:21:13.514060665Z [2024-04-06 02:21:13,513: INFO/ForkPoolWorker-15] [] 2024-04-06T02:21:13.514076456Z [2024-04-06 02:21:13,514: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T02:21:13.515226609Z [2024-04-06 02:21:13,514: ERROR/ForkPoolWorker-15] [a7679e49-4281-4499-8395-18f29a276bcf] Failed to execute task Dag 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f' could not be found; either it does not exist or it failed to parse.. 2024-04-06T02:21:13.515246506Z Traceback (most recent call last): 2024-04-06T02:21:13.515254656Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T02:21:13.515283032Z args.func(args) 2024-04-06T02:21:13.515291925Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T02:21:13.515298808Z return func(*args, **kwargs) 2024-04-06T02:21:13.515304512Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T02:21:13.515310572Z return f(*args, **kwargs) 2024-04-06T02:21:13.515316109Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T02:21:13.515321638Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T02:21:13.515327098Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T02:21:13.515332631Z raise AirflowException( 2024-04-06T02:21:13.515339731Z airflow.exceptions.AirflowException: Dag 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f' could not be found; either it does not exist or it failed to parse. 2024-04-06T02:21:13.539978522Z [2024-04-06 02:21:13,539: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7679e49-4281-4499-8395-18f29a276bcf] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a7679e49-4281-4499-8395-18f29a276bcf') 2024-04-06T02:21:13.540017495Z Traceback (most recent call last): 2024-04-06T02:21:13.540024288Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T02:21:13.540027577Z R = retval = fun(*args, **kwargs) 2024-04-06T02:21:13.540030787Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T02:21:13.540066450Z return self.run(*args, **kwargs) 2024-04-06T02:21:13.540070770Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T02:21:13.540074964Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T02:21:13.540078096Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T02:21:13.540082453Z raise AirflowException(msg) 2024-04-06T02:21:13.540087903Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a7679e49-4281-4499-8395-18f29a276bcf 2024-04-06T02:22:00.596957411Z [2024-04-06 02:22:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffe399b4-46cd-41c4-a3ae-cd4d1a3203ba] received 2024-04-06T02:22:00.602564094Z [2024-04-06 02:22:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55056b9a-b948-4048-90fc-7c607f27a345] received 2024-04-06T02:22:00.605473855Z [2024-04-06 02:22:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f119277b-3e5e-4f30-8f60-226f5b60a3fe] received 2024-04-06T02:22:00.612751033Z [2024-04-06 02:22:00,612: INFO/ForkPoolWorker-15] [ffe399b4-46cd-41c4-a3ae-cd4d1a3203ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:22:00.622107418Z [2024-04-06 02:22:00,620: INFO/ForkPoolWorker-1] [f119277b-3e5e-4f30-8f60-226f5b60a3fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:22:00.626630946Z [2024-04-06 02:22:00,626: INFO/ForkPoolWorker-16] [55056b9a-b948-4048-90fc-7c607f27a345] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:22:00.970617229Z [2024-04-06 02:22:00,967: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:22:01.093411474Z [2024-04-06 02:22:01,089: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:22:01.152104521Z [2024-04-06 02:22:01,148: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:22:01.374220949Z [2024-04-06 02:22:01,373: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:22:02.263940369Z [2024-04-06 02:22:02,260: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f119277b-3e5e-4f30-8f60-226f5b60a3fe] succeeded in 1.653824054999859s: None 2024-04-06T02:22:02.686623658Z [2024-04-06 02:22:02,686: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:22:02.689900751Z [2024-04-06 02:22:02,689: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:22:02.734817475Z [2024-04-06 02:22:02,734: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:22:02.742245359Z [2024-04-06 02:22:02,741: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:22:02.742272035Z [2024-04-06 02:22:02,742: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:22:02.742419623Z [2024-04-06 02:22:02,742: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:22:02.742468852Z [2024-04-06 02:22:02,742: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:22:02.742752952Z [2024-04-06 02:22:02,742: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:22:02.742987027Z [2024-04-06 02:22:02,742: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:22:02.845783082Z [2024-04-06 02:22:02,845: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:22:03.162899211Z [2024-04-06 02:22:03,162: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:22:03.166528211Z [2024-04-06 02:22:03,166: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:22:03.222870445Z [2024-04-06 02:22:03,222: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:22:03.225519178Z [2024-04-06 02:22:03,225: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:22:03.225535081Z [2024-04-06 02:22:03,225: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:22:03.225636815Z [2024-04-06 02:22:03,225: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:22:03.225651277Z [2024-04-06 02:22:03,225: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:22:03.225976997Z [2024-04-06 02:22:03,225: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:22:03.225992123Z [2024-04-06 02:22:03,225: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:22:03.346904033Z [2024-04-06 02:22:03,346: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:22:05.220941446Z [2024-04-06 02:22:05,220: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55056b9a-b948-4048-90fc-7c607f27a345] succeeded in 4.616200357999787s: None 2024-04-06T02:22:05.539639982Z [2024-04-06 02:22:05,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffe399b4-46cd-41c4-a3ae-cd4d1a3203ba] succeeded in 4.940562437000153s: None 2024-04-06T02:23:00.428993111Z [2024-04-06 02:23:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9076464-e6a0-4147-bcc7-4da8af33ab1f] received 2024-04-06T02:23:00.431310583Z [2024-04-06 02:23:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d5106ae-1ca1-4c71-87ee-50e42f65c762] received 2024-04-06T02:23:00.436778348Z [2024-04-06 02:23:00,436: INFO/ForkPoolWorker-15] [c9076464-e6a0-4147-bcc7-4da8af33ab1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:23:00.437724216Z [2024-04-06 02:23:00,437: INFO/ForkPoolWorker-16] [7d5106ae-1ca1-4c71-87ee-50e42f65c762] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:23:00.713936992Z [2024-04-06 02:23:00,705: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:23:00.721972119Z [2024-04-06 02:23:00,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:23:02.063000027Z [2024-04-06 02:23:02,062: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:23:02.067267323Z [2024-04-06 02:23:02,066: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:23:02.172538158Z [2024-04-06 02:23:02,170: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:23:02.188065860Z [2024-04-06 02:23:02,186: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:23:02.188084518Z [2024-04-06 02:23:02,187: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:23:02.188088858Z [2024-04-06 02:23:02,187: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:23:02.188533493Z [2024-04-06 02:23:02,188: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:23:02.190582281Z [2024-04-06 02:23:02,189: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:23:02.190742220Z [2024-04-06 02:23:02,190: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:23:02.217896661Z [2024-04-06 02:23:02,212: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:23:02.217921459Z [2024-04-06 02:23:02,215: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:23:02.290402069Z [2024-04-06 02:23:02,290: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:23:02.292532708Z [2024-04-06 02:23:02,292: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:23:02.292545970Z [2024-04-06 02:23:02,292: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:23:02.292629620Z [2024-04-06 02:23:02,292: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:23:02.292654964Z [2024-04-06 02:23:02,292: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:23:02.292877860Z [2024-04-06 02:23:02,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:23:02.292902533Z [2024-04-06 02:23:02,292: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:23:02.423100667Z [2024-04-06 02:23:02,422: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:23:02.501899663Z [2024-04-06 02:23:02,501: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:23:04.274009848Z [2024-04-06 02:23:04,273: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d5106ae-1ca1-4c71-87ee-50e42f65c762] succeeded in 3.8405399449998185s: None 2024-04-06T02:23:04.630488935Z [2024-04-06 02:23:04,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9076464-e6a0-4147-bcc7-4da8af33ab1f] succeeded in 4.198696144999758s: None 2024-04-06T02:24:01.089234900Z [2024-04-06 02:24:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[150eff79-72e7-4882-8b82-17ea7cb77fb8] received 2024-04-06T02:24:01.107873720Z [2024-04-06 02:24:01,107: INFO/ForkPoolWorker-15] [150eff79-72e7-4882-8b82-17ea7cb77fb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:24:01.111625485Z [2024-04-06 02:24:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30b6745c-4a90-4776-9515-6f7a974321f6] received 2024-04-06T02:24:01.125736320Z [2024-04-06 02:24:01,125: INFO/ForkPoolWorker-16] [30b6745c-4a90-4776-9515-6f7a974321f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:24:01.133629270Z [2024-04-06 02:24:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02e87093-3054-4beb-b73c-21596f3b2d7e] received 2024-04-06T02:24:01.144330312Z [2024-04-06 02:24:01,143: INFO/ForkPoolWorker-1] [02e87093-3054-4beb-b73c-21596f3b2d7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:24:01.532160637Z [2024-04-06 02:24:01,528: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:24:01.550538568Z [2024-04-06 02:24:01,546: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:24:01.634336927Z [2024-04-06 02:24:01,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:24:01.935500533Z [2024-04-06 02:24:01,935: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:24:02.866533204Z [2024-04-06 02:24:02,866: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[02e87093-3054-4beb-b73c-21596f3b2d7e] succeeded in 1.7305415920000087s: None 2024-04-06T02:24:03.209342730Z [2024-04-06 02:24:03,209: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:24:03.214271419Z [2024-04-06 02:24:03,212: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:24:03.280100047Z [2024-04-06 02:24:03,279: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:24:03.290298397Z [2024-04-06 02:24:03,290: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:24:03.292004442Z [2024-04-06 02:24:03,291: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:24:03.294157042Z [2024-04-06 02:24:03,293: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:24:03.294269460Z [2024-04-06 02:24:03,294: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:24:03.294555605Z [2024-04-06 02:24:03,294: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:24:03.296875825Z [2024-04-06 02:24:03,295: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:24:03.447598483Z [2024-04-06 02:24:03,447: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:24:03.598952936Z [2024-04-06 02:24:03,598: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:24:03.603854748Z [2024-04-06 02:24:03,603: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:24:03.658385068Z [2024-04-06 02:24:03,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:24:03.662388928Z [2024-04-06 02:24:03,662: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:24:03.662439501Z [2024-04-06 02:24:03,662: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:24:03.662508844Z [2024-04-06 02:24:03,662: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:24:03.662579848Z [2024-04-06 02:24:03,662: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:24:03.662772258Z [2024-04-06 02:24:03,662: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:24:03.662784526Z [2024-04-06 02:24:03,662: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:24:03.772615219Z [2024-04-06 02:24:03,772: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:24:05.590100391Z [2024-04-06 02:24:05,589: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[150eff79-72e7-4882-8b82-17ea7cb77fb8] succeeded in 4.494127424999988s: None 2024-04-06T02:24:05.635012062Z [2024-04-06 02:24:05,634: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30b6745c-4a90-4776-9515-6f7a974321f6] succeeded in 4.5181481250001525s: None 2024-04-06T02:25:00.592737907Z [2024-04-06 02:25:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0fd2767-fdc8-47d0-9158-e2f6ca5f42f9] received 2024-04-06T02:25:00.594888222Z [2024-04-06 02:25:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3471dec-26ce-41ae-93bd-8a6aee6365e0] received 2024-04-06T02:25:00.600068237Z [2024-04-06 02:25:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41489524-f73d-4600-bf21-0d412fe8704d] received 2024-04-06T02:25:00.602179416Z [2024-04-06 02:25:00,601: INFO/ForkPoolWorker-15] [b0fd2767-fdc8-47d0-9158-e2f6ca5f42f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:25:00.616063243Z [2024-04-06 02:25:00,615: INFO/ForkPoolWorker-16] [e3471dec-26ce-41ae-93bd-8a6aee6365e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:25:00.617597143Z [2024-04-06 02:25:00,617: INFO/ForkPoolWorker-1] [41489524-f73d-4600-bf21-0d412fe8704d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:25:00.979607278Z [2024-04-06 02:25:00,975: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:25:01.010426945Z [2024-04-06 02:25:01,006: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:25:01.019320898Z [2024-04-06 02:25:01,016: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:25:02.602219621Z [2024-04-06 02:25:02,601: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:25:02.606277791Z [2024-04-06 02:25:02,605: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:02.681922072Z [2024-04-06 02:25:02,681: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:25:02.684524141Z [2024-04-06 02:25:02,684: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:25:02.684715539Z [2024-04-06 02:25:02,684: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:25:02.684956244Z [2024-04-06 02:25:02,684: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:02.685101430Z [2024-04-06 02:25:02,684: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:25:02.685499063Z [2024-04-06 02:25:02,685: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:25:02.685674627Z [2024-04-06 02:25:02,685: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:25:02.774372595Z [2024-04-06 02:25:02,774: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:03.048737831Z [2024-04-06 02:25:03,048: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:25:03.052347600Z [2024-04-06 02:25:03,051: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:03.111455614Z [2024-04-06 02:25:03,111: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:25:03.114212073Z [2024-04-06 02:25:03,113: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:25:03.114232502Z [2024-04-06 02:25:03,114: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:25:03.114355470Z [2024-04-06 02:25:03,114: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:03.114369661Z [2024-04-06 02:25:03,114: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:25:03.114616633Z [2024-04-06 02:25:03,114: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:25:03.114626971Z [2024-04-06 02:25:03,114: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:25:03.234811962Z [2024-04-06 02:25:03,234: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:03.313981899Z [2024-04-06 02:25:03,303: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:25:03.314010428Z [2024-04-06 02:25:03,311: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:03.354794527Z [2024-04-06 02:25:03,354: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:25:03.356742931Z [2024-04-06 02:25:03,356: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:25:03.356760810Z [2024-04-06 02:25:03,356: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:25:03.356764691Z [2024-04-06 02:25:03,356: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:03.356768486Z [2024-04-06 02:25:03,356: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:25:03.357088635Z [2024-04-06 02:25:03,356: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:25:03.357137236Z [2024-04-06 02:25:03,357: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:25:03.517336788Z [2024-04-06 02:25:03,516: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:04.416464695Z [2024-04-06 02:25:04,416: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0fd2767-fdc8-47d0-9158-e2f6ca5f42f9] succeeded in 3.820176255000206s: None 2024-04-06T02:25:04.736305575Z [2024-04-06 02:25:04,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7957e11-1aec-4f6f-bb50-183db2d66d6d] received 2024-04-06T02:25:04.752575097Z [2024-04-06 02:25:04,752: INFO/ForkPoolWorker-15] [e7957e11-1aec-4f6f-bb50-183db2d66d6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:25:05.164665707Z [2024-04-06 02:25:05,164: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3471dec-26ce-41ae-93bd-8a6aee6365e0] succeeded in 4.5635131250000995s: None 2024-04-06T02:25:05.208612177Z [2024-04-06 02:25:05,205: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:25:05.826826817Z [2024-04-06 02:25:05,826: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41489524-f73d-4600-bf21-0d412fe8704d] succeeded in 5.223156720000134s: None 2024-04-06T02:25:06.407741968Z [2024-04-06 02:25:06,407: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:25:06.410958875Z [2024-04-06 02:25:06,410: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:06.450097901Z [2024-04-06 02:25:06,449: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:25:06.451867985Z [2024-04-06 02:25:06,451: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:25:06.451900456Z [2024-04-06 02:25:06,451: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:25:06.452130318Z [2024-04-06 02:25:06,451: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:06.452154241Z [2024-04-06 02:25:06,452: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:25:06.452531009Z [2024-04-06 02:25:06,452: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:25:06.452554519Z [2024-04-06 02:25:06,452: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:25:06.552102520Z [2024-04-06 02:25:06,551: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:07.173058288Z [2024-04-06 02:25:07,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d2093d9-2493-42c0-92cc-bb503ec2f205] received 2024-04-06T02:25:07.185073169Z [2024-04-06 02:25:07,184: INFO/ForkPoolWorker-16] [8d2093d9-2493-42c0-92cc-bb503ec2f205] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:25:07.236230353Z [2024-04-06 02:25:07,235: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7957e11-1aec-4f6f-bb50-183db2d66d6d] succeeded in 2.4979265789997953s: None 2024-04-06T02:25:07.458521515Z [2024-04-06 02:25:07,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:25:08.612503629Z [2024-04-06 02:25:08,609: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:25:08.612827541Z [2024-04-06 02:25:08,612: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:08.649130398Z [2024-04-06 02:25:08,648: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:25:08.651964152Z [2024-04-06 02:25:08,650: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:25:08.652141060Z [2024-04-06 02:25:08,652: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:25:08.652381567Z [2024-04-06 02:25:08,652: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:08.652614438Z [2024-04-06 02:25:08,652: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:25:08.652893583Z [2024-04-06 02:25:08,652: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:25:08.653028648Z [2024-04-06 02:25:08,652: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:25:08.743973950Z [2024-04-06 02:25:08,743: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:09.288277955Z [2024-04-06 02:25:09,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cefd9c43-884a-443e-9ac2-63921a7cdd12] received 2024-04-06T02:25:09.294976271Z [2024-04-06 02:25:09,294: INFO/ForkPoolWorker-15] [cefd9c43-884a-443e-9ac2-63921a7cdd12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:25:09.361028154Z [2024-04-06 02:25:09,360: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8d2093d9-2493-42c0-92cc-bb503ec2f205] succeeded in 2.1861310629997206s: None 2024-04-06T02:25:09.629241514Z [2024-04-06 02:25:09,626: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:25:10.822029237Z [2024-04-06 02:25:10,821: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:25:10.825869311Z [2024-04-06 02:25:10,825: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:10.864417144Z [2024-04-06 02:25:10,864: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:25:10.867323891Z [2024-04-06 02:25:10,867: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:25:10.867447653Z [2024-04-06 02:25:10,867: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:25:10.867646083Z [2024-04-06 02:25:10,867: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:10.867763765Z [2024-04-06 02:25:10,867: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:25:10.868088308Z [2024-04-06 02:25:10,867: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:25:10.868220176Z [2024-04-06 02:25:10,868: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:25:10.965827334Z [2024-04-06 02:25:10,965: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:11.740859607Z [2024-04-06 02:25:11,738: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cefd9c43-884a-443e-9ac2-63921a7cdd12] succeeded in 2.4484816730000603s: None 2024-04-06T02:26:00.798502400Z [2024-04-06 02:26:00,797: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d304116-c09e-49b6-8a2c-6f086a3a88d6] received 2024-04-06T02:26:00.807446569Z [2024-04-06 02:26:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0802159-fea9-4f8b-ba44-33770a750406] received 2024-04-06T02:26:00.813247165Z [2024-04-06 02:26:00,812: INFO/ForkPoolWorker-15] [1d304116-c09e-49b6-8a2c-6f086a3a88d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:26:00.816314351Z [2024-04-06 02:26:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfee7e42-1e72-4b9e-aef6-d3a0876bfd00] received 2024-04-06T02:26:00.827493334Z [2024-04-06 02:26:00,827: INFO/ForkPoolWorker-16] [f0802159-fea9-4f8b-ba44-33770a750406] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:26:00.845138655Z [2024-04-06 02:26:00,844: INFO/ForkPoolWorker-1] [dfee7e42-1e72-4b9e-aef6-d3a0876bfd00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:26:01.206378472Z [2024-04-06 02:26:01,202: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:26:01.242367058Z [2024-04-06 02:26:01,239: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:26:01.291868613Z [2024-04-06 02:26:01,283: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:26:01.694179707Z [2024-04-06 02:26:01,682: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:26:02.763253310Z [2024-04-06 02:26:02,762: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0802159-fea9-4f8b-ba44-33770a750406] succeeded in 1.9530565390000447s: None 2024-04-06T02:26:02.867095296Z [2024-04-06 02:26:02,866: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:26:02.870513330Z [2024-04-06 02:26:02,870: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:26:02.933165594Z [2024-04-06 02:26:02,932: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:26:02.936173963Z [2024-04-06 02:26:02,935: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:26:02.936391182Z [2024-04-06 02:26:02,936: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:26:02.936587314Z [2024-04-06 02:26:02,936: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:26:02.936717613Z [2024-04-06 02:26:02,936: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:26:02.937029537Z [2024-04-06 02:26:02,936: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:26:02.937165512Z [2024-04-06 02:26:02,937: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:26:03.020686508Z [2024-04-06 02:26:03,020: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:26:03.179083490Z [2024-04-06 02:26:03,178: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:26:03.182808151Z [2024-04-06 02:26:03,182: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:26:03.221193752Z [2024-04-06 02:26:03,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:26:03.223375772Z [2024-04-06 02:26:03,223: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:26:03.223548435Z [2024-04-06 02:26:03,223: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:26:03.223790976Z [2024-04-06 02:26:03,223: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:26:03.223941706Z [2024-04-06 02:26:03,223: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:26:03.224346086Z [2024-04-06 02:26:03,224: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:26:03.224519276Z [2024-04-06 02:26:03,224: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:26:03.357506426Z [2024-04-06 02:26:03,357: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:26:05.417838265Z [2024-04-06 02:26:05,417: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dfee7e42-1e72-4b9e-aef6-d3a0876bfd00] succeeded in 4.587814276999779s: None 2024-04-06T02:26:05.709539021Z [2024-04-06 02:26:05,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d304116-c09e-49b6-8a2c-6f086a3a88d6] succeeded in 4.907629000999805s: None 2024-04-06T02:27:00.896306819Z [2024-04-06 02:27:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6861d1d9-2ad3-473c-aa1c-bf54c3771940] received 2024-04-06T02:27:00.909084270Z [2024-04-06 02:27:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3c3fc24-511b-4ea7-9eb5-6db935345045] received 2024-04-06T02:27:00.917192380Z [2024-04-06 02:27:00,916: INFO/ForkPoolWorker-15] [6861d1d9-2ad3-473c-aa1c-bf54c3771940] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:27:00.927300638Z [2024-04-06 02:27:00,926: INFO/ForkPoolWorker-16] [a3c3fc24-511b-4ea7-9eb5-6db935345045] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:27:01.366950605Z [2024-04-06 02:27:01,363: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:27:01.650998208Z [2024-04-06 02:27:01,634: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:27:03.150122292Z [2024-04-06 02:27:03,149: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:27:03.153828919Z [2024-04-06 02:27:03,153: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:27:03.215497665Z [2024-04-06 02:27:03,215: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:27:03.223071723Z [2024-04-06 02:27:03,222: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:27:03.223242968Z [2024-04-06 02:27:03,223: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:27:03.223531656Z [2024-04-06 02:27:03,223: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:27:03.223761570Z [2024-04-06 02:27:03,223: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:27:03.224250449Z [2024-04-06 02:27:03,224: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:27:03.224453376Z [2024-04-06 02:27:03,224: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:27:03.280083618Z [2024-04-06 02:27:03,279: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:27:03.283757433Z [2024-04-06 02:27:03,283: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:27:03.339137000Z [2024-04-06 02:27:03,338: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:27:03.344595637Z [2024-04-06 02:27:03,344: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:27:03.344704822Z [2024-04-06 02:27:03,344: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:27:03.344869826Z [2024-04-06 02:27:03,344: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:27:03.344921860Z [2024-04-06 02:27:03,344: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:27:03.345224304Z [2024-04-06 02:27:03,345: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:27:03.345324624Z [2024-04-06 02:27:03,345: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:27:03.354192219Z [2024-04-06 02:27:03,353: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:27:03.428410047Z [2024-04-06 02:27:03,428: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:27:05.308932210Z [2024-04-06 02:27:05,308: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3c3fc24-511b-4ea7-9eb5-6db935345045] succeeded in 4.393682942999931s: None 2024-04-06T02:27:06.685398714Z [2024-04-06 02:27:06,684: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6861d1d9-2ad3-473c-aa1c-bf54c3771940] succeeded in 5.785743942999943s: None 2024-04-06T02:28:00.802773679Z [2024-04-06 02:28:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89a1dc71-4366-4c8e-9811-9542d0b6ce75] received 2024-04-06T02:28:00.811440483Z [2024-04-06 02:28:00,811: INFO/ForkPoolWorker-15] [89a1dc71-4366-4c8e-9811-9542d0b6ce75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:28:00.821091458Z [2024-04-06 02:28:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ce52a19-0ba6-404e-97c4-1c3928063c35] received 2024-04-06T02:28:00.842470339Z [2024-04-06 02:28:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65f8fa0f-8caa-44a7-aec5-1b4fcd0591bd] received 2024-04-06T02:28:00.846764533Z [2024-04-06 02:28:00,846: INFO/ForkPoolWorker-16] [4ce52a19-0ba6-404e-97c4-1c3928063c35] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:28:00.867856789Z [2024-04-06 02:28:00,867: INFO/ForkPoolWorker-1] [65f8fa0f-8caa-44a7-aec5-1b4fcd0591bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:28:01.292130619Z [2024-04-06 02:28:01,288: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:28:01.319029310Z [2024-04-06 02:28:01,307: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:28:01.776146490Z [2024-04-06 02:28:01,748: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:28:01.929915972Z [2024-04-06 02:28:01,929: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:28:02.893378739Z [2024-04-06 02:28:02,893: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:28:02.896657282Z [2024-04-06 02:28:02,896: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:28:02.978964998Z [2024-04-06 02:28:02,978: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:28:02.988028356Z [2024-04-06 02:28:02,987: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:28:02.988490128Z [2024-04-06 02:28:02,987: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:28:02.988721161Z [2024-04-06 02:28:02,988: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:28:02.988821343Z [2024-04-06 02:28:02,988: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:28:02.989092385Z [2024-04-06 02:28:02,988: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:28:02.989466932Z [2024-04-06 02:28:02,989: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:28:03.103817945Z [2024-04-06 02:28:03,103: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:28:03.454621312Z [2024-04-06 02:28:03,454: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ce52a19-0ba6-404e-97c4-1c3928063c35] succeeded in 2.630880321999939s: None 2024-04-06T02:28:03.563456532Z [2024-04-06 02:28:03,563: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:28:03.566689911Z [2024-04-06 02:28:03,566: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:28:03.602502403Z [2024-04-06 02:28:03,602: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:28:03.606130291Z [2024-04-06 02:28:03,604: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:28:03.606181065Z [2024-04-06 02:28:03,606: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:28:03.606346921Z [2024-04-06 02:28:03,606: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:28:03.606410223Z [2024-04-06 02:28:03,606: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:28:03.606660763Z [2024-04-06 02:28:03,606: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:28:03.606734554Z [2024-04-06 02:28:03,606: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:28:03.736810927Z [2024-04-06 02:28:03,736: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:28:05.401703404Z [2024-04-06 02:28:05,401: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89a1dc71-4366-4c8e-9811-9542d0b6ce75] succeeded in 4.596963040999981s: None 2024-04-06T02:28:05.793072179Z [2024-04-06 02:28:05,792: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[65f8fa0f-8caa-44a7-aec5-1b4fcd0591bd] succeeded in 4.945516951000172s: None 2024-04-06T02:29:01.322002804Z [2024-04-06 02:29:01,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46176c3c-36f0-47e8-958b-dcec7cd40ab9] received 2024-04-06T02:29:01.325519424Z [2024-04-06 02:29:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc58718e-ca06-46c4-aed4-056203085a3c] received 2024-04-06T02:29:01.338345579Z [2024-04-06 02:29:01,337: INFO/ForkPoolWorker-15] [46176c3c-36f0-47e8-958b-dcec7cd40ab9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:29:01.338689257Z [2024-04-06 02:29:01,338: INFO/ForkPoolWorker-16] [fc58718e-ca06-46c4-aed4-056203085a3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:29:01.838368801Z [2024-04-06 02:29:01,834: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:29:01.952017102Z [2024-04-06 02:29:01,947: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:29:03.306477915Z [2024-04-06 02:29:03,306: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:29:03.310335725Z [2024-04-06 02:29:03,309: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:29:03.358920115Z [2024-04-06 02:29:03,358: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:29:03.360635505Z [2024-04-06 02:29:03,360: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:29:03.360836969Z [2024-04-06 02:29:03,360: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:29:03.361208500Z [2024-04-06 02:29:03,360: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:29:03.361549571Z [2024-04-06 02:29:03,361: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:29:03.362077176Z [2024-04-06 02:29:03,361: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:29:03.362337534Z [2024-04-06 02:29:03,362: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:29:03.467417531Z [2024-04-06 02:29:03,467: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:29:03.547602525Z [2024-04-06 02:29:03,547: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:29:03.552136884Z [2024-04-06 02:29:03,551: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:29:03.576068644Z [2024-04-06 02:29:03,575: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:29:03.577107054Z [2024-04-06 02:29:03,576: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:29:03.577379343Z [2024-04-06 02:29:03,577: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:29:03.577577419Z [2024-04-06 02:29:03,577: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:29:03.577716980Z [2024-04-06 02:29:03,577: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:29:03.578116510Z [2024-04-06 02:29:03,577: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:29:03.578220791Z [2024-04-06 02:29:03,578: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:29:03.723567122Z [2024-04-06 02:29:03,723: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:29:05.558795349Z [2024-04-06 02:29:05,558: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc58718e-ca06-46c4-aed4-056203085a3c] succeeded in 4.228342571999747s: None 2024-04-06T02:29:05.641064373Z [2024-04-06 02:29:05,640: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46176c3c-36f0-47e8-958b-dcec7cd40ab9] succeeded in 4.3133723159999136s: None 2024-04-06T02:30:00.770420306Z [2024-04-06 02:30:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eeb62c3-c1e6-4902-be25-57e79d5773e4] received 2024-04-06T02:30:00.770456224Z [2024-04-06 02:30:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c840025b-3cc7-411d-a36f-c78e17495989] received 2024-04-06T02:30:00.776149827Z [2024-04-06 02:30:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4942b9a-1d86-4d00-8c7f-f7a77141869a] received 2024-04-06T02:30:00.777370367Z [2024-04-06 02:30:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1c5f2da-5f4f-4271-9fcd-0b18129ec1ea] received 2024-04-06T02:30:00.788884772Z [2024-04-06 02:30:00,785: INFO/ForkPoolWorker-15] [8eeb62c3-c1e6-4902-be25-57e79d5773e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:30:00.792549282Z [2024-04-06 02:30:00,789: INFO/ForkPoolWorker-16] [c840025b-3cc7-411d-a36f-c78e17495989] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:30:00.840015027Z [2024-04-06 02:30:00,839: INFO/ForkPoolWorker-1] [c4942b9a-1d86-4d00-8c7f-f7a77141869a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:30:00.848510731Z [2024-04-06 02:30:00,841: INFO/ForkPoolWorker-2] [e1c5f2da-5f4f-4271-9fcd-0b18129ec1ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:30:01.335283103Z [2024-04-06 02:30:01,330: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:30:01.393154360Z [2024-04-06 02:30:01,369: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:30:01.447669588Z [2024-04-06 02:30:01,438: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:30:01.779851045Z [2024-04-06 02:30:01,775: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:30:02.161966760Z [2024-04-06 02:30:02,161: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:03.369710905Z [2024-04-06 02:30:03,369: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:30:03.373340139Z [2024-04-06 02:30:03,372: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:03.501226994Z [2024-04-06 02:30:03,500: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:30:03.503695459Z [2024-04-06 02:30:03,503: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:30:03.503718072Z [2024-04-06 02:30:03,503: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:30:03.503929732Z [2024-04-06 02:30:03,503: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:03.504172630Z [2024-04-06 02:30:03,503: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:30:03.504467974Z [2024-04-06 02:30:03,504: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:30:03.504571619Z [2024-04-06 02:30:03,504: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:30:03.631894669Z [2024-04-06 02:30:03,631: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:03.895891977Z [2024-04-06 02:30:03,895: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:30:03.899616699Z [2024-04-06 02:30:03,899: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:03.915607915Z [2024-04-06 02:30:03,915: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c840025b-3cc7-411d-a36f-c78e17495989] succeeded in 3.1458026999998765s: None 2024-04-06T02:30:03.954283336Z [2024-04-06 02:30:03,954: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:30:03.956379877Z [2024-04-06 02:30:03,956: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:30:03.956932320Z [2024-04-06 02:30:03,956: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:30:03.957247122Z [2024-04-06 02:30:03,956: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:03.957501267Z [2024-04-06 02:30:03,957: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:30:03.957929575Z [2024-04-06 02:30:03,957: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:30:03.958189792Z [2024-04-06 02:30:03,957: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:30:04.071191432Z [2024-04-06 02:30:04,070: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:04.807368744Z [2024-04-06 02:30:04,805: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:30:04.814136115Z [2024-04-06 02:30:04,813: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:04.843108885Z [2024-04-06 02:30:04,842: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:30:04.844327743Z [2024-04-06 02:30:04,843: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:30:04.844478672Z [2024-04-06 02:30:04,844: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:30:04.844680362Z [2024-04-06 02:30:04,844: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:04.844809462Z [2024-04-06 02:30:04,844: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:30:04.845259033Z [2024-04-06 02:30:04,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:30:04.845396725Z [2024-04-06 02:30:04,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:30:04.939334916Z [2024-04-06 02:30:04,939: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:05.620050380Z [2024-04-06 02:30:05,619: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8eeb62c3-c1e6-4902-be25-57e79d5773e4] succeeded in 4.845151239000188s: None 2024-04-06T02:30:05.825799510Z [2024-04-06 02:30:05,825: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c4942b9a-1d86-4d00-8c7f-f7a77141869a] succeeded in 5.049899732000085s: None 2024-04-06T02:30:05.864274821Z [2024-04-06 02:30:05,863: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e1c5f2da-5f4f-4271-9fcd-0b18129ec1ea] succeeded in 5.084275505999358s: None 2024-04-06T02:30:06.364116759Z [2024-04-06 02:30:06,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e857b597-5f4f-477b-a163-3c547e3d663c] received 2024-04-06T02:30:06.373781477Z [2024-04-06 02:30:06,373: INFO/ForkPoolWorker-15] [e857b597-5f4f-477b-a163-3c547e3d663c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:30:06.659379132Z [2024-04-06 02:30:06,656: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:30:07.734064459Z [2024-04-06 02:30:07,733: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:30:07.737425218Z [2024-04-06 02:30:07,737: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:07.780617416Z [2024-04-06 02:30:07,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:30:07.781629282Z [2024-04-06 02:30:07,781: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:30:07.781743213Z [2024-04-06 02:30:07,781: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:30:07.781953719Z [2024-04-06 02:30:07,781: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:07.782083335Z [2024-04-06 02:30:07,781: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:30:07.782325369Z [2024-04-06 02:30:07,782: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:30:07.782572723Z [2024-04-06 02:30:07,782: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:30:07.860758839Z [2024-04-06 02:30:07,860: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:08.629350622Z [2024-04-06 02:30:08,628: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e857b597-5f4f-477b-a163-3c547e3d663c] succeeded in 2.2635616440002195s: None 2024-04-06T02:30:08.714514649Z [2024-04-06 02:30:08,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57b416f0-a324-423b-8be2-b8085d4439d1] received 2024-04-06T02:30:08.730422949Z [2024-04-06 02:30:08,730: INFO/ForkPoolWorker-15] [57b416f0-a324-423b-8be2-b8085d4439d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:30:09.034880918Z [2024-04-06 02:30:09,031: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:30:10.157270117Z [2024-04-06 02:30:10,156: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:30:10.160556408Z [2024-04-06 02:30:10,160: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:10.234811454Z [2024-04-06 02:30:10,234: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:30:10.240993779Z [2024-04-06 02:30:10,240: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:30:10.241322377Z [2024-04-06 02:30:10,241: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:30:10.241754820Z [2024-04-06 02:30:10,241: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:10.242115180Z [2024-04-06 02:30:10,241: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:30:10.242615106Z [2024-04-06 02:30:10,242: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:30:10.243356323Z [2024-04-06 02:30:10,243: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:30:10.333622971Z [2024-04-06 02:30:10,333: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:10.879108734Z [2024-04-06 02:30:10,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57b416f0-a324-423b-8be2-b8085d4439d1] succeeded in 2.1603062619997218s: None 2024-04-06T02:30:11.776685397Z [2024-04-06 02:30:11,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5384848-0a7b-40d3-88cc-ede63b05eb6f] received 2024-04-06T02:30:11.790513141Z [2024-04-06 02:30:11,790: INFO/ForkPoolWorker-15] [f5384848-0a7b-40d3-88cc-ede63b05eb6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:30:12.105817724Z [2024-04-06 02:30:12,101: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:30:13.232946438Z [2024-04-06 02:30:13,232: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:30:13.237064565Z [2024-04-06 02:30:13,236: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:13.267603644Z [2024-04-06 02:30:13,267: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:30:13.268887148Z [2024-04-06 02:30:13,268: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:30:13.269086033Z [2024-04-06 02:30:13,268: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:30:13.269327414Z [2024-04-06 02:30:13,269: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:13.269514752Z [2024-04-06 02:30:13,269: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:30:13.269841885Z [2024-04-06 02:30:13,269: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:30:13.270037620Z [2024-04-06 02:30:13,269: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:30:13.364878324Z [2024-04-06 02:30:13,364: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:13.966475706Z [2024-04-06 02:30:13,965: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5384848-0a7b-40d3-88cc-ede63b05eb6f] succeeded in 2.1839131469996573s: None 2024-04-06T02:31:01.069148264Z [2024-04-06 02:31:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb1d66a3-a47e-442e-8048-37cae11a595f] received 2024-04-06T02:31:01.078549697Z [2024-04-06 02:31:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f78d602-dfc4-473e-8c77-17858a9298da] received 2024-04-06T02:31:01.088491191Z [2024-04-06 02:31:01,088: INFO/ForkPoolWorker-15] [cb1d66a3-a47e-442e-8048-37cae11a595f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:31:01.088941403Z [2024-04-06 02:31:01,088: INFO/ForkPoolWorker-16] [3f78d602-dfc4-473e-8c77-17858a9298da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:31:01.476690125Z [2024-04-06 02:31:01,472: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:31:01.519518705Z [2024-04-06 02:31:01,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:31:02.995869753Z [2024-04-06 02:31:02,995: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:31:02.999561729Z [2024-04-06 02:31:02,999: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:31:03.024981786Z [2024-04-06 02:31:03,024: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:31:03.029383923Z [2024-04-06 02:31:03,028: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:31:03.059233469Z [2024-04-06 02:31:03,059: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:31:03.060756737Z [2024-04-06 02:31:03,060: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:31:03.060951673Z [2024-04-06 02:31:03,060: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:31:03.061198054Z [2024-04-06 02:31:03,060: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:31:03.061319755Z [2024-04-06 02:31:03,061: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:31:03.061586642Z [2024-04-06 02:31:03,061: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:31:03.061686983Z [2024-04-06 02:31:03,061: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:31:03.063519553Z [2024-04-06 02:31:03,063: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:31:03.067559468Z [2024-04-06 02:31:03,066: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:31:03.067898842Z [2024-04-06 02:31:03,067: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:31:03.072894873Z [2024-04-06 02:31:03,067: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:31:03.073933723Z [2024-04-06 02:31:03,072: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:31:03.082250824Z [2024-04-06 02:31:03,081: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:31:03.082415171Z [2024-04-06 02:31:03,082: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:31:03.159758500Z [2024-04-06 02:31:03,159: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:31:03.232542240Z [2024-04-06 02:31:03,232: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:31:05.732505093Z [2024-04-06 02:31:05,731: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f78d602-dfc4-473e-8c77-17858a9298da] succeeded in 4.651347404000262s: None 2024-04-06T02:31:06.893227043Z [2024-04-06 02:31:06,892: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb1d66a3-a47e-442e-8048-37cae11a595f] succeeded in 5.819294486000217s: None 2024-04-06T02:32:00.312649648Z [2024-04-06 02:32:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7521802-c0c3-4005-859b-adf35969105e] received 2024-04-06T02:32:00.314894648Z [2024-04-06 02:32:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bdb8531-ef8b-4e44-8cd6-345f08b6ac8d] received 2024-04-06T02:32:00.316137192Z [2024-04-06 02:32:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c1f0933-1b9e-423a-afd8-3982bdfaf445] received 2024-04-06T02:32:00.329992563Z [2024-04-06 02:32:00,329: INFO/ForkPoolWorker-15] [b7521802-c0c3-4005-859b-adf35969105e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:32:00.336424415Z [2024-04-06 02:32:00,336: INFO/ForkPoolWorker-16] [5bdb8531-ef8b-4e44-8cd6-345f08b6ac8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:32:00.339228781Z [2024-04-06 02:32:00,338: INFO/ForkPoolWorker-1] [9c1f0933-1b9e-423a-afd8-3982bdfaf445] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:32:00.622962794Z [2024-04-06 02:32:00,619: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:32:00.648156774Z [2024-04-06 02:32:00,644: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:32:00.659382572Z [2024-04-06 02:32:00,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:32:00.993261793Z [2024-04-06 02:32:00,992: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:32:01.793860729Z [2024-04-06 02:32:01,793: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5bdb8531-ef8b-4e44-8cd6-345f08b6ac8d] succeeded in 1.4750329250000505s: None 2024-04-06T02:32:02.700746267Z [2024-04-06 02:32:02,700: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:32:02.704529492Z [2024-04-06 02:32:02,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:32:02.754119741Z [2024-04-06 02:32:02,753: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:32:02.785491488Z [2024-04-06 02:32:02,785: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:32:02.785653141Z [2024-04-06 02:32:02,785: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:32:02.785865754Z [2024-04-06 02:32:02,785: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:32:02.786059896Z [2024-04-06 02:32:02,785: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:32:02.786412019Z [2024-04-06 02:32:02,786: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:32:02.786569515Z [2024-04-06 02:32:02,786: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:32:02.875639407Z [2024-04-06 02:32:02,875: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:32:02.986952801Z [2024-04-06 02:32:02,986: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:32:02.994145469Z [2024-04-06 02:32:02,989: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:32:03.058042732Z [2024-04-06 02:32:03,057: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:32:03.065572071Z [2024-04-06 02:32:03,064: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:32:03.065613552Z [2024-04-06 02:32:03,065: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:32:03.065743330Z [2024-04-06 02:32:03,065: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:32:03.065760987Z [2024-04-06 02:32:03,065: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:32:03.069015103Z [2024-04-06 02:32:03,068: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:32:03.069087194Z [2024-04-06 02:32:03,068: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:32:03.240654364Z [2024-04-06 02:32:03,240: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:32:05.291090617Z [2024-04-06 02:32:05,290: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9c1f0933-1b9e-423a-afd8-3982bdfaf445] succeeded in 4.970307605999551s: None 2024-04-06T02:32:05.735450701Z [2024-04-06 02:32:05,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7521802-c0c3-4005-859b-adf35969105e] succeeded in 5.419344418999572s: None 2024-04-06T02:33:00.249126233Z [2024-04-06 02:33:00,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8e9d818-6ee9-4d95-8a4d-48bbed2ddd05] received 2024-04-06T02:33:00.262519383Z [2024-04-06 02:33:00,262: INFO/ForkPoolWorker-15] [b8e9d818-6ee9-4d95-8a4d-48bbed2ddd05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:33:00.272713097Z [2024-04-06 02:33:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e1a0f4d-6982-4422-83ae-72f2be2a55c3] received 2024-04-06T02:33:00.285895315Z [2024-04-06 02:33:00,285: INFO/ForkPoolWorker-16] [4e1a0f4d-6982-4422-83ae-72f2be2a55c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:33:00.551218656Z [2024-04-06 02:33:00,547: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:33:00.566897116Z [2024-04-06 02:33:00,563: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:33:01.849069895Z [2024-04-06 02:33:01,848: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:33:01.853081803Z [2024-04-06 02:33:01,852: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:33:01.866036069Z [2024-04-06 02:33:01,865: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:33:01.876379101Z [2024-04-06 02:33:01,875: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:33:01.903431807Z [2024-04-06 02:33:01,903: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:33:01.908473940Z [2024-04-06 02:33:01,908: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:33:01.908681565Z [2024-04-06 02:33:01,908: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:33:01.908914133Z [2024-04-06 02:33:01,908: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:33:01.909135155Z [2024-04-06 02:33:01,908: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:33:01.909489470Z [2024-04-06 02:33:01,909: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:33:01.909682331Z [2024-04-06 02:33:01,909: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:33:01.947425854Z [2024-04-06 02:33:01,947: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:33:01.951128851Z [2024-04-06 02:33:01,950: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:33:01.951143230Z [2024-04-06 02:33:01,950: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:33:01.951147078Z [2024-04-06 02:33:01,950: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:33:01.953543931Z [2024-04-06 02:33:01,951: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:33:01.953560240Z [2024-04-06 02:33:01,953: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:33:01.953564561Z [2024-04-06 02:33:01,953: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:33:02.047762592Z [2024-04-06 02:33:02,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:33:02.072143392Z [2024-04-06 02:33:02,071: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:33:03.801037427Z [2024-04-06 02:33:03,800: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8e9d818-6ee9-4d95-8a4d-48bbed2ddd05] succeeded in 3.549166214000252s: None 2024-04-06T02:33:05.923303863Z [2024-04-06 02:33:05,922: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4e1a0f4d-6982-4422-83ae-72f2be2a55c3] succeeded in 5.648326819000431s: None 2024-04-06T02:34:00.392549897Z [2024-04-06 02:34:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a9e02d5-ffa4-4709-8a60-dbaccbcd9d10] received 2024-04-06T02:34:00.395947557Z [2024-04-06 02:34:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f41db8b-987d-435a-91ac-342261f1f9b7] received 2024-04-06T02:34:00.397151650Z [2024-04-06 02:34:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ab44cc4-3c07-4ec8-8f1d-cd0d31be3e11] received 2024-04-06T02:34:00.406354355Z [2024-04-06 02:34:00,406: INFO/ForkPoolWorker-15] [8a9e02d5-ffa4-4709-8a60-dbaccbcd9d10] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:34:00.410545549Z [2024-04-06 02:34:00,410: INFO/ForkPoolWorker-16] [2f41db8b-987d-435a-91ac-342261f1f9b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:34:00.411892977Z [2024-04-06 02:34:00,411: INFO/ForkPoolWorker-1] [8ab44cc4-3c07-4ec8-8f1d-cd0d31be3e11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:34:00.681085043Z [2024-04-06 02:34:00,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:34:00.743367594Z [2024-04-06 02:34:00,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:34:00.824203594Z [2024-04-06 02:34:00,819: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:34:01.027765896Z [2024-04-06 02:34:01,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:34:01.711344706Z [2024-04-06 02:34:01,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a9e02d5-ffa4-4709-8a60-dbaccbcd9d10] succeeded in 1.3112178479996146s: None 2024-04-06T02:34:02.690971212Z [2024-04-06 02:34:02,690: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:34:02.700643480Z [2024-04-06 02:34:02,700: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:34:02.732615347Z [2024-04-06 02:34:02,732: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:34:02.737134838Z [2024-04-06 02:34:02,736: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:34:02.780253049Z [2024-04-06 02:34:02,780: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:34:02.781573488Z [2024-04-06 02:34:02,781: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:34:02.781592895Z [2024-04-06 02:34:02,781: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:34:02.781733527Z [2024-04-06 02:34:02,781: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:34:02.781746819Z [2024-04-06 02:34:02,781: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:34:02.785930263Z [2024-04-06 02:34:02,785: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:34:02.785951336Z [2024-04-06 02:34:02,785: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:34:02.850130608Z [2024-04-06 02:34:02,849: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:34:02.857245229Z [2024-04-06 02:34:02,856: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:34:02.858335207Z [2024-04-06 02:34:02,857: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:34:02.860389806Z [2024-04-06 02:34:02,858: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:34:02.861963299Z [2024-04-06 02:34:02,860: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:34:02.863059305Z [2024-04-06 02:34:02,862: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:34:02.865065945Z [2024-04-06 02:34:02,863: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:34:02.935628191Z [2024-04-06 02:34:02,935: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:34:03.158179905Z [2024-04-06 02:34:03,152: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:34:05.068614851Z [2024-04-06 02:34:05,067: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f41db8b-987d-435a-91ac-342261f1f9b7] succeeded in 4.669591814999876s: None 2024-04-06T02:34:06.042403558Z [2024-04-06 02:34:06,041: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ab44cc4-3c07-4ec8-8f1d-cd0d31be3e11] succeeded in 5.640835444999539s: None 2024-04-06T02:35:00.280973196Z [2024-04-06 02:35:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b8efeb9-8feb-4d95-8614-59ab9cf22793] received 2024-04-06T02:35:00.283183488Z [2024-04-06 02:35:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7cc35c1-14fb-4090-a186-ddcf2857eca0] received 2024-04-06T02:35:00.285957665Z [2024-04-06 02:35:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b46682c0-87c9-4400-8289-6a2380780a45] received 2024-04-06T02:35:00.295181366Z [2024-04-06 02:35:00,294: INFO/ForkPoolWorker-15] [2b8efeb9-8feb-4d95-8614-59ab9cf22793] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:35:00.298136480Z [2024-04-06 02:35:00,297: INFO/ForkPoolWorker-1] [b46682c0-87c9-4400-8289-6a2380780a45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:35:00.299237848Z [2024-04-06 02:35:00,298: INFO/ForkPoolWorker-16] [a7cc35c1-14fb-4090-a186-ddcf2857eca0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:35:00.612503996Z [2024-04-06 02:35:00,609: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:35:00.616037347Z [2024-04-06 02:35:00,610: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:35:00.625436167Z [2024-04-06 02:35:00,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:35:02.451786778Z [2024-04-06 02:35:02,451: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:35:02.455429476Z [2024-04-06 02:35:02,454: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:02.517554685Z [2024-04-06 02:35:02,517: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:35:02.520528965Z [2024-04-06 02:35:02,520: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:35:02.520550187Z [2024-04-06 02:35:02,520: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:35:02.520710884Z [2024-04-06 02:35:02,520: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:02.520921759Z [2024-04-06 02:35:02,520: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:35:02.521240601Z [2024-04-06 02:35:02,521: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:35:02.521529891Z [2024-04-06 02:35:02,521: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:35:02.697521286Z [2024-04-06 02:35:02,697: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:02.927728717Z [2024-04-06 02:35:02,927: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:35:02.941448081Z [2024-04-06 02:35:02,940: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:02.999794045Z [2024-04-06 02:35:02,999: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:35:03.009724207Z [2024-04-06 02:35:03,009: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:03.070156858Z [2024-04-06 02:35:03,069: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:35:03.075179033Z [2024-04-06 02:35:03,074: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:35:03.076822496Z [2024-04-06 02:35:03,076: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:35:03.078451007Z [2024-04-06 02:35:03,076: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:03.078735715Z [2024-04-06 02:35:03,078: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:35:03.079213292Z [2024-04-06 02:35:03,078: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:35:03.079415711Z [2024-04-06 02:35:03,079: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:35:03.084518577Z [2024-04-06 02:35:03,084: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:35:03.086922050Z [2024-04-06 02:35:03,086: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:35:03.087007585Z [2024-04-06 02:35:03,086: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:35:03.087290437Z [2024-04-06 02:35:03,086: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:03.087552882Z [2024-04-06 02:35:03,087: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:35:03.087804386Z [2024-04-06 02:35:03,087: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:35:03.087894952Z [2024-04-06 02:35:03,087: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:35:03.199073078Z [2024-04-06 02:35:03,198: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:03.240238257Z [2024-04-06 02:35:03,239: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:04.059105566Z [2024-04-06 02:35:04,058: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b46682c0-87c9-4400-8289-6a2380780a45] succeeded in 3.771470741000485s: None 2024-04-06T02:35:04.231703094Z [2024-04-06 02:35:04,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7d32276-5bbb-4512-b59e-321ee0418050] received 2024-04-06T02:35:04.287837350Z [2024-04-06 02:35:04,279: INFO/ForkPoolWorker-1] [d7d32276-5bbb-4512-b59e-321ee0418050] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:35:04.784535564Z [2024-04-06 02:35:04,780: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:35:05.106244560Z [2024-04-06 02:35:05,105: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7cc35c1-14fb-4090-a186-ddcf2857eca0] succeeded in 4.818075156999839s: None 2024-04-06T02:35:05.123710064Z [2024-04-06 02:35:05,123: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b8efeb9-8feb-4d95-8614-59ab9cf22793] succeeded in 4.8380134609997185s: None 2024-04-06T02:35:06.154553098Z [2024-04-06 02:35:06,153: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:35:06.157291864Z [2024-04-06 02:35:06,156: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:06.191322638Z [2024-04-06 02:35:06,191: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:35:06.192920393Z [2024-04-06 02:35:06,192: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:35:06.192963098Z [2024-04-06 02:35:06,192: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:35:06.193080244Z [2024-04-06 02:35:06,192: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:06.193120756Z [2024-04-06 02:35:06,193: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:35:06.193587904Z [2024-04-06 02:35:06,193: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:35:06.193601960Z [2024-04-06 02:35:06,193: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:35:06.279438256Z [2024-04-06 02:35:06,278: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:06.938146282Z [2024-04-06 02:35:06,937: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d7d32276-5bbb-4512-b59e-321ee0418050] succeeded in 2.6962244139995164s: None 2024-04-06T02:35:08.014358225Z [2024-04-06 02:35:08,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22915c3c-3903-4843-b7d7-2ec643f6ea42] received 2024-04-06T02:35:08.021637518Z [2024-04-06 02:35:08,021: INFO/ForkPoolWorker-15] [22915c3c-3903-4843-b7d7-2ec643f6ea42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:35:08.415603436Z [2024-04-06 02:35:08,411: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:35:09.598620102Z [2024-04-06 02:35:09,598: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:35:09.601873265Z [2024-04-06 02:35:09,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:09.644493204Z [2024-04-06 02:35:09,644: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:35:09.646314378Z [2024-04-06 02:35:09,646: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:35:09.646384535Z [2024-04-06 02:35:09,646: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:35:09.646562477Z [2024-04-06 02:35:09,646: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:09.646652783Z [2024-04-06 02:35:09,646: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:35:09.646931228Z [2024-04-06 02:35:09,646: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:35:09.647001657Z [2024-04-06 02:35:09,646: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:35:09.739444250Z [2024-04-06 02:35:09,738: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:10.325213769Z [2024-04-06 02:35:10,324: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22915c3c-3903-4843-b7d7-2ec643f6ea42] succeeded in 2.308633534999899s: None 2024-04-06T02:35:10.608645114Z [2024-04-06 02:35:10,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[883b46ce-2ef6-454c-988b-bbbd0987f975] received 2024-04-06T02:35:10.619289359Z [2024-04-06 02:35:10,619: INFO/ForkPoolWorker-15] [883b46ce-2ef6-454c-988b-bbbd0987f975] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:35:10.976606195Z [2024-04-06 02:35:10,973: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:35:12.310400007Z [2024-04-06 02:35:12,309: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:35:12.313670422Z [2024-04-06 02:35:12,313: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:12.346527702Z [2024-04-06 02:35:12,346: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:35:12.348248890Z [2024-04-06 02:35:12,347: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:35:12.348822382Z [2024-04-06 02:35:12,348: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:35:12.349005056Z [2024-04-06 02:35:12,348: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:12.349112745Z [2024-04-06 02:35:12,348: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:35:12.349549478Z [2024-04-06 02:35:12,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:35:12.349599304Z [2024-04-06 02:35:12,349: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:35:12.440177667Z [2024-04-06 02:35:12,439: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:13.202480746Z [2024-04-06 02:35:13,201: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[883b46ce-2ef6-454c-988b-bbbd0987f975] succeeded in 2.5913367290004317s: None 2024-04-06T02:36:00.442660418Z [2024-04-06 02:36:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[062e7991-1e80-4ff3-9388-7a53e5d3b775] received 2024-04-06T02:36:00.448277568Z [2024-04-06 02:36:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3eff0725-615e-4b49-b495-c54be6c042ee] received 2024-04-06T02:36:00.456174775Z [2024-04-06 02:36:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89873863-eb42-40d5-a8c3-b521f570db53] received 2024-04-06T02:36:00.456753122Z [2024-04-06 02:36:00,456: INFO/ForkPoolWorker-15] [062e7991-1e80-4ff3-9388-7a53e5d3b775] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:36:00.459744418Z [2024-04-06 02:36:00,459: INFO/ForkPoolWorker-16] [3eff0725-615e-4b49-b495-c54be6c042ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:36:00.493710274Z [2024-04-06 02:36:00,493: INFO/ForkPoolWorker-1] [89873863-eb42-40d5-a8c3-b521f570db53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:36:00.813599743Z [2024-04-06 02:36:00,808: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:36:00.872785775Z [2024-04-06 02:36:00,868: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:36:00.953873418Z [2024-04-06 02:36:00,949: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:36:01.183482895Z [2024-04-06 02:36:01,183: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:36:02.197230131Z [2024-04-06 02:36:02,186: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[062e7991-1e80-4ff3-9388-7a53e5d3b775] succeeded in 1.741698102000555s: None 2024-04-06T02:36:02.987088519Z [2024-04-06 02:36:02,986: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:36:02.990830208Z [2024-04-06 02:36:02,990: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:36:03.072871467Z [2024-04-06 02:36:03,072: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:36:03.075019142Z [2024-04-06 02:36:03,074: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:36:03.075214739Z [2024-04-06 02:36:03,074: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:36:03.075406189Z [2024-04-06 02:36:03,075: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:36:03.075460693Z [2024-04-06 02:36:03,075: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:36:03.075755170Z [2024-04-06 02:36:03,075: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:36:03.075824488Z [2024-04-06 02:36:03,075: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:36:03.200542666Z [2024-04-06 02:36:03,200: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:36:03.547662318Z [2024-04-06 02:36:03,547: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:36:03.561331572Z [2024-04-06 02:36:03,560: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:36:03.640289024Z [2024-04-06 02:36:03,640: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:36:03.642403119Z [2024-04-06 02:36:03,642: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:36:03.647255474Z [2024-04-06 02:36:03,646: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:36:03.647571721Z [2024-04-06 02:36:03,647: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:36:03.647733807Z [2024-04-06 02:36:03,647: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:36:03.648831961Z [2024-04-06 02:36:03,648: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:36:03.649577147Z [2024-04-06 02:36:03,649: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:36:03.839943230Z [2024-04-06 02:36:03,839: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:36:05.863885386Z [2024-04-06 02:36:05,863: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[89873863-eb42-40d5-a8c3-b521f570db53] succeeded in 5.404070921999846s: None 2024-04-06T02:36:06.035479726Z [2024-04-06 02:36:06,034: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3eff0725-615e-4b49-b495-c54be6c042ee] succeeded in 5.58539779900002s: None 2024-04-06T02:37:01.028531076Z [2024-04-06 02:37:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04bbb2b8-9869-4590-b241-699a0ee177db] received 2024-04-06T02:37:01.034319718Z [2024-04-06 02:37:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f668b757-c1de-430b-92da-dcc4e7431f24] received 2024-04-06T02:37:01.053040034Z [2024-04-06 02:37:01,052: INFO/ForkPoolWorker-16] [f668b757-c1de-430b-92da-dcc4e7431f24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:37:01.057582054Z [2024-04-06 02:37:01,057: INFO/ForkPoolWorker-15] [04bbb2b8-9869-4590-b241-699a0ee177db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:37:01.413904861Z [2024-04-06 02:37:01,409: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:37:01.459507491Z [2024-04-06 02:37:01,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:37:03.409762340Z [2024-04-06 02:37:03,409: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:37:03.414047523Z [2024-04-06 02:37:03,413: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:37:03.483681738Z [2024-04-06 02:37:03,483: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:37:03.488853334Z [2024-04-06 02:37:03,488: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:37:03.488895874Z [2024-04-06 02:37:03,488: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:37:03.490434755Z [2024-04-06 02:37:03,489: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:37:03.490770893Z [2024-04-06 02:37:03,490: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:37:03.492084288Z [2024-04-06 02:37:03,491: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:37:03.522305082Z [2024-04-06 02:37:03,492: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:37:03.627562191Z [2024-04-06 02:37:03,627: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:37:03.716566831Z [2024-04-06 02:37:03,716: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:37:03.719832644Z [2024-04-06 02:37:03,719: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:37:03.766506917Z [2024-04-06 02:37:03,766: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:37:03.770696807Z [2024-04-06 02:37:03,770: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:37:03.778053073Z [2024-04-06 02:37:03,770: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:37:03.778414489Z [2024-04-06 02:37:03,778: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:37:03.778531373Z [2024-04-06 02:37:03,778: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:37:03.778930180Z [2024-04-06 02:37:03,778: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:37:03.779039228Z [2024-04-06 02:37:03,778: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:37:04.027596375Z [2024-04-06 02:37:04,027: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:37:05.726600879Z [2024-04-06 02:37:05,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[04bbb2b8-9869-4590-b241-699a0ee177db] succeeded in 4.692931818000034s: None 2024-04-06T02:37:06.532688936Z [2024-04-06 02:37:06,532: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f668b757-c1de-430b-92da-dcc4e7431f24] succeeded in 5.4955038260004585s: None 2024-04-06T02:38:01.133028182Z [2024-04-06 02:38:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[019bb342-b941-4b07-9507-af7ccba6b7a0] received 2024-04-06T02:38:01.142297890Z [2024-04-06 02:38:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5669c1b-6d7d-4b7d-93dd-218de7768571] received 2024-04-06T02:38:01.156639175Z [2024-04-06 02:38:01,156: INFO/ForkPoolWorker-16] [f5669c1b-6d7d-4b7d-93dd-218de7768571] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:38:01.156896770Z [2024-04-06 02:38:01,156: INFO/ForkPoolWorker-15] [019bb342-b941-4b07-9507-af7ccba6b7a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:38:01.158440715Z [2024-04-06 02:38:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e192a1cc-8b8c-469e-968b-a0e0d25e01ce] received 2024-04-06T02:38:01.176905431Z [2024-04-06 02:38:01,176: INFO/ForkPoolWorker-1] [e192a1cc-8b8c-469e-968b-a0e0d25e01ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:38:01.606424980Z [2024-04-06 02:38:01,602: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:38:01.632180031Z [2024-04-06 02:38:01,627: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:38:01.773745901Z [2024-04-06 02:38:01,769: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:38:01.992550660Z [2024-04-06 02:38:01,992: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:38:02.816908548Z [2024-04-06 02:38:02,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[019bb342-b941-4b07-9507-af7ccba6b7a0] succeeded in 1.6791562270000213s: None 2024-04-06T02:38:03.520341038Z [2024-04-06 02:38:03,519: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:38:03.524351833Z [2024-04-06 02:38:03,523: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:38:03.582172590Z [2024-04-06 02:38:03,581: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:38:03.586899934Z [2024-04-06 02:38:03,586: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:38:03.587677737Z [2024-04-06 02:38:03,587: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:38:03.587902343Z [2024-04-06 02:38:03,587: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:38:03.588061027Z [2024-04-06 02:38:03,587: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:38:03.588405114Z [2024-04-06 02:38:03,588: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:38:03.589140467Z [2024-04-06 02:38:03,588: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:38:03.702705883Z [2024-04-06 02:38:03,702: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:38:03.875873331Z [2024-04-06 02:38:03,875: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:38:03.880357801Z [2024-04-06 02:38:03,879: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:38:03.917052038Z [2024-04-06 02:38:03,916: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:38:03.918790996Z [2024-04-06 02:38:03,918: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:38:03.918804042Z [2024-04-06 02:38:03,918: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:38:03.918980898Z [2024-04-06 02:38:03,918: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:38:03.919045656Z [2024-04-06 02:38:03,918: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:38:03.919279603Z [2024-04-06 02:38:03,919: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:38:03.919694428Z [2024-04-06 02:38:03,919: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:38:04.025401704Z [2024-04-06 02:38:04,025: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:38:06.076312341Z [2024-04-06 02:38:06,075: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e192a1cc-8b8c-469e-968b-a0e0d25e01ce] succeeded in 4.9098471159995825s: None 2024-04-06T02:38:08.355579791Z [2024-04-06 02:38:08,355: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5669c1b-6d7d-4b7d-93dd-218de7768571] succeeded in 7.208745087999887s: None 2024-04-06T02:39:01.195396290Z [2024-04-06 02:39:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2475341-ccb4-4376-a99c-8065754afff2] received 2024-04-06T02:39:01.204325521Z [2024-04-06 02:39:01,203: INFO/ForkPoolWorker-15] [b2475341-ccb4-4376-a99c-8065754afff2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:39:01.227788489Z [2024-04-06 02:39:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9118ac96-ce3e-42c5-bbb3-f56fe96f409b] received 2024-04-06T02:39:01.252457104Z [2024-04-06 02:39:01,252: INFO/ForkPoolWorker-16] [9118ac96-ce3e-42c5-bbb3-f56fe96f409b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:39:01.826204085Z [2024-04-06 02:39:01,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:39:01.862089276Z [2024-04-06 02:39:01,857: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:39:03.402836309Z [2024-04-06 02:39:03,402: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:39:03.406898727Z [2024-04-06 02:39:03,406: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:39:03.451172775Z [2024-04-06 02:39:03,450: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:39:03.452774536Z [2024-04-06 02:39:03,452: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:39:03.452794287Z [2024-04-06 02:39:03,452: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:39:03.452924853Z [2024-04-06 02:39:03,452: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:39:03.452938264Z [2024-04-06 02:39:03,452: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:39:03.453151049Z [2024-04-06 02:39:03,453: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:39:03.453178598Z [2024-04-06 02:39:03,453: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:39:03.515473380Z [2024-04-06 02:39:03,515: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:39:03.523314049Z [2024-04-06 02:39:03,522: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:39:03.567682112Z [2024-04-06 02:39:03,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:39:03.597653486Z [2024-04-06 02:39:03,597: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:39:03.599466780Z [2024-04-06 02:39:03,599: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:39:03.599486855Z [2024-04-06 02:39:03,599: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:39:03.602513749Z [2024-04-06 02:39:03,599: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:39:03.602570296Z [2024-04-06 02:39:03,602: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:39:03.602777230Z [2024-04-06 02:39:03,602: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:39:03.602827453Z [2024-04-06 02:39:03,602: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:39:03.731273647Z [2024-04-06 02:39:03,731: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:39:05.605378861Z [2024-04-06 02:39:05,604: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2475341-ccb4-4376-a99c-8065754afff2] succeeded in 4.4077062240003215s: None 2024-04-06T02:39:06.196094254Z [2024-04-06 02:39:06,195: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9118ac96-ce3e-42c5-bbb3-f56fe96f409b] succeeded in 4.960612986999877s: None 2024-04-06T02:40:00.999856726Z [2024-04-06 02:40:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c21974c7-ada8-4345-936c-398698955dac] received 2024-04-06T02:40:01.007733062Z [2024-04-06 02:40:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ef0411b-7721-4f6d-af8a-461e5a8d00db] received 2024-04-06T02:40:01.017944073Z [2024-04-06 02:40:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dccbc89-7a4a-406b-82d0-0fb6f4d1b467] received 2024-04-06T02:40:01.020942766Z [2024-04-06 02:40:01,020: INFO/ForkPoolWorker-16] [8ef0411b-7721-4f6d-af8a-461e5a8d00db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:40:01.026919789Z [2024-04-06 02:40:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00ec24d0-9389-42a3-9c78-ff00566f8a58] received 2024-04-06T02:40:01.033768466Z [2024-04-06 02:40:01,033: INFO/ForkPoolWorker-1] [7dccbc89-7a4a-406b-82d0-0fb6f4d1b467] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:40:01.068484474Z [2024-04-06 02:40:01,068: INFO/ForkPoolWorker-15] [c21974c7-ada8-4345-936c-398698955dac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:40:01.090374639Z [2024-04-06 02:40:01,089: INFO/ForkPoolWorker-2] [00ec24d0-9389-42a3-9c78-ff00566f8a58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:40:01.495884146Z [2024-04-06 02:40:01,492: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:40:01.780914094Z [2024-04-06 02:40:01,764: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:40:01.939290180Z [2024-04-06 02:40:01,925: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:40:01.969394686Z [2024-04-06 02:40:01,965: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:40:03.307051819Z [2024-04-06 02:40:03,306: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:03.953228991Z [2024-04-06 02:40:03,948: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:40:03.988711170Z [2024-04-06 02:40:03,988: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:04.149468217Z [2024-04-06 02:40:04,149: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:40:04.153457701Z [2024-04-06 02:40:04,153: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:40:04.153485283Z [2024-04-06 02:40:04,153: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:40:04.153638227Z [2024-04-06 02:40:04,153: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:04.153731782Z [2024-04-06 02:40:04,153: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:40:04.154409252Z [2024-04-06 02:40:04,154: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:40:04.156960564Z [2024-04-06 02:40:04,154: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:40:04.212979660Z [2024-04-06 02:40:04,211: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ef0411b-7721-4f6d-af8a-461e5a8d00db] succeeded in 3.2011758640001062s: None 2024-04-06T02:40:04.227867064Z [2024-04-06 02:40:04,227: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:40:04.248657390Z [2024-04-06 02:40:04,246: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:04.347734299Z [2024-04-06 02:40:04,347: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:40:04.352590389Z [2024-04-06 02:40:04,352: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:40:04.352648100Z [2024-04-06 02:40:04,352: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:40:04.352764321Z [2024-04-06 02:40:04,352: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:04.352771534Z [2024-04-06 02:40:04,352: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:40:04.352988104Z [2024-04-06 02:40:04,352: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:40:04.353026459Z [2024-04-06 02:40:04,352: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:40:04.379955512Z [2024-04-06 02:40:04,379: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:04.464454370Z [2024-04-06 02:40:04,462: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:05.011587311Z [2024-04-06 02:40:05,011: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:40:05.028197404Z [2024-04-06 02:40:05,027: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:05.134905579Z [2024-04-06 02:40:05,134: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:40:05.142872225Z [2024-04-06 02:40:05,142: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:40:05.142948963Z [2024-04-06 02:40:05,142: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:40:05.142993106Z [2024-04-06 02:40:05,142: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:05.143040385Z [2024-04-06 02:40:05,142: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:40:05.143321373Z [2024-04-06 02:40:05,143: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:40:05.143347788Z [2024-04-06 02:40:05,143: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:40:05.266852922Z [2024-04-06 02:40:05,266: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:05.695467625Z [2024-04-06 02:40:05,695: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c21974c7-ada8-4345-936c-398698955dac] succeeded in 4.683895856000163s: None 2024-04-06T02:40:06.134584019Z [2024-04-06 02:40:06,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edc02d93-77d3-4777-84a9-40ca3c4572c8] received 2024-04-06T02:40:06.150943458Z [2024-04-06 02:40:06,150: INFO/ForkPoolWorker-15] [edc02d93-77d3-4777-84a9-40ca3c4572c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:40:06.470343191Z [2024-04-06 02:40:06,469: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[00ec24d0-9389-42a3-9c78-ff00566f8a58] succeeded in 5.434331036000003s: None 2024-04-06T02:40:06.529003387Z [2024-04-06 02:40:06,525: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:40:07.558564987Z [2024-04-06 02:40:07,557: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7dccbc89-7a4a-406b-82d0-0fb6f4d1b467] succeeded in 6.535286260999783s: None 2024-04-06T02:40:07.639146186Z [2024-04-06 02:40:07,638: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:40:07.642396190Z [2024-04-06 02:40:07,641: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:07.678233937Z [2024-04-06 02:40:07,677: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:40:07.679587653Z [2024-04-06 02:40:07,679: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:40:07.679662532Z [2024-04-06 02:40:07,679: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:40:07.679879972Z [2024-04-06 02:40:07,679: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:07.679983389Z [2024-04-06 02:40:07,679: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:40:07.680285869Z [2024-04-06 02:40:07,680: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:40:07.680350058Z [2024-04-06 02:40:07,680: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:40:07.765982300Z [2024-04-06 02:40:07,765: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:08.545615641Z [2024-04-06 02:40:08,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[edc02d93-77d3-4777-84a9-40ca3c4572c8] succeeded in 2.4072594780000145s: None 2024-04-06T02:40:08.587552332Z [2024-04-06 02:40:08,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09a92d38-5e8f-4a1b-bcb6-5f2b1e301cc9] received 2024-04-06T02:40:08.605252173Z [2024-04-06 02:40:08,604: INFO/ForkPoolWorker-15] [09a92d38-5e8f-4a1b-bcb6-5f2b1e301cc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:40:08.901996518Z [2024-04-06 02:40:08,898: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:40:10.062494595Z [2024-04-06 02:40:10,062: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:40:10.065917614Z [2024-04-06 02:40:10,065: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:10.092845585Z [2024-04-06 02:40:10,092: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:40:10.094304714Z [2024-04-06 02:40:10,094: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:40:10.094382489Z [2024-04-06 02:40:10,094: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:40:10.094520272Z [2024-04-06 02:40:10,094: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:10.094585473Z [2024-04-06 02:40:10,094: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:40:10.094821075Z [2024-04-06 02:40:10,094: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:40:10.094924822Z [2024-04-06 02:40:10,094: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:40:10.195878427Z [2024-04-06 02:40:10,195: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:10.806965637Z [2024-04-06 02:40:10,805: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09a92d38-5e8f-4a1b-bcb6-5f2b1e301cc9] succeeded in 2.217184685000575s: None 2024-04-06T02:40:11.147586209Z [2024-04-06 02:40:11,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[355b4905-956c-43ba-b474-9e27c0a42396] received 2024-04-06T02:40:11.154926610Z [2024-04-06 02:40:11,154: INFO/ForkPoolWorker-15] [355b4905-956c-43ba-b474-9e27c0a42396] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:40:11.523403019Z [2024-04-06 02:40:11,520: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:40:12.777475069Z [2024-04-06 02:40:12,776: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:40:12.786781096Z [2024-04-06 02:40:12,786: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:12.821561259Z [2024-04-06 02:40:12,821: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:40:12.823080060Z [2024-04-06 02:40:12,822: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:40:12.823353613Z [2024-04-06 02:40:12,823: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:40:12.823674644Z [2024-04-06 02:40:12,823: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:12.823917133Z [2024-04-06 02:40:12,823: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:40:12.824384153Z [2024-04-06 02:40:12,824: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:40:12.824712444Z [2024-04-06 02:40:12,824: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:40:12.917101853Z [2024-04-06 02:40:12,916: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:13.495523853Z [2024-04-06 02:40:13,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[355b4905-956c-43ba-b474-9e27c0a42396] succeeded in 2.345778173999861s: None 2024-04-06T02:41:00.889407423Z [2024-04-06 02:41:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d637781-636b-4e9b-b929-0c01b4298ed8] received 2024-04-06T02:41:00.897378017Z [2024-04-06 02:41:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b0e43ea-9130-4cf3-8ff5-fc4e988d4707] received 2024-04-06T02:41:00.901065803Z [2024-04-06 02:41:00,900: INFO/ForkPoolWorker-15] [2d637781-636b-4e9b-b929-0c01b4298ed8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:41:00.906548730Z [2024-04-06 02:41:00,906: INFO/ForkPoolWorker-16] [3b0e43ea-9130-4cf3-8ff5-fc4e988d4707] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:41:01.256156761Z [2024-04-06 02:41:01,251: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:41:01.342256208Z [2024-04-06 02:41:01,322: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:41:03.037977563Z [2024-04-06 02:41:03,037: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:41:03.041517357Z [2024-04-06 02:41:03,040: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:41:03.096556066Z [2024-04-06 02:41:03,096: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:41:03.097798847Z [2024-04-06 02:41:03,097: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:41:03.097869202Z [2024-04-06 02:41:03,097: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:41:03.097964225Z [2024-04-06 02:41:03,097: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:41:03.098007784Z [2024-04-06 02:41:03,097: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:41:03.098717275Z [2024-04-06 02:41:03,098: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:41:03.098759895Z [2024-04-06 02:41:03,098: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:41:03.175256616Z [2024-04-06 02:41:03,174: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:41:03.183103812Z [2024-04-06 02:41:03,182: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:41:03.242679357Z [2024-04-06 02:41:03,242: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:41:03.254511598Z [2024-04-06 02:41:03,254: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:41:03.262473528Z [2024-04-06 02:41:03,262: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:41:03.262726657Z [2024-04-06 02:41:03,262: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:41:03.262991292Z [2024-04-06 02:41:03,262: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:41:03.263193853Z [2024-04-06 02:41:03,263: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:41:03.263546109Z [2024-04-06 02:41:03,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:41:03.263731577Z [2024-04-06 02:41:03,263: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:41:03.456705494Z [2024-04-06 02:41:03,456: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:41:05.418157440Z [2024-04-06 02:41:05,417: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3b0e43ea-9130-4cf3-8ff5-fc4e988d4707] succeeded in 4.518892256999607s: None 2024-04-06T02:41:06.185209693Z [2024-04-06 02:41:06,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d637781-636b-4e9b-b929-0c01b4298ed8] succeeded in 5.293432814999505s: None 2024-04-06T02:42:01.199420575Z [2024-04-06 02:42:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97bf6215-4927-4380-98a9-ecd7d179f602] received 2024-04-06T02:42:01.212031312Z [2024-04-06 02:42:01,211: INFO/ForkPoolWorker-15] [97bf6215-4927-4380-98a9-ecd7d179f602] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:42:01.217651744Z [2024-04-06 02:42:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a4c3608-1b07-4201-a8a5-95a4b6dba2d2] received 2024-04-06T02:42:01.228484559Z [2024-04-06 02:42:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2f8d500-5988-4f4d-a81d-c35115ce0b95] received 2024-04-06T02:42:01.229798444Z [2024-04-06 02:42:01,229: INFO/ForkPoolWorker-16] [7a4c3608-1b07-4201-a8a5-95a4b6dba2d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:42:01.299545509Z [2024-04-06 02:42:01,299: INFO/ForkPoolWorker-1] [d2f8d500-5988-4f4d-a81d-c35115ce0b95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:42:01.609065881Z [2024-04-06 02:42:01,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:42:01.770951918Z [2024-04-06 02:42:01,765: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:42:01.949966358Z [2024-04-06 02:42:01,942: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:42:01.978838494Z [2024-04-06 02:42:01,977: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:42:02.950517896Z [2024-04-06 02:42:02,950: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97bf6215-4927-4380-98a9-ecd7d179f602] succeeded in 1.7471344779996798s: None 2024-04-06T02:42:04.196674343Z [2024-04-06 02:42:04,195: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:42:04.206041344Z [2024-04-06 02:42:04,205: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:42:04.282350655Z [2024-04-06 02:42:04,282: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:42:04.288474045Z [2024-04-06 02:42:04,285: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:42:04.288491729Z [2024-04-06 02:42:04,285: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:42:04.288508482Z [2024-04-06 02:42:04,287: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:42:04.288513003Z [2024-04-06 02:42:04,287: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:42:04.288856628Z [2024-04-06 02:42:04,288: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:42:04.297464572Z [2024-04-06 02:42:04,288: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:42:04.419939710Z [2024-04-06 02:42:04,419: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:42:04.478959263Z [2024-04-06 02:42:04,478: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:42:04.482169053Z [2024-04-06 02:42:04,481: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:42:04.607659774Z [2024-04-06 02:42:04,606: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:42:04.614315008Z [2024-04-06 02:42:04,614: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:42:04.614561444Z [2024-04-06 02:42:04,614: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:42:04.614821326Z [2024-04-06 02:42:04,614: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:42:04.615036048Z [2024-04-06 02:42:04,614: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:42:04.615368768Z [2024-04-06 02:42:04,615: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:42:04.615522782Z [2024-04-06 02:42:04,615: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:42:04.839619253Z [2024-04-06 02:42:04,839: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:42:06.710809744Z [2024-04-06 02:42:06,710: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7a4c3608-1b07-4201-a8a5-95a4b6dba2d2] succeeded in 5.489213855000344s: None 2024-04-06T02:42:06.739243257Z [2024-04-06 02:42:06,738: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2f8d500-5988-4f4d-a81d-c35115ce0b95] succeeded in 5.507381952999822s: None 2024-04-06T02:43:00.706271980Z [2024-04-06 02:43:00,705: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[535b999b-d488-43db-a462-4ae89773928c] received 2024-04-06T02:43:00.708509735Z [2024-04-06 02:43:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e26fb92f-917c-43b6-b32c-281660424149] received 2024-04-06T02:43:00.722090161Z [2024-04-06 02:43:00,721: INFO/ForkPoolWorker-16] [e26fb92f-917c-43b6-b32c-281660424149] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:43:00.728305223Z [2024-04-06 02:43:00,728: INFO/ForkPoolWorker-15] [535b999b-d488-43db-a462-4ae89773928c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:43:01.123243425Z [2024-04-06 02:43:01,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:43:01.267955994Z [2024-04-06 02:43:01,264: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:43:02.549487373Z [2024-04-06 02:43:02,549: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:43:02.553105344Z [2024-04-06 02:43:02,552: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:43:02.600726720Z [2024-04-06 02:43:02,600: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:43:02.602236189Z [2024-04-06 02:43:02,601: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:43:02.602470621Z [2024-04-06 02:43:02,602: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:43:02.602730410Z [2024-04-06 02:43:02,602: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:43:02.603411359Z [2024-04-06 02:43:02,603: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:43:02.603823234Z [2024-04-06 02:43:02,603: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:43:02.604423866Z [2024-04-06 02:43:02,604: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:43:02.677642307Z [2024-04-06 02:43:02,677: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:43:02.680955252Z [2024-04-06 02:43:02,680: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:43:02.706064531Z [2024-04-06 02:43:02,705: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:43:02.735257624Z [2024-04-06 02:43:02,735: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:43:02.738762189Z [2024-04-06 02:43:02,738: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:43:02.738977216Z [2024-04-06 02:43:02,738: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:43:02.739157345Z [2024-04-06 02:43:02,738: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:43:02.739238090Z [2024-04-06 02:43:02,739: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:43:02.741760994Z [2024-04-06 02:43:02,741: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:43:02.741915279Z [2024-04-06 02:43:02,741: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:43:02.860187325Z [2024-04-06 02:43:02,859: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:43:05.074443556Z [2024-04-06 02:43:05,074: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e26fb92f-917c-43b6-b32c-281660424149] succeeded in 4.36430948799989s: None 2024-04-06T02:43:05.882617057Z [2024-04-06 02:43:05,882: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[535b999b-d488-43db-a462-4ae89773928c] succeeded in 5.162163748999774s: None 2024-04-06T02:44:00.680737849Z [2024-04-06 02:44:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53da7902-1ead-4012-b18a-47eb9f5056ab] received 2024-04-06T02:44:00.684806065Z [2024-04-06 02:44:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adf5953c-9a69-452e-8feb-843ebcc12ed9] received 2024-04-06T02:44:00.698805173Z [2024-04-06 02:44:00,698: INFO/ForkPoolWorker-15] [53da7902-1ead-4012-b18a-47eb9f5056ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:44:00.701535934Z [2024-04-06 02:44:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc5e10d4-365c-421b-92c5-f601a2a18a7b] received 2024-04-06T02:44:00.737692000Z [2024-04-06 02:44:00,736: INFO/ForkPoolWorker-16] [adf5953c-9a69-452e-8feb-843ebcc12ed9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:44:00.740879505Z [2024-04-06 02:44:00,739: INFO/ForkPoolWorker-1] [dc5e10d4-365c-421b-92c5-f601a2a18a7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:44:01.239647421Z [2024-04-06 02:44:01,236: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:44:01.345014025Z [2024-04-06 02:44:01,336: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:44:01.356526897Z [2024-04-06 02:44:01,350: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:44:01.775764658Z [2024-04-06 02:44:01,775: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:44:02.758859409Z [2024-04-06 02:44:02,758: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53da7902-1ead-4012-b18a-47eb9f5056ab] succeeded in 2.0725173800001357s: None 2024-04-06T02:44:03.200528982Z [2024-04-06 02:44:03,199: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:44:03.206514955Z [2024-04-06 02:44:03,205: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:44:03.280942643Z [2024-04-06 02:44:03,280: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:44:03.282522735Z [2024-04-06 02:44:03,281: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:44:03.282538054Z [2024-04-06 02:44:03,282: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:44:03.282541874Z [2024-04-06 02:44:03,282: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:44:03.282545170Z [2024-04-06 02:44:03,282: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:44:03.283004331Z [2024-04-06 02:44:03,282: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:44:03.283143795Z [2024-04-06 02:44:03,283: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:44:03.415951707Z [2024-04-06 02:44:03,415: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:44:03.419304183Z [2024-04-06 02:44:03,418: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:44:03.429282675Z [2024-04-06 02:44:03,429: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:44:03.470522414Z [2024-04-06 02:44:03,469: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:44:03.475706047Z [2024-04-06 02:44:03,475: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:44:03.475729568Z [2024-04-06 02:44:03,475: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:44:03.475742813Z [2024-04-06 02:44:03,475: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:44:03.475747889Z [2024-04-06 02:44:03,475: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:44:03.476036290Z [2024-04-06 02:44:03,475: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:44:03.476046332Z [2024-04-06 02:44:03,475: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:44:03.567340568Z [2024-04-06 02:44:03,567: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:44:05.362663652Z [2024-04-06 02:44:05,362: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc5e10d4-365c-421b-92c5-f601a2a18a7b] succeeded in 4.6438754060000065s: None 2024-04-06T02:44:05.797288015Z [2024-04-06 02:44:05,796: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[adf5953c-9a69-452e-8feb-843ebcc12ed9] succeeded in 5.109508988999551s: None 2024-04-06T02:45:00.649889241Z [2024-04-06 02:45:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f2a3d3a-8ace-4536-bc31-ecccaeb7e9cd] received 2024-04-06T02:45:00.665199975Z [2024-04-06 02:45:00,664: INFO/ForkPoolWorker-15] [2f2a3d3a-8ace-4536-bc31-ecccaeb7e9cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:45:00.669344061Z [2024-04-06 02:45:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68fefee3-79b7-410b-8aed-6c782e493ede] received 2024-04-06T02:45:00.681470765Z [2024-04-06 02:45:00,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a470aba-a5bb-4686-887a-81527bf5c0bc] received 2024-04-06T02:45:00.681509559Z [2024-04-06 02:45:00,681: INFO/ForkPoolWorker-16] [68fefee3-79b7-410b-8aed-6c782e493ede] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:45:00.702424416Z [2024-04-06 02:45:00,701: INFO/ForkPoolWorker-1] [5a470aba-a5bb-4686-887a-81527bf5c0bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:45:01.324086839Z [2024-04-06 02:45:01,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:45:01.366601860Z [2024-04-06 02:45:01,362: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:45:01.397236002Z [2024-04-06 02:45:01,393: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:45:03.228212211Z [2024-04-06 02:45:03,227: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:45:03.231771922Z [2024-04-06 02:45:03,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:03.275266582Z [2024-04-06 02:45:03,275: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:45:03.277359174Z [2024-04-06 02:45:03,277: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:45:03.277406337Z [2024-04-06 02:45:03,277: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:45:03.277543808Z [2024-04-06 02:45:03,277: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:03.277609861Z [2024-04-06 02:45:03,277: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:45:03.277845942Z [2024-04-06 02:45:03,277: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:45:03.277912710Z [2024-04-06 02:45:03,277: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:45:03.500420442Z [2024-04-06 02:45:03,499: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:45:03.504052636Z [2024-04-06 02:45:03,503: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:03.507401920Z [2024-04-06 02:45:03,507: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:03.539068918Z [2024-04-06 02:45:03,538: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:45:03.541478718Z [2024-04-06 02:45:03,541: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:45:03.541625868Z [2024-04-06 02:45:03,541: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:45:03.541890786Z [2024-04-06 02:45:03,541: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:03.542035077Z [2024-04-06 02:45:03,541: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:45:03.542355954Z [2024-04-06 02:45:03,542: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:45:03.542509394Z [2024-04-06 02:45:03,542: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:45:03.662561607Z [2024-04-06 02:45:03,662: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:04.107379998Z [2024-04-06 02:45:04,107: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:45:04.110864971Z [2024-04-06 02:45:04,110: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:04.184966340Z [2024-04-06 02:45:04,184: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:45:04.198645215Z [2024-04-06 02:45:04,198: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:45:04.198666499Z [2024-04-06 02:45:04,198: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:45:04.198852864Z [2024-04-06 02:45:04,198: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:04.198896028Z [2024-04-06 02:45:04,198: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:45:04.199300192Z [2024-04-06 02:45:04,199: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:45:04.199797205Z [2024-04-06 02:45:04,199: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:45:04.437925270Z [2024-04-06 02:45:04,437: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:04.998920748Z [2024-04-06 02:45:04,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[083bf361-89de-4f8f-beac-61a2b19613f3] received 2024-04-06T02:45:05.050946414Z [2024-04-06 02:45:05,050: INFO/ForkPoolWorker-2] [083bf361-89de-4f8f-beac-61a2b19613f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:45:05.059782040Z [2024-04-06 02:45:05,059: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f2a3d3a-8ace-4536-bc31-ecccaeb7e9cd] succeeded in 4.40514185200027s: None 2024-04-06T02:45:05.673261553Z [2024-04-06 02:45:05,669: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:45:06.035049385Z [2024-04-06 02:45:06,034: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[68fefee3-79b7-410b-8aed-6c782e493ede] succeeded in 5.363354641999649s: None 2024-04-06T02:45:06.920661635Z [2024-04-06 02:45:06,920: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:45:06.923639812Z [2024-04-06 02:45:06,923: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:06.975905281Z [2024-04-06 02:45:06,975: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:45:06.979056104Z [2024-04-06 02:45:06,978: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:45:06.979368130Z [2024-04-06 02:45:06,979: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:45:06.979783621Z [2024-04-06 02:45:06,979: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:06.980292324Z [2024-04-06 02:45:06,980: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:45:06.980876326Z [2024-04-06 02:45:06,980: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:45:06.981191799Z [2024-04-06 02:45:06,980: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:45:07.096085230Z [2024-04-06 02:45:07,095: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:07.660387821Z [2024-04-06 02:45:07,659: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a470aba-a5bb-4686-887a-81527bf5c0bc] succeeded in 6.975969940000141s: None 2024-04-06T02:45:07.783795156Z [2024-04-06 02:45:07,782: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[083bf361-89de-4f8f-beac-61a2b19613f3] succeeded in 2.7697199329995783s: None 2024-04-06T02:45:08.814089508Z [2024-04-06 02:45:08,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a53d3b5e-a749-4ba4-ac40-f076fa8dd06b] received 2024-04-06T02:45:08.823823636Z [2024-04-06 02:45:08,823: INFO/ForkPoolWorker-15] [a53d3b5e-a749-4ba4-ac40-f076fa8dd06b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:45:09.102644835Z [2024-04-06 02:45:09,099: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:45:10.113020808Z [2024-04-06 02:45:10,112: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:45:10.120163572Z [2024-04-06 02:45:10,119: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:10.140971312Z [2024-04-06 02:45:10,140: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:45:10.142613520Z [2024-04-06 02:45:10,142: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:45:10.142687472Z [2024-04-06 02:45:10,142: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:45:10.142835400Z [2024-04-06 02:45:10,142: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:10.142872377Z [2024-04-06 02:45:10,142: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:45:10.143092771Z [2024-04-06 02:45:10,142: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:45:10.143102425Z [2024-04-06 02:45:10,143: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:45:10.229852388Z [2024-04-06 02:45:10,229: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:10.820878962Z [2024-04-06 02:45:10,820: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a53d3b5e-a749-4ba4-ac40-f076fa8dd06b] succeeded in 2.002828253000189s: None 2024-04-06T02:45:11.187765415Z [2024-04-06 02:45:11,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c765af4f-2347-403d-a0b3-86a016f456d4] received 2024-04-06T02:45:11.206793215Z [2024-04-06 02:45:11,206: INFO/ForkPoolWorker-15] [c765af4f-2347-403d-a0b3-86a016f456d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:45:11.565253846Z [2024-04-06 02:45:11,561: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:45:12.742181860Z [2024-04-06 02:45:12,741: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:45:12.745514025Z [2024-04-06 02:45:12,744: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:12.787627161Z [2024-04-06 02:45:12,787: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:45:12.789418721Z [2024-04-06 02:45:12,789: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:45:12.789671865Z [2024-04-06 02:45:12,789: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:45:12.789908084Z [2024-04-06 02:45:12,789: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:12.790063856Z [2024-04-06 02:45:12,789: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:45:12.790929039Z [2024-04-06 02:45:12,790: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:45:12.791081832Z [2024-04-06 02:45:12,790: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:45:12.889231097Z [2024-04-06 02:45:12,888: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:13.481894540Z [2024-04-06 02:45:13,481: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c765af4f-2347-403d-a0b3-86a016f456d4] succeeded in 2.2903520549998575s: None 2024-04-06T02:46:01.221185083Z [2024-04-06 02:46:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0046be7-ae79-4dde-af1c-d63d7b970f81] received 2024-04-06T02:46:01.226064313Z [2024-04-06 02:46:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[494f919e-eeea-4762-a153-c1afee6613d8] received 2024-04-06T02:46:01.232389917Z [2024-04-06 02:46:01,232: INFO/ForkPoolWorker-15] [e0046be7-ae79-4dde-af1c-d63d7b970f81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:46:01.238859440Z [2024-04-06 02:46:01,238: INFO/ForkPoolWorker-16] [494f919e-eeea-4762-a153-c1afee6613d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:46:01.262235747Z [2024-04-06 02:46:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c70f733-43a9-4adc-b7f3-51ded0e83ef1] received 2024-04-06T02:46:01.281312390Z [2024-04-06 02:46:01,280: INFO/ForkPoolWorker-1] [3c70f733-43a9-4adc-b7f3-51ded0e83ef1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:46:01.630720507Z [2024-04-06 02:46:01,626: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:46:01.882444694Z [2024-04-06 02:46:01,879: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:46:02.165191630Z [2024-04-06 02:46:02,161: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:46:02.176347647Z [2024-04-06 02:46:02,175: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:46:03.113790409Z [2024-04-06 02:46:03,113: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[494f919e-eeea-4762-a153-c1afee6613d8] succeeded in 1.8858737770005973s: None 2024-04-06T02:46:03.914439939Z [2024-04-06 02:46:03,914: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:46:03.921207524Z [2024-04-06 02:46:03,920: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:46:03.991065859Z [2024-04-06 02:46:03,990: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:46:03.992239308Z [2024-04-06 02:46:03,992: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:46:03.992395042Z [2024-04-06 02:46:03,992: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:46:03.992573635Z [2024-04-06 02:46:03,992: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:46:03.992697721Z [2024-04-06 02:46:03,992: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:46:03.993044002Z [2024-04-06 02:46:03,992: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:46:03.993243427Z [2024-04-06 02:46:03,993: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:46:04.122865596Z [2024-04-06 02:46:04,122: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:46:04.848896631Z [2024-04-06 02:46:04,847: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:46:04.853666696Z [2024-04-06 02:46:04,853: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:46:04.900998209Z [2024-04-06 02:46:04,900: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:46:04.902394277Z [2024-04-06 02:46:04,902: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:46:04.902624324Z [2024-04-06 02:46:04,902: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:46:04.902882253Z [2024-04-06 02:46:04,902: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:46:04.903066183Z [2024-04-06 02:46:04,902: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:46:04.903413988Z [2024-04-06 02:46:04,903: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:46:04.903710488Z [2024-04-06 02:46:04,903: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:46:04.975935461Z [2024-04-06 02:46:04,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:46:06.526923784Z [2024-04-06 02:46:06,526: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c70f733-43a9-4adc-b7f3-51ded0e83ef1] succeeded in 5.256418848000067s: None 2024-04-06T02:46:07.806002423Z [2024-04-06 02:46:07,805: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0046be7-ae79-4dde-af1c-d63d7b970f81] succeeded in 6.583016501000202s: None 2024-04-06T02:47:00.383090657Z [2024-04-06 02:47:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b237b3fe-54ab-4411-9480-1dc8f7b0d8b3] received 2024-04-06T02:47:00.391784919Z [2024-04-06 02:47:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97fcbf64-2047-4267-b56d-90dea39fdc9c] received 2024-04-06T02:47:00.405261476Z [2024-04-06 02:47:00,404: INFO/ForkPoolWorker-16] [97fcbf64-2047-4267-b56d-90dea39fdc9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:47:00.406324000Z [2024-04-06 02:47:00,405: INFO/ForkPoolWorker-15] [b237b3fe-54ab-4411-9480-1dc8f7b0d8b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:47:00.685850572Z [2024-04-06 02:47:00,681: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:47:00.745398418Z [2024-04-06 02:47:00,714: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:47:02.148361656Z [2024-04-06 02:47:02,148: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:47:02.151891923Z [2024-04-06 02:47:02,151: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:47:02.232251371Z [2024-04-06 02:47:02,230: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:47:02.232706546Z [2024-04-06 02:47:02,231: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:47:02.232725912Z [2024-04-06 02:47:02,232: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:47:02.232732939Z [2024-04-06 02:47:02,232: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:47:02.232737362Z [2024-04-06 02:47:02,232: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:47:02.232740479Z [2024-04-06 02:47:02,232: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:47:02.232743651Z [2024-04-06 02:47:02,232: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:47:02.342397220Z [2024-04-06 02:47:02,341: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:47:02.346822261Z [2024-04-06 02:47:02,346: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:47:02.372174596Z [2024-04-06 02:47:02,371: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:47:02.373262644Z [2024-04-06 02:47:02,373: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:47:02.373437558Z [2024-04-06 02:47:02,373: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:47:02.373670421Z [2024-04-06 02:47:02,373: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:47:02.373897511Z [2024-04-06 02:47:02,373: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:47:02.374213537Z [2024-04-06 02:47:02,374: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:47:02.374360630Z [2024-04-06 02:47:02,374: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:47:02.387377495Z [2024-04-06 02:47:02,387: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:47:02.501545412Z [2024-04-06 02:47:02,501: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:47:04.027645689Z [2024-04-06 02:47:04,027: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97fcbf64-2047-4267-b56d-90dea39fdc9c] succeeded in 3.6336576240000795s: None 2024-04-06T02:47:04.646796743Z [2024-04-06 02:47:04,646: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b237b3fe-54ab-4411-9480-1dc8f7b0d8b3] succeeded in 4.257338039000388s: None 2024-04-06T02:48:00.747944067Z [2024-04-06 02:48:00,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fea760a-013f-4fcc-bd7d-2cf95cf53355] received 2024-04-06T02:48:00.764076703Z [2024-04-06 02:48:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eefede07-8b9a-47d2-a3de-991c94586e32] received 2024-04-06T02:48:00.764968693Z [2024-04-06 02:48:00,764: INFO/ForkPoolWorker-15] [1fea760a-013f-4fcc-bd7d-2cf95cf53355] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:48:00.772906188Z [2024-04-06 02:48:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[329c06ab-0916-49a9-a44d-4039bd1c217b] received 2024-04-06T02:48:00.773927158Z [2024-04-06 02:48:00,773: INFO/ForkPoolWorker-16] [eefede07-8b9a-47d2-a3de-991c94586e32] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:48:00.798853782Z [2024-04-06 02:48:00,798: INFO/ForkPoolWorker-1] [329c06ab-0916-49a9-a44d-4039bd1c217b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:48:01.237701147Z [2024-04-06 02:48:01,233: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:48:01.346188212Z [2024-04-06 02:48:01,342: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:48:01.430629462Z [2024-04-06 02:48:01,418: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:48:01.910478756Z [2024-04-06 02:48:01,910: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:48:02.763954339Z [2024-04-06 02:48:02,763: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eefede07-8b9a-47d2-a3de-991c94586e32] succeeded in 1.9977862870000536s: None 2024-04-06T02:48:03.116184945Z [2024-04-06 02:48:03,115: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:48:03.120703140Z [2024-04-06 02:48:03,119: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:48:03.131420394Z [2024-04-06 02:48:03,131: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:48:03.139928617Z [2024-04-06 02:48:03,137: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:48:03.169943970Z [2024-04-06 02:48:03,167: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:48:03.172873460Z [2024-04-06 02:48:03,172: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:48:03.173673237Z [2024-04-06 02:48:03,173: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:48:03.173895934Z [2024-04-06 02:48:03,173: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:48:03.174346125Z [2024-04-06 02:48:03,173: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:48:03.174886170Z [2024-04-06 02:48:03,174: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:48:03.175017999Z [2024-04-06 02:48:03,174: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:48:03.216007343Z [2024-04-06 02:48:03,215: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:48:03.226071244Z [2024-04-06 02:48:03,224: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:48:03.226429325Z [2024-04-06 02:48:03,226: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:48:03.227573168Z [2024-04-06 02:48:03,227: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:48:03.230387060Z [2024-04-06 02:48:03,230: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:48:03.230655991Z [2024-04-06 02:48:03,230: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:48:03.230757443Z [2024-04-06 02:48:03,230: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:48:03.307935482Z [2024-04-06 02:48:03,307: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:48:03.383155616Z [2024-04-06 02:48:03,382: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:48:05.783366431Z [2024-04-06 02:48:05,782: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1fea760a-013f-4fcc-bd7d-2cf95cf53355] succeeded in 5.033966715000133s: None 2024-04-06T02:48:06.313232457Z [2024-04-06 02:48:06,312: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[329c06ab-0916-49a9-a44d-4039bd1c217b] succeeded in 5.525844958000562s: None 2024-04-06T02:49:00.240344777Z [2024-04-06 02:49:00,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d54a6b9-ab5d-4162-b38c-3e8fe6f0f11f] received 2024-04-06T02:49:00.247054016Z [2024-04-06 02:49:00,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbc47bc8-d2a0-4440-a165-7cd8319ee0d0] received 2024-04-06T02:49:00.249089361Z [2024-04-06 02:49:00,248: INFO/ForkPoolWorker-15] [4d54a6b9-ab5d-4162-b38c-3e8fe6f0f11f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:49:00.259367191Z [2024-04-06 02:49:00,259: INFO/ForkPoolWorker-16] [dbc47bc8-d2a0-4440-a165-7cd8319ee0d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:49:00.557238874Z [2024-04-06 02:49:00,553: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:49:00.588859764Z [2024-04-06 02:49:00,582: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:49:02.263355100Z [2024-04-06 02:49:02,252: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:49:02.263417651Z [2024-04-06 02:49:02,257: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:49:02.330498889Z [2024-04-06 02:49:02,330: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:49:02.342142650Z [2024-04-06 02:49:02,341: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:49:02.342173568Z [2024-04-06 02:49:02,342: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:49:02.342325740Z [2024-04-06 02:49:02,342: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:49:02.342375044Z [2024-04-06 02:49:02,342: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:49:02.342692859Z [2024-04-06 02:49:02,342: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:49:02.342845012Z [2024-04-06 02:49:02,342: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:49:02.490540808Z [2024-04-06 02:49:02,490: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:49:02.494184641Z [2024-04-06 02:49:02,493: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:49:02.535228345Z [2024-04-06 02:49:02,535: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:49:02.536564198Z [2024-04-06 02:49:02,536: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:49:02.536680330Z [2024-04-06 02:49:02,536: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:49:02.537423145Z [2024-04-06 02:49:02,536: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:49:02.537563710Z [2024-04-06 02:49:02,537: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:49:02.538042921Z [2024-04-06 02:49:02,537: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:49:02.538381865Z [2024-04-06 02:49:02,537: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:49:02.547832839Z [2024-04-06 02:49:02,547: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:49:02.666693443Z [2024-04-06 02:49:02,666: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:49:04.502399679Z [2024-04-06 02:49:04,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d54a6b9-ab5d-4162-b38c-3e8fe6f0f11f] succeeded in 4.259189002999847s: None 2024-04-06T02:49:05.265175787Z [2024-04-06 02:49:05,264: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dbc47bc8-d2a0-4440-a165-7cd8319ee0d0] succeeded in 5.015856747000726s: None 2024-04-06T02:50:01.201507431Z [2024-04-06 02:50:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1017161-333b-409a-aabd-88b852f65267] received 2024-04-06T02:50:01.205366325Z [2024-04-06 02:50:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[428f9d32-3946-4945-b5a0-33df21ab42b9] received 2024-04-06T02:50:01.225418583Z [2024-04-06 02:50:01,223: INFO/ForkPoolWorker-15] [b1017161-333b-409a-aabd-88b852f65267] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:50:01.234380284Z [2024-04-06 02:50:01,233: INFO/ForkPoolWorker-16] [428f9d32-3946-4945-b5a0-33df21ab42b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:50:01.255243352Z [2024-04-06 02:50:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75148a00-1ddb-41ad-9392-ed8df5b93c34] received 2024-04-06T02:50:01.260735348Z [2024-04-06 02:50:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2bb829f-7dea-442d-9797-ae6accc7218c] received 2024-04-06T02:50:01.272272403Z [2024-04-06 02:50:01,271: INFO/ForkPoolWorker-1] [75148a00-1ddb-41ad-9392-ed8df5b93c34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:50:01.274583687Z [2024-04-06 02:50:01,274: INFO/ForkPoolWorker-2] [a2bb829f-7dea-442d-9797-ae6accc7218c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:50:01.721007880Z [2024-04-06 02:50:01,670: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:50:01.848057997Z [2024-04-06 02:50:01,844: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:50:01.865643857Z [2024-04-06 02:50:01,855: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:50:02.037048900Z [2024-04-06 02:50:02,033: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:50:02.048614825Z [2024-04-06 02:50:02,048: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:50:03.247457432Z [2024-04-06 02:50:03,246: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a2bb829f-7dea-442d-9797-ae6accc7218c] succeeded in 1.9835931329998857s: None 2024-04-06T02:50:04.670383819Z [2024-04-06 02:50:04,669: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:50:04.687394129Z [2024-04-06 02:50:04,686: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:50:04.785636919Z [2024-04-06 02:50:04,785: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:50:04.795422454Z [2024-04-06 02:50:04,795: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:50:04.795509255Z [2024-04-06 02:50:04,795: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:50:04.795716747Z [2024-04-06 02:50:04,795: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:50:04.795832313Z [2024-04-06 02:50:04,795: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:50:04.796252810Z [2024-04-06 02:50:04,796: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:50:04.796303333Z [2024-04-06 02:50:04,796: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:50:04.881305189Z [2024-04-06 02:50:04,881: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:50:05.011135061Z [2024-04-06 02:50:05,010: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:50:05.017573036Z [2024-04-06 02:50:05,017: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:50:05.098419130Z [2024-04-06 02:50:05,098: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:50:05.104462675Z [2024-04-06 02:50:05,104: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:50:05.104500210Z [2024-04-06 02:50:05,104: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:50:05.104630148Z [2024-04-06 02:50:05,104: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:50:05.104662257Z [2024-04-06 02:50:05,104: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:50:05.104900385Z [2024-04-06 02:50:05,104: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:50:05.104911547Z [2024-04-06 02:50:05,104: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:50:05.272379272Z [2024-04-06 02:50:05,272: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:50:05.408931297Z [2024-04-06 02:50:05,408: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:50:05.435774849Z [2024-04-06 02:50:05,435: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:50:05.573591873Z [2024-04-06 02:50:05,573: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:50:05.584294068Z [2024-04-06 02:50:05,581: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:50:05.587998682Z [2024-04-06 02:50:05,586: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:50:05.588354047Z [2024-04-06 02:50:05,588: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:50:05.590088932Z [2024-04-06 02:50:05,589: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:50:05.590384320Z [2024-04-06 02:50:05,590: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:50:05.590480653Z [2024-04-06 02:50:05,590: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:50:05.830875389Z [2024-04-06 02:50:05,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:50:06.050887731Z [2024-04-06 02:50:06,050: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[75148a00-1ddb-41ad-9392-ed8df5b93c34] succeeded in 4.789375100000143s: None 2024-04-06T02:50:06.607900281Z [2024-04-06 02:50:06,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a556c990-995f-4e52-b43a-5b774f78ebb2] received 2024-04-06T02:50:06.619199206Z [2024-04-06 02:50:06,618: INFO/ForkPoolWorker-1] [a556c990-995f-4e52-b43a-5b774f78ebb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:50:06.893085543Z [2024-04-06 02:50:06,887: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:50:07.006557986Z [2024-04-06 02:50:07,001: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[428f9d32-3946-4945-b5a0-33df21ab42b9] succeeded in 5.7821622810006374s: None 2024-04-06T02:50:07.734652228Z [2024-04-06 02:50:07,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1017161-333b-409a-aabd-88b852f65267] succeeded in 6.527064656999755s: None 2024-04-06T02:50:07.991618369Z [2024-04-06 02:50:07,991: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:50:07.994611315Z [2024-04-06 02:50:07,994: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:50:08.026081650Z [2024-04-06 02:50:08,025: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:50:08.027573966Z [2024-04-06 02:50:08,027: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:50:08.027686016Z [2024-04-06 02:50:08,027: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:50:08.027987412Z [2024-04-06 02:50:08,027: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:50:08.028106938Z [2024-04-06 02:50:08,027: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:50:08.028414490Z [2024-04-06 02:50:08,028: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:50:08.028511144Z [2024-04-06 02:50:08,028: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:50:08.124674143Z [2024-04-06 02:50:08,120: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:50:08.730161983Z [2024-04-06 02:50:08,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1a3da90-b666-483d-a6b1-53a862df0de6] received 2024-04-06T02:50:08.745111037Z [2024-04-06 02:50:08,744: INFO/ForkPoolWorker-15] [e1a3da90-b666-483d-a6b1-53a862df0de6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:50:08.781732521Z [2024-04-06 02:50:08,781: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a556c990-995f-4e52-b43a-5b774f78ebb2] succeeded in 2.1722784049998154s: None 2024-04-06T02:50:08.998627540Z [2024-04-06 02:50:08,995: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:50:10.016111522Z [2024-04-06 02:50:10,015: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:50:10.019258451Z [2024-04-06 02:50:10,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:50:10.048484868Z [2024-04-06 02:50:10,048: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:50:10.049551437Z [2024-04-06 02:50:10,049: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:50:10.049603742Z [2024-04-06 02:50:10,049: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:50:10.049729337Z [2024-04-06 02:50:10,049: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:50:10.049854988Z [2024-04-06 02:50:10,049: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:50:10.050192852Z [2024-04-06 02:50:10,049: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:50:10.050363210Z [2024-04-06 02:50:10,050: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:50:10.138534606Z [2024-04-06 02:50:10,138: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:50:10.786087580Z [2024-04-06 02:50:10,783: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1a3da90-b666-483d-a6b1-53a862df0de6] succeeded in 2.04447213200001s: None 2024-04-06T02:50:11.077934535Z [2024-04-06 02:50:11,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2b8ab77-d39d-42e9-aa68-9a85f3d84587] received 2024-04-06T02:50:11.087266674Z [2024-04-06 02:50:11,087: INFO/ForkPoolWorker-15] [b2b8ab77-d39d-42e9-aa68-9a85f3d84587] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:50:11.363363355Z [2024-04-06 02:50:11,359: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:50:12.423981549Z [2024-04-06 02:50:12,422: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:50:12.429522388Z [2024-04-06 02:50:12,428: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:50:12.460094844Z [2024-04-06 02:50:12,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:50:12.461498662Z [2024-04-06 02:50:12,461: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:50:12.461647856Z [2024-04-06 02:50:12,461: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:50:12.461869325Z [2024-04-06 02:50:12,461: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:50:12.462013701Z [2024-04-06 02:50:12,461: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:50:12.462882911Z [2024-04-06 02:50:12,462: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:50:12.463063030Z [2024-04-06 02:50:12,462: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:50:12.543145468Z [2024-04-06 02:50:12,542: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:50:13.153095588Z [2024-04-06 02:50:13,152: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2b8ab77-d39d-42e9-aa68-9a85f3d84587] succeeded in 2.0738050049994854s: None 2024-04-06T02:51:00.320956692Z [2024-04-06 02:51:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[456654c5-cbe5-4d83-bb44-d7b701f399a5] received 2024-04-06T02:51:00.323655490Z [2024-04-06 02:51:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aff01834-7bca-4e4e-9886-fd197d5a1b10] received 2024-04-06T02:51:00.333659656Z [2024-04-06 02:51:00,333: INFO/ForkPoolWorker-16] [aff01834-7bca-4e4e-9886-fd197d5a1b10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:51:00.335286646Z [2024-04-06 02:51:00,334: INFO/ForkPoolWorker-15] [456654c5-cbe5-4d83-bb44-d7b701f399a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:51:00.628436119Z [2024-04-06 02:51:00,623: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:51:00.656252633Z [2024-04-06 02:51:00,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:51:02.011430276Z [2024-04-06 02:51:02,011: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:51:02.015783194Z [2024-04-06 02:51:02,015: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:51:02.053987394Z [2024-04-06 02:51:02,053: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:51:02.054980317Z [2024-04-06 02:51:02,054: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:51:02.058743761Z [2024-04-06 02:51:02,058: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:51:02.065851749Z [2024-04-06 02:51:02,065: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:51:02.065881381Z [2024-04-06 02:51:02,065: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:51:02.066025474Z [2024-04-06 02:51:02,065: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:51:02.066090977Z [2024-04-06 02:51:02,065: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:51:02.066456415Z [2024-04-06 02:51:02,066: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:51:02.066695009Z [2024-04-06 02:51:02,066: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:51:02.096396615Z [2024-04-06 02:51:02,095: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:51:02.099672670Z [2024-04-06 02:51:02,099: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:51:02.099736482Z [2024-04-06 02:51:02,099: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:51:02.100009199Z [2024-04-06 02:51:02,099: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:51:02.100079651Z [2024-04-06 02:51:02,099: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:51:02.101900086Z [2024-04-06 02:51:02,100: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:51:02.102038091Z [2024-04-06 02:51:02,101: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:51:02.151896192Z [2024-04-06 02:51:02,151: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:51:02.250314489Z [2024-04-06 02:51:02,249: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:51:03.964093075Z [2024-04-06 02:51:03,963: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aff01834-7bca-4e4e-9886-fd197d5a1b10] succeeded in 3.638374190999457s: None 2024-04-06T02:51:04.214556693Z [2024-04-06 02:51:04,214: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[456654c5-cbe5-4d83-bb44-d7b701f399a5] succeeded in 3.8903475979996074s: None 2024-04-06T02:52:00.838365097Z [2024-04-06 02:52:00,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eded5528-1f5f-4707-b253-38047abaf721] received 2024-04-06T02:52:00.842672532Z [2024-04-06 02:52:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36a9fbe3-63d0-4e06-9c4b-ede3f3065383] received 2024-04-06T02:52:00.849366863Z [2024-04-06 02:52:00,849: INFO/ForkPoolWorker-15] [eded5528-1f5f-4707-b253-38047abaf721] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:52:00.852549283Z [2024-04-06 02:52:00,852: INFO/ForkPoolWorker-16] [36a9fbe3-63d0-4e06-9c4b-ede3f3065383] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:52:00.859123130Z [2024-04-06 02:52:00,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e11b81c-2852-427f-af91-56d6f5d28466] received 2024-04-06T02:52:00.901668441Z [2024-04-06 02:52:00,901: INFO/ForkPoolWorker-1] [1e11b81c-2852-427f-af91-56d6f5d28466] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:52:01.274573977Z [2024-04-06 02:52:01,270: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:52:01.365171297Z [2024-04-06 02:52:01,351: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:52:01.413097481Z [2024-04-06 02:52:01,409: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:52:01.950902396Z [2024-04-06 02:52:01,950: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:52:03.009290043Z [2024-04-06 02:52:03,008: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1e11b81c-2852-427f-af91-56d6f5d28466] succeeded in 2.1474378210004943s: None 2024-04-06T02:52:03.192470155Z [2024-04-06 02:52:03,192: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:52:03.196080295Z [2024-04-06 02:52:03,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:52:03.269351832Z [2024-04-06 02:52:03,269: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:52:03.274440899Z [2024-04-06 02:52:03,273: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:52:03.288023221Z [2024-04-06 02:52:03,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:52:03.292704551Z [2024-04-06 02:52:03,292: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:52:03.296158692Z [2024-04-06 02:52:03,295: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:52:03.302077132Z [2024-04-06 02:52:03,296: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:52:03.302291514Z [2024-04-06 02:52:03,302: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:52:03.302650163Z [2024-04-06 02:52:03,302: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:52:03.302805217Z [2024-04-06 02:52:03,302: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:52:03.341417456Z [2024-04-06 02:52:03,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:52:03.350167637Z [2024-04-06 02:52:03,349: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:52:03.350648393Z [2024-04-06 02:52:03,350: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:52:03.350880933Z [2024-04-06 02:52:03,350: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:52:03.351138809Z [2024-04-06 02:52:03,351: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:52:03.351469376Z [2024-04-06 02:52:03,351: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:52:03.351667080Z [2024-04-06 02:52:03,351: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:52:03.425106030Z [2024-04-06 02:52:03,424: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:52:03.461623028Z [2024-04-06 02:52:03,461: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:52:05.341774616Z [2024-04-06 02:52:05,341: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36a9fbe3-63d0-4e06-9c4b-ede3f3065383] succeeded in 4.497133882000526s: None 2024-04-06T02:52:05.881999284Z [2024-04-06 02:52:05,881: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eded5528-1f5f-4707-b253-38047abaf721] succeeded in 5.040993106999849s: None 2024-04-06T02:52:54.282941881Z [2024-04-06 02:52:54,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eca4a2e6-dd6b-44ea-827e-e1d9f9649ec7] received 2024-04-06T02:52:54.307030314Z [2024-04-06 02:52:54,293: INFO/ForkPoolWorker-15] [eca4a2e6-dd6b-44ea-827e-e1d9f9649ec7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240406025253_219393', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-06T02:52:54.613084816Z [2024-04-06 02:52:54,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-06T02:52:54.901699132Z [2024-04-06 02:52:54,901: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:52:55.542319731Z [2024-04-06 02:52:55,541: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eca4a2e6-dd6b-44ea-827e-e1d9f9649ec7] succeeded in 1.2571096900001066s: None 2024-04-06T02:53:01.216272172Z [2024-04-06 02:53:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec461e3d-6f25-4429-8ef5-bcdaf08e45b5] received 2024-04-06T02:53:01.232927946Z [2024-04-06 02:53:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[403e3f12-84cb-4cca-b1be-3396c470ee31] received 2024-04-06T02:53:01.243004504Z [2024-04-06 02:53:01,242: INFO/ForkPoolWorker-15] [ec461e3d-6f25-4429-8ef5-bcdaf08e45b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:53:01.259305987Z [2024-04-06 02:53:01,258: INFO/ForkPoolWorker-16] [403e3f12-84cb-4cca-b1be-3396c470ee31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:53:01.549560954Z [2024-04-06 02:53:01,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:53:01.615821671Z [2024-04-06 02:53:01,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:53:03.006598769Z [2024-04-06 02:53:03,006: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:53:03.010986929Z [2024-04-06 02:53:03,010: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:53:03.076958467Z [2024-04-06 02:53:03,076: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:53:03.084319153Z [2024-04-06 02:53:03,081: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:53:03.084832703Z [2024-04-06 02:53:03,084: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:53:03.085001277Z [2024-04-06 02:53:03,084: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:53:03.085128744Z [2024-04-06 02:53:03,084: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:53:03.085553337Z [2024-04-06 02:53:03,085: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:53:03.085564206Z [2024-04-06 02:53:03,085: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:53:03.172281307Z [2024-04-06 02:53:03,171: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:53:03.214159632Z [2024-04-06 02:53:03,213: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:53:03.217331904Z [2024-04-06 02:53:03,216: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:53:03.261367517Z [2024-04-06 02:53:03,261: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:53:03.262323393Z [2024-04-06 02:53:03,262: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:53:03.262336669Z [2024-04-06 02:53:03,262: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:53:03.262700797Z [2024-04-06 02:53:03,262: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:53:03.262763240Z [2024-04-06 02:53:03,262: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:53:03.266159226Z [2024-04-06 02:53:03,265: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:53:03.266171751Z [2024-04-06 02:53:03,266: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:53:03.361981301Z [2024-04-06 02:53:03,361: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:53:05.351551705Z [2024-04-06 02:53:05,351: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[403e3f12-84cb-4cca-b1be-3396c470ee31] succeeded in 4.113724342999376s: None 2024-04-06T02:53:05.472258562Z [2024-04-06 02:53:05,471: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec461e3d-6f25-4429-8ef5-bcdaf08e45b5] succeeded in 4.250822684999548s: None 2024-04-06T02:54:00.551455020Z [2024-04-06 02:54:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6aee4d9-cf15-48c0-bc30-6d3cd3342cde] received 2024-04-06T02:54:00.562663919Z [2024-04-06 02:54:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93a548ad-579a-45c1-b654-266668641360] received 2024-04-06T02:54:00.563514303Z [2024-04-06 02:54:00,563: INFO/ForkPoolWorker-15] [b6aee4d9-cf15-48c0-bc30-6d3cd3342cde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:54:00.567357075Z [2024-04-06 02:54:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f552ff3-15ab-4821-ae81-cd61449245f7] received 2024-04-06T02:54:00.573972654Z [2024-04-06 02:54:00,573: INFO/ForkPoolWorker-16] [93a548ad-579a-45c1-b654-266668641360] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:54:00.588908800Z [2024-04-06 02:54:00,588: INFO/ForkPoolWorker-1] [9f552ff3-15ab-4821-ae81-cd61449245f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:54:00.947351684Z [2024-04-06 02:54:00,939: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:54:00.959976452Z [2024-04-06 02:54:00,956: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:54:00.960795301Z [2024-04-06 02:54:00,957: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:54:01.239255611Z [2024-04-06 02:54:01,239: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:54:01.913844024Z [2024-04-06 02:54:01,913: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93a548ad-579a-45c1-b654-266668641360] succeeded in 1.3484534449999046s: None 2024-04-06T02:54:02.805471611Z [2024-04-06 02:54:02,805: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:54:02.808790634Z [2024-04-06 02:54:02,808: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:54:02.879180242Z [2024-04-06 02:54:02,878: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:54:02.889134243Z [2024-04-06 02:54:02,883: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:54:02.889427868Z [2024-04-06 02:54:02,889: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:54:02.889643909Z [2024-04-06 02:54:02,889: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:54:02.891569446Z [2024-04-06 02:54:02,890: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:54:02.891583739Z [2024-04-06 02:54:02,890: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:54:02.891586981Z [2024-04-06 02:54:02,890: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:54:02.976366874Z [2024-04-06 02:54:02,976: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:54:03.597700089Z [2024-04-06 02:54:03,597: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:54:03.608483409Z [2024-04-06 02:54:03,604: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:54:03.693496712Z [2024-04-06 02:54:03,693: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:54:03.698390538Z [2024-04-06 02:54:03,698: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:54:03.698410847Z [2024-04-06 02:54:03,698: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:54:03.698497689Z [2024-04-06 02:54:03,698: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:54:03.698561816Z [2024-04-06 02:54:03,698: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:54:03.698784472Z [2024-04-06 02:54:03,698: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:54:03.698826859Z [2024-04-06 02:54:03,698: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:54:03.826203146Z [2024-04-06 02:54:03,822: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:54:05.368625163Z [2024-04-06 02:54:05,368: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f552ff3-15ab-4821-ae81-cd61449245f7] succeeded in 4.798228089999611s: None 2024-04-06T02:54:06.555067034Z [2024-04-06 02:54:06,554: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6aee4d9-cf15-48c0-bc30-6d3cd3342cde] succeeded in 5.999606526000207s: None 2024-04-06T02:54:20.220856368Z [2024-04-06 02:54:20,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd4a6849-b279-4da5-b105-d2401876f117] received 2024-04-06T02:54:20.233583024Z [2024-04-06 02:54:20,233: INFO/ForkPoolWorker-15] [fd4a6849-b279-4da5-b105-d2401876f117] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:54:20.577464209Z [2024-04-06 02:54:20,572: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:54:21.918199526Z [2024-04-06 02:54:21,917: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:54:21.921433035Z [2024-04-06 02:54:21,920: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:54:21.945968134Z [2024-04-06 02:54:21,945: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:54:21.947310715Z [2024-04-06 02:54:21,947: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:54:21.947392081Z [2024-04-06 02:54:21,947: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:54:21.947482347Z [2024-04-06 02:54:21,947: INFO/ForkPoolWorker-15] Read VIM bb497dd3-763c-402a-9bfa-42b2035b7b2a (basic01_229848) 2024-04-06T02:54:21.947636056Z [2024-04-06 02:54:21,947: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'name': 'basic01_229848', 'vim_type': 'openstack'}] 2024-04-06T02:54:21.947734008Z [2024-04-06 02:54:21,947: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:54:21.948025680Z [2024-04-06 02:54:21,947: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:54:21.948114869Z [2024-04-06 02:54:21,948: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:54:21.952952865Z [2024-04-06 02:54:21,952: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a 2024-04-06T02:54:22.036246273Z [2024-04-06 02:54:22,035: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:54:24.053882172Z [2024-04-06 02:54:24,052: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd4a6849-b279-4da5-b105-d2401876f117] succeeded in 3.82760255499943s: None 2024-04-06T02:54:34.241175149Z [2024-04-06 02:54:34,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab1a8133-bf9b-49cb-8be2-7aa7883512d8] received 2024-04-06T02:54:34.276163365Z [2024-04-06 02:54:34,271: INFO/ForkPoolWorker-15] [ab1a8133-bf9b-49cb-8be2-7aa7883512d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:54:34.602269243Z [2024-04-06 02:54:34,599: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:54:35.686986172Z [2024-04-06 02:54:35,686: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:54:35.690269088Z [2024-04-06 02:54:35,689: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:54:35.719768677Z [2024-04-06 02:54:35,719: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:54:35.721407114Z [2024-04-06 02:54:35,721: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:54:35.721420029Z [2024-04-06 02:54:35,721: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:54:35.721706773Z [2024-04-06 02:54:35,721: INFO/ForkPoolWorker-15] Read VIM bb497dd3-763c-402a-9bfa-42b2035b7b2a (basic01_229848) 2024-04-06T02:54:35.722044264Z [2024-04-06 02:54:35,721: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'name': 'basic01_229848', 'vim_type': 'openstack'}] 2024-04-06T02:54:35.722079127Z [2024-04-06 02:54:35,721: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:54:35.722330969Z [2024-04-06 02:54:35,722: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:54:35.722346527Z [2024-04-06 02:54:35,722: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:54:35.726847305Z [2024-04-06 02:54:35,726: INFO/ForkPoolWorker-15] Creating DAG vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a 2024-04-06T02:54:35.805716517Z [2024-04-06 02:54:35,805: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:54:37.298497639Z [2024-04-06 02:54:37,297: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab1a8133-bf9b-49cb-8be2-7aa7883512d8] succeeded in 3.0556806639997376s: None 2024-04-06T02:54:37.625107719Z [2024-04-06 02:54:37,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f562012-ce6a-42de-a82c-418f654eecfb] received 2024-04-06T02:54:37.634836501Z [2024-04-06 02:54:37,634: INFO/ForkPoolWorker-15] [2f562012-ce6a-42de-a82c-418f654eecfb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:54:37.908320441Z [2024-04-06 02:54:37,905: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:54:39.022169000Z [2024-04-06 02:54:39,021: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:54:39.025109500Z [2024-04-06 02:54:39,024: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:54:39.060852840Z [2024-04-06 02:54:39,060: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:54:39.062743089Z [2024-04-06 02:54:39,062: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:54:39.062777681Z [2024-04-06 02:54:39,062: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:54:39.062800556Z [2024-04-06 02:54:39,062: INFO/ForkPoolWorker-15] Read VIM bb497dd3-763c-402a-9bfa-42b2035b7b2a (basic01_229848) 2024-04-06T02:54:39.062971666Z [2024-04-06 02:54:39,062: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'name': 'basic01_229848', 'vim_type': 'openstack'}] 2024-04-06T02:54:39.062990048Z [2024-04-06 02:54:39,062: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:54:39.063177770Z [2024-04-06 02:54:39,063: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:54:39.063227630Z [2024-04-06 02:54:39,063: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:54:39.069957029Z [2024-04-06 02:54:39,069: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a 2024-04-06T02:54:39.162726040Z [2024-04-06 02:54:39,162: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:54:39.735036677Z [2024-04-06 02:54:39,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f562012-ce6a-42de-a82c-418f654eecfb] succeeded in 2.1072178430003987s: None 2024-04-06T02:54:39.958810236Z [2024-04-06 02:54:39,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c35cf825-1402-496b-ab7b-5601936d9e1b] received 2024-04-06T02:54:39.969461435Z [2024-04-06 02:54:39,969: INFO/ForkPoolWorker-15] [c35cf825-1402-496b-ab7b-5601936d9e1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'split_metrics', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:54:40.297066138Z [2024-04-06 02:54:40,293: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:54:41.456384688Z [2024-04-06 02:54:41,455: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:54:41.459538861Z [2024-04-06 02:54:41,459: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:54:41.494944004Z [2024-04-06 02:54:41,494: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:54:41.498377806Z [2024-04-06 02:54:41,498: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:54:41.498567105Z [2024-04-06 02:54:41,498: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:54:41.498731267Z [2024-04-06 02:54:41,498: INFO/ForkPoolWorker-15] Read VIM bb497dd3-763c-402a-9bfa-42b2035b7b2a (basic01_229848) 2024-04-06T02:54:41.499023842Z [2024-04-06 02:54:41,498: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'name': 'basic01_229848', 'vim_type': 'openstack'}] 2024-04-06T02:54:41.499352525Z [2024-04-06 02:54:41,499: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:54:41.501098262Z [2024-04-06 02:54:41,500: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:54:41.501276362Z [2024-04-06 02:54:41,501: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:54:41.513022022Z [2024-04-06 02:54:41,512: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a 2024-04-06T02:54:41.590384719Z [2024-04-06 02:54:41,590: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:54:42.254006568Z [2024-04-06 02:54:42,253: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c35cf825-1402-496b-ab7b-5601936d9e1b] succeeded in 2.292548426999929s: None 2024-04-06T02:54:42.678852409Z [2024-04-06 02:54:42,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3984a50-d712-4b2e-b4e8-e327462410e5] received 2024-04-06T02:54:42.690568495Z [2024-04-06 02:54:42,690: INFO/ForkPoolWorker-15] [b3984a50-d712-4b2e-b4e8-e327462410e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'collect_metrics', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:54:42.956521705Z [2024-04-06 02:54:42,953: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:54:44.013725354Z [2024-04-06 02:54:44,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:54:44.016858754Z [2024-04-06 02:54:44,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:54:44.047994044Z [2024-04-06 02:54:44,047: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:54:44.050964348Z [2024-04-06 02:54:44,050: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:54:44.051046377Z [2024-04-06 02:54:44,050: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:54:44.051639475Z [2024-04-06 02:54:44,050: INFO/ForkPoolWorker-15] Read VIM bb497dd3-763c-402a-9bfa-42b2035b7b2a (basic01_229848) 2024-04-06T02:54:44.052099859Z [2024-04-06 02:54:44,051: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'name': 'basic01_229848', 'vim_type': 'openstack'}] 2024-04-06T02:54:44.053290427Z [2024-04-06 02:54:44,052: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:54:44.053625383Z [2024-04-06 02:54:44,053: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:54:44.054159973Z [2024-04-06 02:54:44,053: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:54:44.061909717Z [2024-04-06 02:54:44,061: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a 2024-04-06T02:54:44.160845709Z [2024-04-06 02:54:44,160: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:54:44.815629501Z [2024-04-06 02:54:44,814: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3984a50-d712-4b2e-b4e8-e327462410e5] succeeded in 2.1336236679999274s: None 2024-04-06T02:54:45.056362918Z [2024-04-06 02:54:45,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7017e677-f5ee-4f57-95fa-f9abdf0cfead] received 2024-04-06T02:54:45.079286088Z [2024-04-06 02:54:45,079: INFO/ForkPoolWorker-15] [7017e677-f5ee-4f57-95fa-f9abdf0cfead] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'send_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:54:45.333392885Z [2024-04-06 02:54:45,330: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:54:46.328492734Z [2024-04-06 02:54:46,328: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:54:46.331463537Z [2024-04-06 02:54:46,331: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:54:46.365067403Z [2024-04-06 02:54:46,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:54:46.366563209Z [2024-04-06 02:54:46,366: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:54:46.366626392Z [2024-04-06 02:54:46,366: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:54:46.366702655Z [2024-04-06 02:54:46,366: INFO/ForkPoolWorker-15] Read VIM bb497dd3-763c-402a-9bfa-42b2035b7b2a (basic01_229848) 2024-04-06T02:54:46.366896113Z [2024-04-06 02:54:46,366: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'name': 'basic01_229848', 'vim_type': 'openstack'}] 2024-04-06T02:54:46.366971758Z [2024-04-06 02:54:46,366: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:54:46.367433009Z [2024-04-06 02:54:46,367: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:54:46.367454011Z [2024-04-06 02:54:46,367: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:54:46.375474334Z [2024-04-06 02:54:46,375: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a 2024-04-06T02:54:46.452581477Z [2024-04-06 02:54:46,452: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:54:47.055983896Z [2024-04-06 02:54:47,055: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7017e677-f5ee-4f57-95fa-f9abdf0cfead] succeeded in 1.990310670999861s: None 2024-04-06T02:55:00.328674863Z [2024-04-06 02:55:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c506630c-b6e4-4bcf-b280-49a8eb1f5880] received 2024-04-06T02:55:00.333277472Z [2024-04-06 02:55:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36ae83f9-5f67-4d01-92e8-c36ee271624c] received 2024-04-06T02:55:00.343222500Z [2024-04-06 02:55:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3acf9e9a-6695-45ed-9d1f-1266f2e9d3d8] received 2024-04-06T02:55:00.343247958Z [2024-04-06 02:55:00,342: INFO/ForkPoolWorker-16] [36ae83f9-5f67-4d01-92e8-c36ee271624c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:00.345716663Z [2024-04-06 02:55:00,345: INFO/ForkPoolWorker-15] [c506630c-b6e4-4bcf-b280-49a8eb1f5880] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:00.346136935Z [2024-04-06 02:55:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e57ec08-2bd0-461e-9089-6986d6bd0885] received 2024-04-06T02:55:00.350090472Z [2024-04-06 02:55:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed7c982a-84b7-4f3b-ad27-aa85cee1998a] received 2024-04-06T02:55:00.351683952Z [2024-04-06 02:55:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eadec9f0-03ea-442e-bba6-1c06e966cb74] received 2024-04-06T02:55:00.366752477Z [2024-04-06 02:55:00,366: INFO/ForkPoolWorker-1] [3acf9e9a-6695-45ed-9d1f-1266f2e9d3d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:55:00.373624972Z [2024-04-06 02:55:00,373: INFO/ForkPoolWorker-2] [0e57ec08-2bd0-461e-9089-6986d6bd0885] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:55:00.378883633Z [2024-04-06 02:55:00,378: INFO/ForkPoolWorker-3] [ed7c982a-84b7-4f3b-ad27-aa85cee1998a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:55:00.460800759Z [2024-04-06 02:55:00,460: INFO/ForkPoolWorker-4] [eadec9f0-03ea-442e-bba6-1c06e966cb74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:55:00.708773172Z [2024-04-06 02:55:00,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:00.831144267Z [2024-04-06 02:55:00,826: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:55:00.841647981Z [2024-04-06 02:55:00,838: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:00.926948329Z [2024-04-06 02:55:00,923: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:55:01.453028733Z [2024-04-06 02:55:01,448: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:55:01.907434306Z [2024-04-06 02:55:01,887: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:55:03.362126479Z [2024-04-06 02:55:03,361: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:55:03.377568813Z [2024-04-06 02:55:03,377: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:03.525249973Z [2024-04-06 02:55:03,525: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:55:03.533194924Z [2024-04-06 02:55:03,530: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:03.533339080Z [2024-04-06 02:55:03,533: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:03.533418533Z [2024-04-06 02:55:03,533: INFO/ForkPoolWorker-1] Read VIM bb497dd3-763c-402a-9bfa-42b2035b7b2a (basic01_229848) 2024-04-06T02:55:03.533612584Z [2024-04-06 02:55:03,533: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'name': 'basic01_229848', 'vim_type': 'openstack'}] 2024-04-06T02:55:03.534831095Z [2024-04-06 02:55:03,534: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:55:03.551275721Z [2024-04-06 02:55:03,550: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:55:03.551436536Z [2024-04-06 02:55:03,551: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:03.557904705Z [2024-04-06 02:55:03,557: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a 2024-04-06T02:55:03.651610410Z [2024-04-06 02:55:03,651: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:55:05.384085895Z [2024-04-06 02:55:05,383: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-06T02:55:05.389525619Z [2024-04-06 02:55:05,389: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:05.430674763Z [2024-04-06 02:55:05,430: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-06T02:55:05.431953257Z [2024-04-06 02:55:05,431: INFO/ForkPoolWorker-4] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:05.432109657Z [2024-04-06 02:55:05,431: INFO/ForkPoolWorker-4] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:05.432226161Z [2024-04-06 02:55:05,432: INFO/ForkPoolWorker-4] Read VIM bb497dd3-763c-402a-9bfa-42b2035b7b2a (basic01_229848) 2024-04-06T02:55:05.432440171Z [2024-04-06 02:55:05,432: INFO/ForkPoolWorker-4] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'name': 'basic01_229848', 'vim_type': 'openstack'}] 2024-04-06T02:55:05.432551573Z [2024-04-06 02:55:05,432: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-06T02:55:05.432822643Z [2024-04-06 02:55:05,432: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:55:05.432955347Z [2024-04-06 02:55:05,432: INFO/ForkPoolWorker-4] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:05.443837747Z [2024-04-06 02:55:05,437: INFO/ForkPoolWorker-4] Creating DAG vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a 2024-04-06T02:55:05.518042960Z [2024-04-06 02:55:05,517: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:55:06.014511699Z [2024-04-06 02:55:06,014: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3acf9e9a-6695-45ed-9d1f-1266f2e9d3d8] succeeded in 5.664319380000052s: None 2024-04-06T02:55:06.359837767Z [2024-04-06 02:55:06,359: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T02:55:06.363044050Z [2024-04-06 02:55:06,362: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:06.419381840Z [2024-04-06 02:55:06,419: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:55:06.432942539Z [2024-04-06 02:55:06,432: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:06.446499658Z [2024-04-06 02:55:06,446: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T02:55:06.458338015Z [2024-04-06 02:55:06,458: INFO/ForkPoolWorker-3] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:06.458529186Z [2024-04-06 02:55:06,458: INFO/ForkPoolWorker-3] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:06.458672325Z [2024-04-06 02:55:06,458: INFO/ForkPoolWorker-3] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:06.458800614Z [2024-04-06 02:55:06,458: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T02:55:06.459069903Z [2024-04-06 02:55:06,458: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:55:06.459531501Z [2024-04-06 02:55:06,459: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:06.468478890Z [2024-04-06 02:55:06,468: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:55:06.469806582Z [2024-04-06 02:55:06,469: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:55:06.473595279Z [2024-04-06 02:55:06,473: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T02:55:06.488511867Z [2024-04-06 02:55:06,488: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:06.597618683Z [2024-04-06 02:55:06,597: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T02:55:06.611912623Z [2024-04-06 02:55:06,611: INFO/ForkPoolWorker-3] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:06.612720797Z [2024-04-06 02:55:06,612: INFO/ForkPoolWorker-3] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:06.612946252Z [2024-04-06 02:55:06,612: INFO/ForkPoolWorker-3] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:06.613050439Z [2024-04-06 02:55:06,612: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T02:55:06.614497187Z [2024-04-06 02:55:06,614: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:55:06.618079981Z [2024-04-06 02:55:06,614: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:06.629938618Z [2024-04-06 02:55:06,629: ERROR/ForkPoolWorker-3] [ed7c982a-84b7-4f3b-ad27-aa85cee1998a] Failed to execute task Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse.. 2024-04-06T02:55:06.629963605Z Traceback (most recent call last): 2024-04-06T02:55:06.629970856Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T02:55:06.629977660Z args.func(args) 2024-04-06T02:55:06.629984192Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T02:55:06.629989721Z return func(*args, **kwargs) 2024-04-06T02:55:06.629995927Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T02:55:06.630001313Z return f(*args, **kwargs) 2024-04-06T02:55:06.630006861Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T02:55:06.630012027Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T02:55:06.630017352Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T02:55:06.630023016Z raise AirflowException( 2024-04-06T02:55:06.630029228Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse. 2024-04-06T02:55:06.631453843Z [2024-04-06 02:55:06,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:55:06.632993138Z [2024-04-06 02:55:06,632: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:06.633126991Z [2024-04-06 02:55:06,632: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:06.633363830Z [2024-04-06 02:55:06,633: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:06.633536918Z [2024-04-06 02:55:06,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:55:06.633888402Z [2024-04-06 02:55:06,633: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:55:06.634119942Z [2024-04-06 02:55:06,633: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:06.636965459Z [2024-04-06 02:55:06,636: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[eadec9f0-03ea-442e-bba6-1c06e966cb74] succeeded in 6.281033459000355s: None 2024-04-06T02:55:06.642761029Z [2024-04-06 02:55:06,642: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:06.643530757Z [2024-04-06 02:55:06,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:06.644568754Z [2024-04-06 02:55:06,644: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:55:06.647311744Z [2024-04-06 02:55:06,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:06.699297634Z [2024-04-06 02:55:06,698: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ed7c982a-84b7-4f3b-ad27-aa85cee1998a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ed7c982a-84b7-4f3b-ad27-aa85cee1998a') 2024-04-06T02:55:06.699312262Z Traceback (most recent call last): 2024-04-06T02:55:06.699315697Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T02:55:06.699318317Z R = retval = fun(*args, **kwargs) 2024-04-06T02:55:06.699320885Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T02:55:06.699323558Z return self.run(*args, **kwargs) 2024-04-06T02:55:06.699326709Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T02:55:06.699329780Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T02:55:06.699332411Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T02:55:06.699335367Z raise AirflowException(msg) 2024-04-06T02:55:06.699338415Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ed7c982a-84b7-4f3b-ad27-aa85cee1998a 2024-04-06T02:55:06.775732814Z [2024-04-06 02:55:06,775: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:55:06.782136083Z [2024-04-06 02:55:06,781: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:06.782275342Z [2024-04-06 02:55:06,782: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:06.782459752Z [2024-04-06 02:55:06,782: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:06.782595164Z [2024-04-06 02:55:06,782: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:55:06.784081153Z [2024-04-06 02:55:06,783: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:55:06.784237010Z [2024-04-06 02:55:06,784: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:06.803261780Z [2024-04-06 02:55:06,802: ERROR/ForkPoolWorker-15] [c506630c-b6e4-4bcf-b280-49a8eb1f5880] Failed to execute task Dag 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse.. 2024-04-06T02:55:06.803282864Z Traceback (most recent call last): 2024-04-06T02:55:06.803286677Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T02:55:06.803290484Z args.func(args) 2024-04-06T02:55:06.803293924Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T02:55:06.803297549Z return func(*args, **kwargs) 2024-04-06T02:55:06.803300649Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T02:55:06.803303358Z return f(*args, **kwargs) 2024-04-06T02:55:06.803306118Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T02:55:06.803308872Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T02:55:06.803315542Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T02:55:06.803318427Z raise AirflowException( 2024-04-06T02:55:06.803321664Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse. 2024-04-06T02:55:06.847221404Z [2024-04-06 02:55:06,846: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:55:06.850826153Z [2024-04-06 02:55:06,850: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:06.919906856Z [2024-04-06 02:55:06,919: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c506630c-b6e4-4bcf-b280-49a8eb1f5880] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c506630c-b6e4-4bcf-b280-49a8eb1f5880') 2024-04-06T02:55:06.919922575Z Traceback (most recent call last): 2024-04-06T02:55:06.919931315Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T02:55:06.919934583Z R = retval = fun(*args, **kwargs) 2024-04-06T02:55:06.919937783Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T02:55:06.919940907Z return self.run(*args, **kwargs) 2024-04-06T02:55:06.919944991Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T02:55:06.919958610Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T02:55:06.919961831Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T02:55:06.919965229Z raise AirflowException(msg) 2024-04-06T02:55:06.919968810Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c506630c-b6e4-4bcf-b280-49a8eb1f5880 2024-04-06T02:55:06.922469046Z [2024-04-06 02:55:06,922: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:55:06.927980325Z [2024-04-06 02:55:06,927: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:06.931378809Z [2024-04-06 02:55:06,931: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:55:06.937208986Z [2024-04-06 02:55:06,936: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:06.937220810Z [2024-04-06 02:55:06,937: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:06.937404275Z [2024-04-06 02:55:06,937: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:06.937448852Z [2024-04-06 02:55:06,937: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:55:06.937765942Z [2024-04-06 02:55:06,937: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:55:06.937824346Z [2024-04-06 02:55:06,937: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:06.990661538Z [2024-04-06 02:55:06,990: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:55:06.992420840Z [2024-04-06 02:55:06,992: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:06.992675150Z [2024-04-06 02:55:06,992: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:06.992951822Z [2024-04-06 02:55:06,992: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:06.993199317Z [2024-04-06 02:55:06,992: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:55:06.994260963Z [2024-04-06 02:55:06,993: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:55:06.994277299Z [2024-04-06 02:55:06,994: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:07.085288266Z [2024-04-06 02:55:07,085: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:55:07.098318945Z [2024-04-06 02:55:07,098: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:55:07.703394030Z [2024-04-06 02:55:07,702: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36ae83f9-5f67-4d01-92e8-c36ee271624c] succeeded in 7.367796164000538s: None 2024-04-06T02:55:08.466000307Z [2024-04-06 02:55:08,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8bad8fc-4e0c-4eef-94bf-5c18210c2ddc] received 2024-04-06T02:55:08.474659569Z [2024-04-06 02:55:08,474: INFO/ForkPoolWorker-15] [e8bad8fc-4e0c-4eef-94bf-5c18210c2ddc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:08.843466496Z [2024-04-06 02:55:08,843: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e57ec08-2bd0-461e-9089-6986d6bd0885] succeeded in 8.490062643000783s: None 2024-04-06T02:55:08.871412913Z [2024-04-06 02:55:08,868: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:09.963141590Z [2024-04-06 02:55:09,962: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:55:09.966388153Z [2024-04-06 02:55:09,966: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:10.006639538Z [2024-04-06 02:55:10,006: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:55:10.007736616Z [2024-04-06 02:55:10,007: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:10.007809981Z [2024-04-06 02:55:10,007: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:10.007921499Z [2024-04-06 02:55:10,007: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:10.008081121Z [2024-04-06 02:55:10,007: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:55:10.008382270Z [2024-04-06 02:55:10,008: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:55:10.008783019Z [2024-04-06 02:55:10,008: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:10.099876706Z [2024-04-06 02:55:10,099: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:55:10.791830049Z [2024-04-06 02:55:10,790: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8bad8fc-4e0c-4eef-94bf-5c18210c2ddc] succeeded in 2.3239963260002696s: None 2024-04-06T02:55:11.123710464Z [2024-04-06 02:55:11,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b157bc4-8b4f-464a-9e81-ef44ce95b29d] received 2024-04-06T02:55:11.130138374Z [2024-04-06 02:55:11,129: INFO/ForkPoolWorker-15] [8b157bc4-8b4f-464a-9e81-ef44ce95b29d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:55:11.546829441Z [2024-04-06 02:55:11,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:12.773462109Z [2024-04-06 02:55:12,772: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:55:12.776755349Z [2024-04-06 02:55:12,776: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:12.806537534Z [2024-04-06 02:55:12,806: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:55:12.808113518Z [2024-04-06 02:55:12,807: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:12.808423566Z [2024-04-06 02:55:12,808: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:12.810359394Z [2024-04-06 02:55:12,808: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:12.810778067Z [2024-04-06 02:55:12,810: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:55:12.811382267Z [2024-04-06 02:55:12,810: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:55:12.811628964Z [2024-04-06 02:55:12,811: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:12.942083022Z [2024-04-06 02:55:12,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:55:13.633981578Z [2024-04-06 02:55:13,633: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[447b789b-fd39-4836-9e5d-ad019449e7f0] received 2024-04-06T02:55:13.634993880Z [2024-04-06 02:55:13,633: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b157bc4-8b4f-464a-9e81-ef44ce95b29d] succeeded in 2.507479479999347s: None 2024-04-06T02:55:13.641094820Z [2024-04-06 02:55:13,640: INFO/ForkPoolWorker-16] [447b789b-fd39-4836-9e5d-ad019449e7f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:13.985111478Z [2024-04-06 02:55:13,982: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:15.356336592Z [2024-04-06 02:55:15,356: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:55:15.359915222Z [2024-04-06 02:55:15,359: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:15.388680634Z [2024-04-06 02:55:15,388: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:55:15.389773816Z [2024-04-06 02:55:15,389: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:15.389969474Z [2024-04-06 02:55:15,389: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:15.390215667Z [2024-04-06 02:55:15,390: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:15.390394327Z [2024-04-06 02:55:15,390: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:55:15.390648837Z [2024-04-06 02:55:15,390: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:55:15.390720909Z [2024-04-06 02:55:15,390: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:15.465908747Z [2024-04-06 02:55:15,465: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:55:16.108880058Z [2024-04-06 02:55:16,108: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[447b789b-fd39-4836-9e5d-ad019449e7f0] succeeded in 2.472865529000046s: None 2024-04-06T02:55:17.452269287Z [2024-04-06 02:55:17,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0759fee8-f69b-497d-b0af-1b105f92565e] received 2024-04-06T02:55:17.454267183Z [2024-04-06 02:55:17,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[645f821b-79a2-4591-b20f-5a3f34aa65fd] received 2024-04-06T02:55:17.461202568Z [2024-04-06 02:55:17,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c810752-28b5-4eb4-9326-6130ec8a0d03] received 2024-04-06T02:55:17.463624922Z [2024-04-06 02:55:17,463: INFO/ForkPoolWorker-16] [645f821b-79a2-4591-b20f-5a3f34aa65fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:55:17.469287422Z [2024-04-06 02:55:17,468: INFO/ForkPoolWorker-1] [5c810752-28b5-4eb4-9326-6130ec8a0d03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:55:17.474283902Z [2024-04-06 02:55:17,474: INFO/ForkPoolWorker-15] [0759fee8-f69b-497d-b0af-1b105f92565e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:17.749898805Z [2024-04-06 02:55:17,746: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:55:17.754624616Z [2024-04-06 02:55:17,751: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:17.854885897Z [2024-04-06 02:55:17,841: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:55:19.379678193Z [2024-04-06 02:55:19,379: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:55:19.382807375Z [2024-04-06 02:55:19,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:19.411623349Z [2024-04-06 02:55:19,411: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:55:19.412972717Z [2024-04-06 02:55:19,412: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:19.413128976Z [2024-04-06 02:55:19,412: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:19.413332781Z [2024-04-06 02:55:19,413: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:19.413525256Z [2024-04-06 02:55:19,413: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:55:19.413873063Z [2024-04-06 02:55:19,413: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:55:19.414447316Z [2024-04-06 02:55:19,414: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:19.421335192Z [2024-04-06 02:55:19,421: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:19.422202957Z [2024-04-06 02:55:19,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:55:19.423196365Z [2024-04-06 02:55:19,423: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:55:19.425807090Z [2024-04-06 02:55:19,425: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:19.441019410Z [2024-04-06 02:55:19,440: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:55:19.442222488Z [2024-04-06 02:55:19,441: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:19.442410817Z [2024-04-06 02:55:19,442: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:19.442621282Z [2024-04-06 02:55:19,442: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:19.442765883Z [2024-04-06 02:55:19,442: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:55:19.443048002Z [2024-04-06 02:55:19,442: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:55:19.443538848Z [2024-04-06 02:55:19,443: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:19.447021552Z [2024-04-06 02:55:19,446: ERROR/ForkPoolWorker-15] [0759fee8-f69b-497d-b0af-1b105f92565e] Failed to execute task Dag 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse.. 2024-04-06T02:55:19.447033076Z Traceback (most recent call last): 2024-04-06T02:55:19.447036959Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T02:55:19.447044057Z args.func(args) 2024-04-06T02:55:19.447047684Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T02:55:19.447051010Z return func(*args, **kwargs) 2024-04-06T02:55:19.447053849Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T02:55:19.447056624Z return f(*args, **kwargs) 2024-04-06T02:55:19.447092883Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T02:55:19.447096549Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T02:55:19.447099967Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T02:55:19.447102831Z raise AirflowException( 2024-04-06T02:55:19.447106580Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse. 2024-04-06T02:55:19.475097941Z [2024-04-06 02:55:19,474: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0759fee8-f69b-497d-b0af-1b105f92565e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0759fee8-f69b-497d-b0af-1b105f92565e') 2024-04-06T02:55:19.475114380Z Traceback (most recent call last): 2024-04-06T02:55:19.475118194Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T02:55:19.475158003Z R = retval = fun(*args, **kwargs) 2024-04-06T02:55:19.475161464Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T02:55:19.475164586Z return self.run(*args, **kwargs) 2024-04-06T02:55:19.475168077Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T02:55:19.475171366Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T02:55:19.475174107Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T02:55:19.475177724Z raise AirflowException(msg) 2024-04-06T02:55:19.475180890Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0759fee8-f69b-497d-b0af-1b105f92565e 2024-04-06T02:55:19.526386136Z [2024-04-06 02:55:19,525: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:55:19.530362273Z [2024-04-06 02:55:19,529: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:19.563724343Z [2024-04-06 02:55:19,563: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:55:19.566592124Z [2024-04-06 02:55:19,566: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:19.566626498Z [2024-04-06 02:55:19,566: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:19.566955368Z [2024-04-06 02:55:19,566: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:19.566967795Z [2024-04-06 02:55:19,566: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:55:19.567257806Z [2024-04-06 02:55:19,567: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:55:19.567282661Z [2024-04-06 02:55:19,567: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:19.574147624Z [2024-04-06 02:55:19,573: WARNING/ForkPoolWorker-1] Dag 'vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:55:19.575031025Z [2024-04-06 02:55:19,574: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:55:19.575924831Z [2024-04-06 02:55:19,575: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:55:19.578926583Z [2024-04-06 02:55:19,578: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:19.601897743Z [2024-04-06 02:55:19,601: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:55:19.603297464Z [2024-04-06 02:55:19,603: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:19.603497537Z [2024-04-06 02:55:19,603: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:19.603871173Z [2024-04-06 02:55:19,603: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:19.604058116Z [2024-04-06 02:55:19,603: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:55:19.604373714Z [2024-04-06 02:55:19,604: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:55:19.604533748Z [2024-04-06 02:55:19,604: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:19.611817444Z [2024-04-06 02:55:19,610: ERROR/ForkPoolWorker-1] [5c810752-28b5-4eb4-9326-6130ec8a0d03] Failed to execute task Dag 'vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse.. 2024-04-06T02:55:19.611831057Z Traceback (most recent call last): 2024-04-06T02:55:19.611846354Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T02:55:19.611851451Z args.func(args) 2024-04-06T02:55:19.611856855Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T02:55:19.611861857Z return func(*args, **kwargs) 2024-04-06T02:55:19.611866630Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T02:55:19.611871299Z return f(*args, **kwargs) 2024-04-06T02:55:19.611875710Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T02:55:19.611880625Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T02:55:19.611885060Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T02:55:19.611889516Z raise AirflowException( 2024-04-06T02:55:19.611894603Z airflow.exceptions.AirflowException: Dag 'vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse. 2024-04-06T02:55:19.639149407Z [2024-04-06 02:55:19,635: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:55:19.640015837Z [2024-04-06 02:55:19,639: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:19.656193137Z [2024-04-06 02:55:19,655: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5c810752-28b5-4eb4-9326-6130ec8a0d03] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5c810752-28b5-4eb4-9326-6130ec8a0d03') 2024-04-06T02:55:19.656230837Z Traceback (most recent call last): 2024-04-06T02:55:19.656237377Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T02:55:19.656241977Z R = retval = fun(*args, **kwargs) 2024-04-06T02:55:19.656262798Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T02:55:19.656267359Z return self.run(*args, **kwargs) 2024-04-06T02:55:19.656272552Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T02:55:19.656277547Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T02:55:19.656281923Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T02:55:19.656286746Z raise AirflowException(msg) 2024-04-06T02:55:19.656291890Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5c810752-28b5-4eb4-9326-6130ec8a0d03 2024-04-06T02:55:19.678087542Z [2024-04-06 02:55:19,677: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:55:19.679119376Z [2024-04-06 02:55:19,678: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:19.679475664Z [2024-04-06 02:55:19,679: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:19.679583065Z [2024-04-06 02:55:19,679: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:19.679648334Z [2024-04-06 02:55:19,679: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:55:19.680103117Z [2024-04-06 02:55:19,679: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:55:19.680125130Z [2024-04-06 02:55:19,680: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:19.686955481Z [2024-04-06 02:55:19,686: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:55:19.687840918Z [2024-04-06 02:55:19,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:55:19.688608158Z [2024-04-06 02:55:19,688: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:55:19.691583232Z [2024-04-06 02:55:19,691: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:55:19.711461048Z [2024-04-06 02:55:19,711: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:55:19.713591622Z [2024-04-06 02:55:19,713: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:55:19.713656666Z [2024-04-06 02:55:19,713: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:55:19.713791480Z [2024-04-06 02:55:19,713: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:55:19.713881692Z [2024-04-06 02:55:19,713: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:55:19.714090639Z [2024-04-06 02:55:19,713: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:55:19.714129046Z [2024-04-06 02:55:19,714: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:55:19.719232701Z [2024-04-06 02:55:19,718: ERROR/ForkPoolWorker-16] [645f821b-79a2-4591-b20f-5a3f34aa65fd] Failed to execute task Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse.. 2024-04-06T02:55:19.719249977Z Traceback (most recent call last): 2024-04-06T02:55:19.719284223Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T02:55:19.719291374Z args.func(args) 2024-04-06T02:55:19.719296391Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T02:55:19.719301646Z return func(*args, **kwargs) 2024-04-06T02:55:19.719306047Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T02:55:19.719310554Z return f(*args, **kwargs) 2024-04-06T02:55:19.719315082Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T02:55:19.719319596Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T02:55:19.719323944Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T02:55:19.719328451Z raise AirflowException( 2024-04-06T02:55:19.719356847Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse. 2024-04-06T02:55:19.748728739Z [2024-04-06 02:55:19,748: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[645f821b-79a2-4591-b20f-5a3f34aa65fd] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 645f821b-79a2-4591-b20f-5a3f34aa65fd') 2024-04-06T02:55:19.748760138Z Traceback (most recent call last): 2024-04-06T02:55:19.748770386Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T02:55:19.748779030Z R = retval = fun(*args, **kwargs) 2024-04-06T02:55:19.748787940Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T02:55:19.748796828Z return self.run(*args, **kwargs) 2024-04-06T02:55:19.748806190Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T02:55:19.748815397Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T02:55:19.748824135Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T02:55:19.748833496Z raise AirflowException(msg) 2024-04-06T02:55:19.748842837Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 645f821b-79a2-4591-b20f-5a3f34aa65fd 2024-04-06T02:56:00.739303034Z [2024-04-06 02:56:00,738: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d3980a2-89c1-4518-b87f-85e76f2359f5] received 2024-04-06T02:56:00.749888362Z [2024-04-06 02:56:00,749: INFO/ForkPoolWorker-15] [4d3980a2-89c1-4518-b87f-85e76f2359f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:56:00.765885837Z [2024-04-06 02:56:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c01d63a1-87ab-4367-bb5c-d7644b37a818] received 2024-04-06T02:56:00.765907167Z [2024-04-06 02:56:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cf00169-68de-4e1e-9bbd-c6b229b8b38a] received 2024-04-06T02:56:00.781907928Z [2024-04-06 02:56:00,771: INFO/ForkPoolWorker-1] [7cf00169-68de-4e1e-9bbd-c6b229b8b38a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:56:00.781933703Z [2024-04-06 02:56:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01cf6bd8-4200-4c02-bcba-17b5918fc8e9] received 2024-04-06T02:56:00.788718435Z [2024-04-06 02:56:00,786: INFO/ForkPoolWorker-2] [01cf6bd8-4200-4c02-bcba-17b5918fc8e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:56:00.791084638Z [2024-04-06 02:56:00,790: INFO/ForkPoolWorker-16] [c01d63a1-87ab-4367-bb5c-d7644b37a818] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:56:01.396405413Z [2024-04-06 02:56:01,392: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:56:01.524350965Z [2024-04-06 02:56:01,520: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:56:01.657410258Z [2024-04-06 02:56:01,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:56:01.721872348Z [2024-04-06 02:56:01,716: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:56:02.417228258Z [2024-04-06 02:56:02,416: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:56:03.886740393Z [2024-04-06 02:56:03,886: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d3980a2-89c1-4518-b87f-85e76f2359f5] succeeded in 3.1444787700002053s: None 2024-04-06T02:56:04.124554262Z [2024-04-06 02:56:04,124: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:56:04.127869483Z [2024-04-06 02:56:04,127: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:56:04.189580084Z [2024-04-06 02:56:04,189: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:56:04.195721296Z [2024-04-06 02:56:04,195: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:56:04.195739206Z [2024-04-06 02:56:04,195: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:56:04.196443381Z [2024-04-06 02:56:04,196: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:56:04.196719350Z [2024-04-06 02:56:04,196: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:56:04.197679257Z [2024-04-06 02:56:04,197: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:56:04.197942515Z [2024-04-06 02:56:04,197: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:56:04.309891347Z [2024-04-06 02:56:04,306: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:56:04.605763013Z [2024-04-06 02:56:04,605: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:56:04.608661558Z [2024-04-06 02:56:04,608: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:56:04.657434936Z [2024-04-06 02:56:04,657: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:56:04.658450014Z [2024-04-06 02:56:04,658: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:56:04.658460884Z [2024-04-06 02:56:04,658: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:56:04.658579556Z [2024-04-06 02:56:04,658: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:56:04.658585457Z [2024-04-06 02:56:04,658: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:56:04.658894435Z [2024-04-06 02:56:04,658: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:56:04.658902176Z [2024-04-06 02:56:04,658: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:56:04.769365300Z [2024-04-06 02:56:04,768: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:56:04.776881553Z [2024-04-06 02:56:04,776: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:56:04.827400328Z [2024-04-06 02:56:04,827: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:56:04.828663856Z [2024-04-06 02:56:04,828: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:56:04.828837943Z [2024-04-06 02:56:04,828: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:56:04.829024753Z [2024-04-06 02:56:04,828: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:56:04.829096659Z [2024-04-06 02:56:04,829: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:56:04.833508562Z [2024-04-06 02:56:04,833: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:56:04.834014602Z [2024-04-06 02:56:04,833: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:56:04.846031488Z [2024-04-06 02:56:04,845: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:56:04.846913692Z [2024-04-06 02:56:04,846: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:56:04.847840862Z [2024-04-06 02:56:04,847: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:56:04.852574680Z [2024-04-06 02:56:04,852: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:56:04.924437129Z [2024-04-06 02:56:04,924: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:56:04.925577293Z [2024-04-06 02:56:04,925: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:56:04.925719741Z [2024-04-06 02:56:04,925: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:56:04.925960826Z [2024-04-06 02:56:04,925: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:56:04.926132397Z [2024-04-06 02:56:04,925: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:56:04.926328368Z [2024-04-06 02:56:04,926: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:56:04.926468815Z [2024-04-06 02:56:04,926: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:56:04.930887801Z [2024-04-06 02:56:04,929: ERROR/ForkPoolWorker-16] [c01d63a1-87ab-4367-bb5c-d7644b37a818] Failed to execute task Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse.. 2024-04-06T02:56:04.930901390Z Traceback (most recent call last): 2024-04-06T02:56:04.930912588Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T02:56:04.930916466Z args.func(args) 2024-04-06T02:56:04.930931889Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T02:56:04.930935371Z return func(*args, **kwargs) 2024-04-06T02:56:04.930938129Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T02:56:04.930941235Z return f(*args, **kwargs) 2024-04-06T02:56:04.930944178Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T02:56:04.930947130Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T02:56:04.930949878Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T02:56:04.930952629Z raise AirflowException( 2024-04-06T02:56:04.930962118Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse. 2024-04-06T02:56:04.968595866Z [2024-04-06 02:56:04,968: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:56:04.978058579Z [2024-04-06 02:56:04,977: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c01d63a1-87ab-4367-bb5c-d7644b37a818] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c01d63a1-87ab-4367-bb5c-d7644b37a818') 2024-04-06T02:56:04.978072499Z Traceback (most recent call last): 2024-04-06T02:56:04.978086188Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T02:56:04.978089074Z R = retval = fun(*args, **kwargs) 2024-04-06T02:56:04.978091956Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T02:56:04.978094602Z return self.run(*args, **kwargs) 2024-04-06T02:56:04.978097799Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T02:56:04.978101045Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T02:56:04.978103745Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T02:56:04.978106953Z raise AirflowException(msg) 2024-04-06T02:56:04.978110259Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c01d63a1-87ab-4367-bb5c-d7644b37a818 2024-04-06T02:56:06.475554425Z [2024-04-06 02:56:06,475: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[01cf6bd8-4200-4c02-bcba-17b5918fc8e9] succeeded in 5.6957261409997955s: None 2024-04-06T02:56:06.567048825Z [2024-04-06 02:56:06,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7cf00169-68de-4e1e-9bbd-c6b229b8b38a] succeeded in 5.803883034000137s: None 2024-04-06T02:56:17.054840471Z [2024-04-06 02:56:17,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1889e1a5-e296-4e4c-b69c-ab92b1de3b05] received 2024-04-06T02:56:17.069215315Z [2024-04-06 02:56:17,068: INFO/ForkPoolWorker-15] [1889e1a5-e296-4e4c-b69c-ab92b1de3b05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:56:17.344305569Z [2024-04-06 02:56:17,340: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:56:18.399841101Z [2024-04-06 02:56:18,399: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:56:18.402772111Z [2024-04-06 02:56:18,402: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:56:18.438310762Z [2024-04-06 02:56:18,431: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:56:18.438331357Z [2024-04-06 02:56:18,432: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:56:18.438337806Z [2024-04-06 02:56:18,432: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:56:18.438343370Z [2024-04-06 02:56:18,432: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:56:18.438349186Z [2024-04-06 02:56:18,432: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:56:18.438353448Z [2024-04-06 02:56:18,432: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:56:18.438357517Z [2024-04-06 02:56:18,432: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:56:18.438657696Z [2024-04-06 02:56:18,438: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:56:18.439422607Z [2024-04-06 02:56:18,438: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:56:18.441654824Z [2024-04-06 02:56:18,440: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:56:18.444002663Z [2024-04-06 02:56:18,442: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:56:18.457019003Z [2024-04-06 02:56:18,456: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:56:18.458452211Z [2024-04-06 02:56:18,458: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:56:18.458553259Z [2024-04-06 02:56:18,458: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:56:18.458688422Z [2024-04-06 02:56:18,458: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:56:18.459017298Z [2024-04-06 02:56:18,458: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:56:18.459021184Z [2024-04-06 02:56:18,458: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:56:18.459025283Z [2024-04-06 02:56:18,458: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:56:18.462048808Z [2024-04-06 02:56:18,461: ERROR/ForkPoolWorker-15] [1889e1a5-e296-4e4c-b69c-ab92b1de3b05] Failed to execute task Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse.. 2024-04-06T02:56:18.462059817Z Traceback (most recent call last): 2024-04-06T02:56:18.462063207Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T02:56:18.462066918Z args.func(args) 2024-04-06T02:56:18.462086872Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T02:56:18.462091279Z return func(*args, **kwargs) 2024-04-06T02:56:18.462094458Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T02:56:18.462097615Z return f(*args, **kwargs) 2024-04-06T02:56:18.462100523Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T02:56:18.462103710Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T02:56:18.462112974Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T02:56:18.462116213Z raise AirflowException( 2024-04-06T02:56:18.462120899Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a' could not be found; either it does not exist or it failed to parse. 2024-04-06T02:56:18.493454001Z [2024-04-06 02:56:18,492: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1889e1a5-e296-4e4c-b69c-ab92b1de3b05] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1889e1a5-e296-4e4c-b69c-ab92b1de3b05') 2024-04-06T02:56:18.493468695Z Traceback (most recent call last): 2024-04-06T02:56:18.493483386Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T02:56:18.493486336Z R = retval = fun(*args, **kwargs) 2024-04-06T02:56:18.493489213Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T02:56:18.493498116Z return self.run(*args, **kwargs) 2024-04-06T02:56:18.493501466Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T02:56:18.493505689Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T02:56:18.493508644Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T02:56:18.493512421Z raise AirflowException(msg) 2024-04-06T02:56:18.493515701Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1889e1a5-e296-4e4c-b69c-ab92b1de3b05 2024-04-06T02:56:54.639330122Z [2024-04-06 02:56:54,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc90366b-31b2-430e-895a-0c54b4783176] received 2024-04-06T02:56:54.647722806Z [2024-04-06 02:56:54,647: INFO/ForkPoolWorker-15] [bc90366b-31b2-430e-895a-0c54b4783176] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240406025653_157521', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-06T02:56:54.966312114Z [2024-04-06 02:56:54,961: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-06T02:56:55.340204495Z [2024-04-06 02:56:55,339: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:56:55.976853567Z [2024-04-06 02:56:55,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc90366b-31b2-430e-895a-0c54b4783176] succeeded in 1.335169654999845s: None 2024-04-06T02:57:01.020164008Z [2024-04-06 02:57:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da999717-9caf-4978-846c-7cd1f6a1a369] received 2024-04-06T02:57:01.032934754Z [2024-04-06 02:57:01,031: INFO/ForkPoolWorker-15] [da999717-9caf-4978-846c-7cd1f6a1a369] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:57:01.063373438Z [2024-04-06 02:57:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ca70705-d09c-4cfe-b474-973f3b9b3cdb] received 2024-04-06T02:57:01.084861705Z [2024-04-06 02:57:01,084: INFO/ForkPoolWorker-16] [1ca70705-d09c-4cfe-b474-973f3b9b3cdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:57:01.493491616Z [2024-04-06 02:57:01,490: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:57:01.513744636Z [2024-04-06 02:57:01,510: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:57:03.060518781Z [2024-04-06 02:57:03,060: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:57:03.067024681Z [2024-04-06 02:57:03,066: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:57:03.123979766Z [2024-04-06 02:57:03,123: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:57:03.129078765Z [2024-04-06 02:57:03,128: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:57:03.129308788Z [2024-04-06 02:57:03,129: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:57:03.129938490Z [2024-04-06 02:57:03,129: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:57:03.130907137Z [2024-04-06 02:57:03,130: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:57:03.131226136Z [2024-04-06 02:57:03,131: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:57:03.133937889Z [2024-04-06 02:57:03,133: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:57:03.239968720Z [2024-04-06 02:57:03,239: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:57:03.383349878Z [2024-04-06 02:57:03,382: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:57:03.389138835Z [2024-04-06 02:57:03,388: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:57:03.432485206Z [2024-04-06 02:57:03,432: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:57:03.437759248Z [2024-04-06 02:57:03,437: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:57:03.438247179Z [2024-04-06 02:57:03,438: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:57:03.438499718Z [2024-04-06 02:57:03,438: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:57:03.438652078Z [2024-04-06 02:57:03,438: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:57:03.438945279Z [2024-04-06 02:57:03,438: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:57:03.439160136Z [2024-04-06 02:57:03,439: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:57:03.566954334Z [2024-04-06 02:57:03,566: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:57:05.326755648Z [2024-04-06 02:57:05,326: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ca70705-d09c-4cfe-b474-973f3b9b3cdb] succeeded in 4.258268706000308s: None 2024-04-06T02:57:05.328904193Z [2024-04-06 02:57:05,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da999717-9caf-4978-846c-7cd1f6a1a369] succeeded in 4.306113055999958s: None 2024-04-06T02:58:00.899603178Z [2024-04-06 02:58:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da3f100b-71ba-4726-aec3-95900f1c1ce8] received 2024-04-06T02:58:00.902471274Z [2024-04-06 02:58:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c9e20b4-d1d4-47c0-8145-3de5f96fe41a] received 2024-04-06T02:58:00.911308113Z [2024-04-06 02:58:00,911: INFO/ForkPoolWorker-15] [da3f100b-71ba-4726-aec3-95900f1c1ce8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:58:00.911857133Z [2024-04-06 02:58:00,911: INFO/ForkPoolWorker-16] [0c9e20b4-d1d4-47c0-8145-3de5f96fe41a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:58:00.992546682Z [2024-04-06 02:58:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca6d0d6f-01c8-4511-8450-5381e1b073c2] received 2024-04-06T02:58:01.013725682Z [2024-04-06 02:58:01,013: INFO/ForkPoolWorker-1] [ca6d0d6f-01c8-4511-8450-5381e1b073c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:58:01.273356102Z [2024-04-06 02:58:01,269: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:58:01.346392900Z [2024-04-06 02:58:01,338: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:58:01.602773682Z [2024-04-06 02:58:01,599: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:58:01.814241255Z [2024-04-06 02:58:01,814: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:58:02.758370653Z [2024-04-06 02:58:02,758: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:58:02.762395210Z [2024-04-06 02:58:02,761: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:58:02.859035984Z [2024-04-06 02:58:02,858: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:58:02.867115392Z [2024-04-06 02:58:02,866: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:58:02.870181350Z [2024-04-06 02:58:02,869: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:58:02.873175862Z [2024-04-06 02:58:02,872: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:58:02.873332853Z [2024-04-06 02:58:02,873: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:58:02.878326346Z [2024-04-06 02:58:02,878: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:58:02.878495804Z [2024-04-06 02:58:02,878: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:58:02.993215335Z [2024-04-06 02:58:02,992: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da3f100b-71ba-4726-aec3-95900f1c1ce8] succeeded in 2.089798007999889s: None 2024-04-06T02:58:03.026928609Z [2024-04-06 02:58:03,026: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:58:03.229710997Z [2024-04-06 02:58:03,228: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:58:03.233895216Z [2024-04-06 02:58:03,233: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:58:03.307053246Z [2024-04-06 02:58:03,306: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:58:03.318670315Z [2024-04-06 02:58:03,318: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:58:03.318731876Z [2024-04-06 02:58:03,318: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:58:03.319015669Z [2024-04-06 02:58:03,318: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:58:03.319075670Z [2024-04-06 02:58:03,318: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:58:03.319390784Z [2024-04-06 02:58:03,319: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:58:03.319464981Z [2024-04-06 02:58:03,319: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:58:03.403138558Z [2024-04-06 02:58:03,402: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:58:05.358516719Z [2024-04-06 02:58:05,358: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c9e20b4-d1d4-47c0-8145-3de5f96fe41a] succeeded in 4.453158016999623s: None 2024-04-06T02:58:05.895271614Z [2024-04-06 02:58:05,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca6d0d6f-01c8-4511-8450-5381e1b073c2] succeeded in 4.899614756999654s: None 2024-04-06T02:59:00.413396590Z [2024-04-06 02:59:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1e8af75-951c-4044-a7be-528e23e8076b] received 2024-04-06T02:59:00.418319262Z [2024-04-06 02:59:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[280c3070-d79f-47c0-bb8f-1676a4d14266] received 2024-04-06T02:59:00.425195237Z [2024-04-06 02:59:00,424: INFO/ForkPoolWorker-15] [b1e8af75-951c-4044-a7be-528e23e8076b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:59:00.425323819Z [2024-04-06 02:59:00,425: INFO/ForkPoolWorker-16] [280c3070-d79f-47c0-bb8f-1676a4d14266] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:59:00.678466131Z [2024-04-06 02:59:00,675: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:59:00.686205420Z [2024-04-06 02:59:00,682: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:59:01.955428474Z [2024-04-06 02:59:01,955: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:59:01.960034875Z [2024-04-06 02:59:01,959: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:59:01.990167755Z [2024-04-06 02:59:01,989: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:59:01.991235101Z [2024-04-06 02:59:01,990: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:59:01.991370472Z [2024-04-06 02:59:01,991: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:59:01.991417491Z [2024-04-06 02:59:01,991: INFO/ForkPoolWorker-16] Read VIM 70cd6e51-eee2-4bfb-8814-8d8b37a005af (k8s07_dummy) 2024-04-06T02:59:01.991570035Z [2024-04-06 02:59:01,991: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '70cd6e51-eee2-4bfb-8814-8d8b37a005af', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T02:59:01.991639923Z [2024-04-06 02:59:01,991: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:59:01.991863047Z [2024-04-06 02:59:01,991: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:59:01.992011896Z [2024-04-06 02:59:01,991: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:59:01.997583099Z [2024-04-06 02:59:01,997: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:59:02.065890974Z [2024-04-06 02:59:02,065: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:59:02.069099377Z [2024-04-06 02:59:02,068: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:59:02.075762855Z [2024-04-06 02:59:02,075: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:59:02.122889642Z [2024-04-06 02:59:02,122: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:59:02.124416360Z [2024-04-06 02:59:02,124: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T02:59:02.124531321Z [2024-04-06 02:59:02,124: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T02:59:02.124678971Z [2024-04-06 02:59:02,124: INFO/ForkPoolWorker-15] Read VIM 70cd6e51-eee2-4bfb-8814-8d8b37a005af (k8s07_dummy) 2024-04-06T02:59:02.124913551Z [2024-04-06 02:59:02,124: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '70cd6e51-eee2-4bfb-8814-8d8b37a005af', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T02:59:02.125085234Z [2024-04-06 02:59:02,124: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:59:02.125303701Z [2024-04-06 02:59:02,125: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:59:02.125387911Z [2024-04-06 02:59:02,125: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T02:59:02.130838099Z [2024-04-06 02:59:02,130: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:59:02.281929570Z [2024-04-06 02:59:02,281: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:59:04.571404770Z [2024-04-06 02:59:04,570: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[280c3070-d79f-47c0-bb8f-1676a4d14266] succeeded in 4.151513718999922s: None 2024-04-06T02:59:06.238426620Z [2024-04-06 02:59:06,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1e8af75-951c-4044-a7be-528e23e8076b] succeeded in 5.820947029999843s: None 2024-04-06T03:00:00.679720323Z [2024-04-06 03:00:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85c055cc-fa85-485c-84bf-a947ff3bc7e0] received 2024-04-06T03:00:00.685550821Z [2024-04-06 03:00:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eeb8b56d-229a-47f1-bb34-8fe3e84db780] received 2024-04-06T03:00:00.706513203Z [2024-04-06 03:00:00,701: INFO/ForkPoolWorker-16] [eeb8b56d-229a-47f1-bb34-8fe3e84db780] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:00:00.711380550Z [2024-04-06 03:00:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a01b34a-5e4d-48de-944c-f40f893158c3] received 2024-04-06T03:00:00.712480707Z [2024-04-06 03:00:00,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8905a0f-313e-451e-bc02-68e4589f26ea] received 2024-04-06T03:00:00.729279433Z [2024-04-06 03:00:00,719: INFO/ForkPoolWorker-15] [85c055cc-fa85-485c-84bf-a947ff3bc7e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:00:00.745291078Z [2024-04-06 03:00:00,742: INFO/ForkPoolWorker-2] [d8905a0f-313e-451e-bc02-68e4589f26ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:00:00.754148179Z [2024-04-06 03:00:00,753: INFO/ForkPoolWorker-1] [4a01b34a-5e4d-48de-944c-f40f893158c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:00:01.276837796Z [2024-04-06 03:00:01,272: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:00:01.280369450Z [2024-04-06 03:00:01,276: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:00:01.345433728Z [2024-04-06 03:00:01,341: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:00:01.482227619Z [2024-04-06 03:00:01,466: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:00:01.997931376Z [2024-04-06 03:00:01,997: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:00:03.247338403Z [2024-04-06 03:00:03,246: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:00:03.256428300Z [2024-04-06 03:00:03,255: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:00:03.399281307Z [2024-04-06 03:00:03,399: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:00:03.403563378Z [2024-04-06 03:00:03,403: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:00:03.407164402Z [2024-04-06 03:00:03,403: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:00:03.408432100Z [2024-04-06 03:00:03,408: INFO/ForkPoolWorker-15] Read VIM 70cd6e51-eee2-4bfb-8814-8d8b37a005af (k8s07_dummy) 2024-04-06T03:00:03.408631510Z [2024-04-06 03:00:03,408: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '70cd6e51-eee2-4bfb-8814-8d8b37a005af', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T03:00:03.408802463Z [2024-04-06 03:00:03,408: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:00:03.413997907Z [2024-04-06 03:00:03,409: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:00:03.414149422Z [2024-04-06 03:00:03,413: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:00:03.429261345Z [2024-04-06 03:00:03,428: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:00:03.675573538Z [2024-04-06 03:00:03,675: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eeb8b56d-229a-47f1-bb34-8fe3e84db780] succeeded in 2.986096073000226s: None 2024-04-06T03:00:03.699849925Z [2024-04-06 03:00:03,699: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:00:03.703221766Z [2024-04-06 03:00:03,702: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:00:03.704366452Z [2024-04-06 03:00:03,704: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:00:03.770701613Z [2024-04-06 03:00:03,770: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:00:03.774833760Z [2024-04-06 03:00:03,774: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:00:03.774848239Z [2024-04-06 03:00:03,774: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:00:03.774857243Z [2024-04-06 03:00:03,774: INFO/ForkPoolWorker-1] Read VIM 70cd6e51-eee2-4bfb-8814-8d8b37a005af (k8s07_dummy) 2024-04-06T03:00:03.774994619Z [2024-04-06 03:00:03,774: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '70cd6e51-eee2-4bfb-8814-8d8b37a005af', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T03:00:03.775016781Z [2024-04-06 03:00:03,774: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:00:03.775269778Z [2024-04-06 03:00:03,775: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:00:03.775278491Z [2024-04-06 03:00:03,775: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:00:03.780233654Z [2024-04-06 03:00:03,779: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:00:03.921689160Z [2024-04-06 03:00:03,921: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:00:04.163257643Z [2024-04-06 03:00:04,162: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T03:00:04.167573858Z [2024-04-06 03:00:04,167: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:00:04.280498807Z [2024-04-06 03:00:04,280: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T03:00:04.285985441Z [2024-04-06 03:00:04,283: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:00:04.285998088Z [2024-04-06 03:00:04,284: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:00:04.286002609Z [2024-04-06 03:00:04,284: INFO/ForkPoolWorker-2] Read VIM 70cd6e51-eee2-4bfb-8814-8d8b37a005af (k8s07_dummy) 2024-04-06T03:00:04.286008036Z [2024-04-06 03:00:04,284: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '70cd6e51-eee2-4bfb-8814-8d8b37a005af', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T03:00:04.286013597Z [2024-04-06 03:00:04,284: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T03:00:04.286019238Z [2024-04-06 03:00:04,284: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:00:04.286023481Z [2024-04-06 03:00:04,284: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:00:04.299710270Z [2024-04-06 03:00:04,299: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:00:04.507103373Z [2024-04-06 03:00:04,497: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:00:04.587025609Z [2024-04-06 03:00:04,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85c055cc-fa85-485c-84bf-a947ff3bc7e0] succeeded in 3.9021726730006776s: None 2024-04-06T03:00:04.670287078Z [2024-04-06 03:00:04,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e596708-dc72-42eb-8ce0-4cfe221d3a79] received 2024-04-06T03:00:04.696835425Z [2024-04-06 03:00:04,696: INFO/ForkPoolWorker-15] [5e596708-dc72-42eb-8ce0-4cfe221d3a79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:00:05.203938092Z [2024-04-06 03:00:05,200: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:00:06.212384285Z [2024-04-06 03:00:06,211: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d8905a0f-313e-451e-bc02-68e4589f26ea] succeeded in 5.497224376999839s: None 2024-04-06T03:00:06.291242585Z [2024-04-06 03:00:06,290: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a01b34a-5e4d-48de-944c-f40f893158c3] succeeded in 5.5642359430003125s: None 2024-04-06T03:00:06.366580666Z [2024-04-06 03:00:06,366: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:00:06.369525027Z [2024-04-06 03:00:06,369: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:00:06.404094080Z [2024-04-06 03:00:06,403: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:00:06.405281983Z [2024-04-06 03:00:06,405: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:00:06.405393251Z [2024-04-06 03:00:06,405: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:00:06.405438433Z [2024-04-06 03:00:06,405: INFO/ForkPoolWorker-15] Read VIM 70cd6e51-eee2-4bfb-8814-8d8b37a005af (k8s07_dummy) 2024-04-06T03:00:06.405658300Z [2024-04-06 03:00:06,405: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '70cd6e51-eee2-4bfb-8814-8d8b37a005af', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T03:00:06.405719866Z [2024-04-06 03:00:06,405: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:00:06.406069959Z [2024-04-06 03:00:06,405: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:00:06.406160474Z [2024-04-06 03:00:06,406: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:00:06.412432143Z [2024-04-06 03:00:06,412: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:00:06.514189060Z [2024-04-06 03:00:06,513: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:00:07.201225057Z [2024-04-06 03:00:07,200: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5e596708-dc72-42eb-8ce0-4cfe221d3a79] succeeded in 2.5232216250005877s: None 2024-04-06T03:00:07.261979799Z [2024-04-06 03:00:07,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a53038d-6965-4c2f-8150-ebd16c32e566] received 2024-04-06T03:00:07.273075870Z [2024-04-06 03:00:07,272: INFO/ForkPoolWorker-15] [1a53038d-6965-4c2f-8150-ebd16c32e566] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:00:07.649308991Z [2024-04-06 03:00:07,644: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:00:08.904706427Z [2024-04-06 03:00:08,904: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:00:08.907350193Z [2024-04-06 03:00:08,906: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:00:08.942621471Z [2024-04-06 03:00:08,942: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:00:08.944535107Z [2024-04-06 03:00:08,944: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:00:08.944742425Z [2024-04-06 03:00:08,944: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:00:08.944956615Z [2024-04-06 03:00:08,944: INFO/ForkPoolWorker-15] Read VIM 70cd6e51-eee2-4bfb-8814-8d8b37a005af (k8s07_dummy) 2024-04-06T03:00:08.945265859Z [2024-04-06 03:00:08,944: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '70cd6e51-eee2-4bfb-8814-8d8b37a005af', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T03:00:08.945463784Z [2024-04-06 03:00:08,945: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:00:08.946027496Z [2024-04-06 03:00:08,945: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:00:08.946171614Z [2024-04-06 03:00:08,945: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:00:08.952468543Z [2024-04-06 03:00:08,952: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:00:09.035067075Z [2024-04-06 03:00:09,034: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:00:09.594245159Z [2024-04-06 03:00:09,593: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a53038d-6965-4c2f-8150-ebd16c32e566] succeeded in 2.328009849999944s: None 2024-04-06T03:00:09.715067709Z [2024-04-06 03:00:09,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f35eaf7-700d-4aa9-a705-c1106321df3e] received 2024-04-06T03:00:09.741641857Z [2024-04-06 03:00:09,741: INFO/ForkPoolWorker-15] [4f35eaf7-700d-4aa9-a705-c1106321df3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:00:10.054959739Z [2024-04-06 03:00:10,051: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:00:11.217033839Z [2024-04-06 03:00:11,216: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:00:11.220392035Z [2024-04-06 03:00:11,220: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:00:11.281469984Z [2024-04-06 03:00:11,281: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:00:11.283630195Z [2024-04-06 03:00:11,283: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:00:11.284081083Z [2024-04-06 03:00:11,283: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:00:11.284418177Z [2024-04-06 03:00:11,284: INFO/ForkPoolWorker-15] Read VIM 70cd6e51-eee2-4bfb-8814-8d8b37a005af (k8s07_dummy) 2024-04-06T03:00:11.285013707Z [2024-04-06 03:00:11,284: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '70cd6e51-eee2-4bfb-8814-8d8b37a005af', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T03:00:11.285316275Z [2024-04-06 03:00:11,284: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:00:11.285970572Z [2024-04-06 03:00:11,285: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:00:11.286218302Z [2024-04-06 03:00:11,286: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:00:11.297277242Z [2024-04-06 03:00:11,296: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:00:11.375606799Z [2024-04-06 03:00:11,375: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:00:11.907317863Z [2024-04-06 03:00:11,906: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f35eaf7-700d-4aa9-a705-c1106321df3e] succeeded in 2.1858749200000602s: None 2024-04-06T03:01:00.583185012Z [2024-04-06 03:01:00,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77a3896c-f95b-4bb2-9c1e-70a99aa96be9] received 2024-04-06T03:01:00.587718947Z [2024-04-06 03:01:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e4d8aa9-b7e8-4339-847f-703a8a1ceb12] received 2024-04-06T03:01:00.593227136Z [2024-04-06 03:01:00,592: INFO/ForkPoolWorker-15] [77a3896c-f95b-4bb2-9c1e-70a99aa96be9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:01:00.602141974Z [2024-04-06 03:01:00,601: INFO/ForkPoolWorker-16] [2e4d8aa9-b7e8-4339-847f-703a8a1ceb12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:01:00.916241081Z [2024-04-06 03:01:00,912: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:01:00.986395928Z [2024-04-06 03:01:00,982: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:01:02.254049438Z [2024-04-06 03:01:02,240: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:01:02.280107850Z [2024-04-06 03:01:02,279: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:01:02.344871799Z [2024-04-06 03:01:02,344: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:01:02.348357957Z [2024-04-06 03:01:02,348: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:01:02.348374323Z [2024-04-06 03:01:02,348: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:01:02.348473970Z [2024-04-06 03:01:02,348: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:01:02.348527022Z [2024-04-06 03:01:02,348: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:01:02.348758740Z [2024-04-06 03:01:02,348: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:01:02.348768342Z [2024-04-06 03:01:02,348: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:01:02.501999950Z [2024-04-06 03:01:02,501: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:01:03.013676775Z [2024-04-06 03:01:03,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:01:03.021356704Z [2024-04-06 03:01:03,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:01:03.082973499Z [2024-04-06 03:01:03,082: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:01:03.084787266Z [2024-04-06 03:01:03,084: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:01:03.085138111Z [2024-04-06 03:01:03,084: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:01:03.085435594Z [2024-04-06 03:01:03,085: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:01:03.085672182Z [2024-04-06 03:01:03,085: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:01:03.086101239Z [2024-04-06 03:01:03,085: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:01:03.086396888Z [2024-04-06 03:01:03,086: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:01:03.227670485Z [2024-04-06 03:01:03,227: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:01:04.591237153Z [2024-04-06 03:01:04,590: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e4d8aa9-b7e8-4339-847f-703a8a1ceb12] succeeded in 4.000036021999222s: None 2024-04-06T03:01:05.612469658Z [2024-04-06 03:01:05,612: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77a3896c-f95b-4bb2-9c1e-70a99aa96be9] succeeded in 5.027290987000015s: None 2024-04-06T03:02:00.361594997Z [2024-04-06 03:02:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3127751-8679-4be0-b276-71e2b022015e] received 2024-04-06T03:02:00.369513737Z [2024-04-06 03:02:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdd08952-a471-4f4d-9cae-c11107bea7ae] received 2024-04-06T03:02:00.376223773Z [2024-04-06 03:02:00,375: INFO/ForkPoolWorker-15] [d3127751-8679-4be0-b276-71e2b022015e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:02:00.378511779Z [2024-04-06 03:02:00,378: INFO/ForkPoolWorker-16] [cdd08952-a471-4f4d-9cae-c11107bea7ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:02:00.385684722Z [2024-04-06 03:02:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08f612fc-28e1-4bee-be12-145f99757b5f] received 2024-04-06T03:02:00.398041399Z [2024-04-06 03:02:00,397: INFO/ForkPoolWorker-1] [08f612fc-28e1-4bee-be12-145f99757b5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:02:00.658221409Z [2024-04-06 03:02:00,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:02:00.680664838Z [2024-04-06 03:02:00,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:02:00.761935986Z [2024-04-06 03:02:00,756: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:02:00.979742373Z [2024-04-06 03:02:00,979: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:02:01.994040376Z [2024-04-06 03:02:01,987: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cdd08952-a471-4f4d-9cae-c11107bea7ae] succeeded in 1.6166893459994753s: None 2024-04-06T03:02:02.756002479Z [2024-04-06 03:02:02,755: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:02:02.760869631Z [2024-04-06 03:02:02,760: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:02:02.777509267Z [2024-04-06 03:02:02,777: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:02:02.780807719Z [2024-04-06 03:02:02,780: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:02:02.809048217Z [2024-04-06 03:02:02,808: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:02:02.810609637Z [2024-04-06 03:02:02,810: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:02:02.811498203Z [2024-04-06 03:02:02,810: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:02:02.811840043Z [2024-04-06 03:02:02,811: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:02:02.812312828Z [2024-04-06 03:02:02,811: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:02:02.812732552Z [2024-04-06 03:02:02,812: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:02:02.812968545Z [2024-04-06 03:02:02,812: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:02:02.817168998Z [2024-04-06 03:02:02,816: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:02:02.830960042Z [2024-04-06 03:02:02,830: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:02:02.831149397Z [2024-04-06 03:02:02,830: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:02:02.831368894Z [2024-04-06 03:02:02,831: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:02:02.831524452Z [2024-04-06 03:02:02,831: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:02:02.832110806Z [2024-04-06 03:02:02,831: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:02:02.832218044Z [2024-04-06 03:02:02,832: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:02:02.914496161Z [2024-04-06 03:02:02,914: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:02:02.924265597Z [2024-04-06 03:02:02,924: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:02:04.767407269Z [2024-04-06 03:02:04,766: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08f612fc-28e1-4bee-be12-145f99757b5f] succeeded in 4.378267445999882s: None 2024-04-06T03:02:04.915137968Z [2024-04-06 03:02:04,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3127751-8679-4be0-b276-71e2b022015e] succeeded in 4.550024987000143s: None 2024-04-06T03:03:00.822740974Z [2024-04-06 03:03:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[188c1ac9-4713-46e6-bf23-924726cf919a] received 2024-04-06T03:03:00.826571590Z [2024-04-06 03:03:00,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7a7542e-e8b7-4026-a780-05bf5f5add29] received 2024-04-06T03:03:00.838464810Z [2024-04-06 03:03:00,838: INFO/ForkPoolWorker-15] [188c1ac9-4713-46e6-bf23-924726cf919a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:03:00.851309969Z [2024-04-06 03:03:00,850: INFO/ForkPoolWorker-16] [d7a7542e-e8b7-4026-a780-05bf5f5add29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:03:01.225349495Z [2024-04-06 03:03:01,221: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:03:01.230048388Z [2024-04-06 03:03:01,225: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:03:03.486074448Z [2024-04-06 03:03:03,485: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:03:03.489763692Z [2024-04-06 03:03:03,489: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:03:03.548985155Z [2024-04-06 03:03:03,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:03:03.550289845Z [2024-04-06 03:03:03,550: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:03:03.550438131Z [2024-04-06 03:03:03,550: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:03:03.550570644Z [2024-04-06 03:03:03,550: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:03:03.550610820Z [2024-04-06 03:03:03,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:03:03.550847471Z [2024-04-06 03:03:03,550: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:03:03.550899881Z [2024-04-06 03:03:03,550: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:03:03.709207190Z [2024-04-06 03:03:03,708: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:03:04.390914089Z [2024-04-06 03:03:04,390: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:03:04.396283021Z [2024-04-06 03:03:04,395: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:03:04.458730476Z [2024-04-06 03:03:04,458: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:03:04.464930395Z [2024-04-06 03:03:04,464: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:03:04.465213557Z [2024-04-06 03:03:04,464: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:03:04.465504303Z [2024-04-06 03:03:04,465: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:03:04.465640649Z [2024-04-06 03:03:04,465: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:03:04.466178282Z [2024-04-06 03:03:04,465: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:03:04.466442298Z [2024-04-06 03:03:04,466: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:03:04.689289161Z [2024-04-06 03:03:04,689: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:03:06.574340885Z [2024-04-06 03:03:06,573: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d7a7542e-e8b7-4026-a780-05bf5f5add29] succeeded in 5.744686436999473s: None 2024-04-06T03:03:06.806581198Z [2024-04-06 03:03:06,806: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[188c1ac9-4713-46e6-bf23-924726cf919a] succeeded in 5.979212473000189s: None 2024-04-06T03:04:00.865620849Z [2024-04-06 03:04:00,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84eae578-6f15-443e-85db-7bfba9f3f285] received 2024-04-06T03:04:00.877393896Z [2024-04-06 03:04:00,877: INFO/ForkPoolWorker-15] [84eae578-6f15-443e-85db-7bfba9f3f285] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:04:00.887571785Z [2024-04-06 03:04:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9243c29-9c8c-4a2d-8eb3-cea0c764c8b9] received 2024-04-06T03:04:00.891496133Z [2024-04-06 03:04:00,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64396135-65d0-4a8f-98e7-27f914a065fb] received 2024-04-06T03:04:00.899122422Z [2024-04-06 03:04:00,898: INFO/ForkPoolWorker-16] [f9243c29-9c8c-4a2d-8eb3-cea0c764c8b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:04:00.903732254Z [2024-04-06 03:04:00,903: INFO/ForkPoolWorker-1] [64396135-65d0-4a8f-98e7-27f914a065fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:04:01.439786116Z [2024-04-06 03:04:01,424: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:04:01.453364239Z [2024-04-06 03:04:01,449: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:04:01.495446758Z [2024-04-06 03:04:01,487: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:04:01.890339398Z [2024-04-06 03:04:01,890: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:04:02.639011338Z [2024-04-06 03:04:02,638: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84eae578-6f15-443e-85db-7bfba9f3f285] succeeded in 1.7716558570000416s: None 2024-04-06T03:04:04.072027713Z [2024-04-06 03:04:04,064: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:04:04.100227023Z [2024-04-06 03:04:04,099: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:04:04.105269002Z [2024-04-06 03:04:04,103: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:04:04.106044211Z [2024-04-06 03:04:04,101: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:04:04.186268908Z [2024-04-06 03:04:04,185: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:04:04.188795872Z [2024-04-06 03:04:04,188: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:04:04.189184814Z [2024-04-06 03:04:04,188: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:04:04.189518912Z [2024-04-06 03:04:04,189: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:04:04.190803800Z [2024-04-06 03:04:04,189: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:04:04.191170978Z [2024-04-06 03:04:04,190: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:04:04.191770065Z [2024-04-06 03:04:04,191: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:04:04.213890652Z [2024-04-06 03:04:04,213: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:04:04.217888691Z [2024-04-06 03:04:04,217: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:04:04.218112456Z [2024-04-06 03:04:04,217: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:04:04.218915312Z [2024-04-06 03:04:04,218: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:04:04.220127119Z [2024-04-06 03:04:04,219: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:04:04.220747501Z [2024-04-06 03:04:04,220: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:04:04.221610228Z [2024-04-06 03:04:04,221: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:04:04.356686136Z [2024-04-06 03:04:04,356: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:04:04.376119717Z [2024-04-06 03:04:04,375: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:04:06.607261912Z [2024-04-06 03:04:06,605: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[64396135-65d0-4a8f-98e7-27f914a065fb] succeeded in 5.712505769000018s: None 2024-04-06T03:04:06.948113887Z [2024-04-06 03:04:06,947: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f9243c29-9c8c-4a2d-8eb3-cea0c764c8b9] succeeded in 6.056063252000058s: None 2024-04-06T03:05:00.948962390Z [2024-04-06 03:05:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75ea33cf-8113-4a5a-ac95-cc164e9b1475] received 2024-04-06T03:05:00.964309048Z [2024-04-06 03:05:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6da035e4-b3fc-4755-ae42-ab23e107c8a9] received 2024-04-06T03:05:00.969795736Z [2024-04-06 03:05:00,969: INFO/ForkPoolWorker-15] [75ea33cf-8113-4a5a-ac95-cc164e9b1475] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:05:00.976316855Z [2024-04-06 03:05:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4d5b3f2-4763-472b-a671-568e61532eb6] received 2024-04-06T03:05:00.985925507Z [2024-04-06 03:05:00,985: INFO/ForkPoolWorker-16] [6da035e4-b3fc-4755-ae42-ab23e107c8a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:05:01.030161444Z [2024-04-06 03:05:01,029: INFO/ForkPoolWorker-1] [f4d5b3f2-4763-472b-a671-568e61532eb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:05:01.358501739Z [2024-04-06 03:05:01,354: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:05:01.528866011Z [2024-04-06 03:05:01,525: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:05:01.609093616Z [2024-04-06 03:05:01,605: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:05:03.724348722Z [2024-04-06 03:05:03,723: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:05:03.731096592Z [2024-04-06 03:05:03,729: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:05:03.852830159Z [2024-04-06 03:05:03,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:05:03.855392343Z [2024-04-06 03:05:03,855: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:05:03.855413792Z [2024-04-06 03:05:03,855: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:05:03.855489129Z [2024-04-06 03:05:03,855: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:05:03.856358183Z [2024-04-06 03:05:03,855: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:05:03.856612111Z [2024-04-06 03:05:03,856: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:05:03.856717198Z [2024-04-06 03:05:03,856: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:05:03.877995877Z [2024-04-06 03:05:03,877: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:05:03.883062420Z [2024-04-06 03:05:03,882: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:05:03.948581250Z [2024-04-06 03:05:03,948: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:05:03.962840090Z [2024-04-06 03:05:03,962: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:05:03.970157641Z [2024-04-06 03:05:03,962: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:05:03.970303879Z [2024-04-06 03:05:03,970: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:05:03.970333138Z [2024-04-06 03:05:03,970: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:05:03.970612866Z [2024-04-06 03:05:03,970: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:05:03.970625821Z [2024-04-06 03:05:03,970: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:05:03.980133073Z [2024-04-06 03:05:03,979: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:05:04.101191003Z [2024-04-06 03:05:04,100: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:05:04.679530953Z [2024-04-06 03:05:04,679: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:05:04.700982312Z [2024-04-06 03:05:04,700: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:05:04.794974734Z [2024-04-06 03:05:04,794: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:05:04.803529126Z [2024-04-06 03:05:04,801: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:05:04.805285686Z [2024-04-06 03:05:04,805: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:05:04.806681913Z [2024-04-06 03:05:04,805: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:05:04.806864886Z [2024-04-06 03:05:04,806: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:05:04.810243349Z [2024-04-06 03:05:04,810: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:05:04.816527682Z [2024-04-06 03:05:04,810: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:05:05.110661640Z [2024-04-06 03:05:05,110: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75ea33cf-8113-4a5a-ac95-cc164e9b1475] succeeded in 4.15852263800025s: None 2024-04-06T03:05:05.142278303Z [2024-04-06 03:05:05,135: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:05:05.167925178Z [2024-04-06 03:05:05,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37cbeb9a-609a-49dd-b17d-4ad34a6c2c71] received 2024-04-06T03:05:05.185849742Z [2024-04-06 03:05:05,185: INFO/ForkPoolWorker-15] [37cbeb9a-609a-49dd-b17d-4ad34a6c2c71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:05:05.871814786Z [2024-04-06 03:05:05,867: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:05:07.047747590Z [2024-04-06 03:05:07,047: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6da035e4-b3fc-4755-ae42-ab23e107c8a9] succeeded in 6.078803035999954s: None 2024-04-06T03:05:07.068504755Z [2024-04-06 03:05:07,068: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f4d5b3f2-4763-472b-a671-568e61532eb6] succeeded in 6.087806435999482s: None 2024-04-06T03:05:07.181104365Z [2024-04-06 03:05:07,180: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:05:07.184234939Z [2024-04-06 03:05:07,183: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:05:07.218017600Z [2024-04-06 03:05:07,217: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:05:07.228584288Z [2024-04-06 03:05:07,228: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:05:07.228695145Z [2024-04-06 03:05:07,228: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:05:07.229152208Z [2024-04-06 03:05:07,228: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:05:07.229180918Z [2024-04-06 03:05:07,229: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:05:07.229539607Z [2024-04-06 03:05:07,229: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:05:07.229550336Z [2024-04-06 03:05:07,229: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:05:07.316460235Z [2024-04-06 03:05:07,316: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:05:07.969615270Z [2024-04-06 03:05:07,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22242e56-d352-4b06-a018-047ce28c2c90] received 2024-04-06T03:05:07.983843316Z [2024-04-06 03:05:07,983: INFO/ForkPoolWorker-16] [22242e56-d352-4b06-a018-047ce28c2c90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:05:08.047572409Z [2024-04-06 03:05:08,047: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37cbeb9a-609a-49dd-b17d-4ad34a6c2c71] succeeded in 2.8767453330001445s: None 2024-04-06T03:05:08.331267301Z [2024-04-06 03:05:08,328: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:05:09.496501054Z [2024-04-06 03:05:09,496: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:05:09.499709249Z [2024-04-06 03:05:09,499: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:05:09.554666244Z [2024-04-06 03:05:09,554: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:05:09.557189060Z [2024-04-06 03:05:09,556: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:05:09.557200679Z [2024-04-06 03:05:09,557: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:05:09.557364726Z [2024-04-06 03:05:09,557: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:05:09.557436932Z [2024-04-06 03:05:09,557: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:05:09.558457749Z [2024-04-06 03:05:09,558: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:05:09.558470804Z [2024-04-06 03:05:09,558: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:05:09.644560074Z [2024-04-06 03:05:09,644: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:05:10.152102035Z [2024-04-06 03:05:10,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[689d6ea8-3321-4178-a8c0-bffd77ef4749] received 2024-04-06T03:05:10.160197147Z [2024-04-06 03:05:10,159: INFO/ForkPoolWorker-15] [689d6ea8-3321-4178-a8c0-bffd77ef4749] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:05:10.190407470Z [2024-04-06 03:05:10,190: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22242e56-d352-4b06-a018-047ce28c2c90] succeeded in 2.2155773509994106s: None 2024-04-06T03:05:10.433689805Z [2024-04-06 03:05:10,430: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:05:11.880177755Z [2024-04-06 03:05:11,879: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:05:11.883290090Z [2024-04-06 03:05:11,882: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:05:11.926656482Z [2024-04-06 03:05:11,926: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:05:11.927575878Z [2024-04-06 03:05:11,927: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:05:11.927688281Z [2024-04-06 03:05:11,927: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:05:11.927831929Z [2024-04-06 03:05:11,927: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:05:11.927974184Z [2024-04-06 03:05:11,927: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:05:11.928248285Z [2024-04-06 03:05:11,928: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:05:11.928410210Z [2024-04-06 03:05:11,928: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:05:12.022527965Z [2024-04-06 03:05:12,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:05:12.634965989Z [2024-04-06 03:05:12,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[689d6ea8-3321-4178-a8c0-bffd77ef4749] succeeded in 2.480200832999799s: None 2024-04-06T03:06:01.032039080Z [2024-04-06 03:06:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23e0217f-e16f-4a36-bdb7-01e6436a7f85] received 2024-04-06T03:06:01.042372540Z [2024-04-06 03:06:01,042: INFO/ForkPoolWorker-15] [23e0217f-e16f-4a36-bdb7-01e6436a7f85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:06:01.049922582Z [2024-04-06 03:06:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d82f70b5-fc58-4af3-b5c7-cdce7a5a374e] received 2024-04-06T03:06:01.054381792Z [2024-04-06 03:06:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[752fdffd-1ff3-4280-9f3a-1ec2253a97bb] received 2024-04-06T03:06:01.080747024Z [2024-04-06 03:06:01,080: INFO/ForkPoolWorker-1] [752fdffd-1ff3-4280-9f3a-1ec2253a97bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:06:01.081452746Z [2024-04-06 03:06:01,081: INFO/ForkPoolWorker-16] [d82f70b5-fc58-4af3-b5c7-cdce7a5a374e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:06:01.455260657Z [2024-04-06 03:06:01,450: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:06:01.549391005Z [2024-04-06 03:06:01,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:06:01.590979922Z [2024-04-06 03:06:01,586: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:06:01.811688871Z [2024-04-06 03:06:01,811: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:06:03.088554386Z [2024-04-06 03:06:03,088: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[752fdffd-1ff3-4280-9f3a-1ec2253a97bb] succeeded in 2.020870109000498s: None 2024-04-06T03:06:03.188680216Z [2024-04-06 03:06:03,188: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:06:03.192194997Z [2024-04-06 03:06:03,191: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:06:03.230352920Z [2024-04-06 03:06:03,229: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:06:03.234404466Z [2024-04-06 03:06:03,233: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:06:03.258345536Z [2024-04-06 03:06:03,258: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:06:03.261032478Z [2024-04-06 03:06:03,260: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:06:03.261058713Z [2024-04-06 03:06:03,260: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:06:03.261423689Z [2024-04-06 03:06:03,261: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:06:03.261514955Z [2024-04-06 03:06:03,261: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:06:03.261744480Z [2024-04-06 03:06:03,261: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:06:03.261774761Z [2024-04-06 03:06:03,261: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:06:03.280346632Z [2024-04-06 03:06:03,280: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:06:03.281601442Z [2024-04-06 03:06:03,281: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:06:03.281733697Z [2024-04-06 03:06:03,281: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:06:03.281933304Z [2024-04-06 03:06:03,281: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:06:03.281992794Z [2024-04-06 03:06:03,281: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:06:03.282264000Z [2024-04-06 03:06:03,282: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:06:03.282365339Z [2024-04-06 03:06:03,282: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:06:03.355004616Z [2024-04-06 03:06:03,354: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:06:03.357231814Z [2024-04-06 03:06:03,357: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:06:05.244540248Z [2024-04-06 03:06:05,244: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23e0217f-e16f-4a36-bdb7-01e6436a7f85] succeeded in 4.209915434999857s: None 2024-04-06T03:06:05.623526382Z [2024-04-06 03:06:05,622: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d82f70b5-fc58-4af3-b5c7-cdce7a5a374e] succeeded in 4.563650017999862s: None 2024-04-06T03:07:00.872766785Z [2024-04-06 03:07:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aef509c4-dda5-48ab-a75b-f8f69fccbd6b] received 2024-04-06T03:07:00.885261091Z [2024-04-06 03:07:00,884: INFO/ForkPoolWorker-15] [aef509c4-dda5-48ab-a75b-f8f69fccbd6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:07:00.890406141Z [2024-04-06 03:07:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4ae1c68-c708-40f4-8118-43995e6a7e62] received 2024-04-06T03:07:00.903347950Z [2024-04-06 03:07:00,903: INFO/ForkPoolWorker-16] [c4ae1c68-c708-40f4-8118-43995e6a7e62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:07:01.289099322Z [2024-04-06 03:07:01,284: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:07:01.395210537Z [2024-04-06 03:07:01,391: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:07:02.825759716Z [2024-04-06 03:07:02,825: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:07:02.829870478Z [2024-04-06 03:07:02,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:07:02.835698908Z [2024-04-06 03:07:02,835: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:07:02.839485971Z [2024-04-06 03:07:02,838: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:07:02.865686249Z [2024-04-06 03:07:02,865: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:07:02.866906164Z [2024-04-06 03:07:02,866: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:07:02.867197122Z [2024-04-06 03:07:02,866: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:07:02.867510767Z [2024-04-06 03:07:02,867: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:07:02.867922408Z [2024-04-06 03:07:02,867: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:07:02.868345388Z [2024-04-06 03:07:02,868: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:07:02.868553637Z [2024-04-06 03:07:02,868: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:07:02.902221347Z [2024-04-06 03:07:02,902: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:07:02.904610056Z [2024-04-06 03:07:02,904: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:07:02.904645341Z [2024-04-06 03:07:02,904: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:07:02.904749313Z [2024-04-06 03:07:02,904: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:07:02.904781145Z [2024-04-06 03:07:02,904: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:07:02.905032254Z [2024-04-06 03:07:02,904: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:07:02.905080180Z [2024-04-06 03:07:02,905: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:07:02.969552412Z [2024-04-06 03:07:02,969: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:07:03.018812240Z [2024-04-06 03:07:03,018: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:07:05.044231206Z [2024-04-06 03:07:05,043: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aef509c4-dda5-48ab-a75b-f8f69fccbd6b] succeeded in 4.16757232100008s: None 2024-04-06T03:07:05.649646602Z [2024-04-06 03:07:05,649: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c4ae1c68-c708-40f4-8118-43995e6a7e62] succeeded in 4.754611375000422s: None 2024-04-06T03:08:00.326512601Z [2024-04-06 03:08:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adba5137-4167-4af6-a346-420b0c8f0592] received 2024-04-06T03:08:00.341244025Z [2024-04-06 03:08:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[425c5d9f-6873-4d85-b6a5-cc8a3ec6e1ea] received 2024-04-06T03:08:00.346933280Z [2024-04-06 03:08:00,346: INFO/ForkPoolWorker-15] [adba5137-4167-4af6-a346-420b0c8f0592] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:08:00.355398519Z [2024-04-06 03:08:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5685b03-7b01-4d10-8561-52389ab80701] received 2024-04-06T03:08:00.356689867Z [2024-04-06 03:08:00,356: INFO/ForkPoolWorker-16] [425c5d9f-6873-4d85-b6a5-cc8a3ec6e1ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:08:00.386137147Z [2024-04-06 03:08:00,382: INFO/ForkPoolWorker-1] [f5685b03-7b01-4d10-8561-52389ab80701] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:08:00.638850457Z [2024-04-06 03:08:00,635: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:08:00.659643745Z [2024-04-06 03:08:00,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:08:00.688704055Z [2024-04-06 03:08:00,685: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:08:00.963021778Z [2024-04-06 03:08:00,962: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:08:01.820424437Z [2024-04-06 03:08:01,820: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[425c5d9f-6873-4d85-b6a5-cc8a3ec6e1ea] succeeded in 1.4762133449994508s: None 2024-04-06T03:08:02.083587206Z [2024-04-06 03:08:02,083: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:08:02.088210204Z [2024-04-06 03:08:02,087: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:08:02.161968470Z [2024-04-06 03:08:02,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:08:02.167301827Z [2024-04-06 03:08:02,167: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:08:02.167316026Z [2024-04-06 03:08:02,167: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:08:02.167399841Z [2024-04-06 03:08:02,167: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:08:02.167409658Z [2024-04-06 03:08:02,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:08:02.167638073Z [2024-04-06 03:08:02,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:08:02.167643567Z [2024-04-06 03:08:02,167: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:08:02.355679876Z [2024-04-06 03:08:02,355: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:08:02.667903508Z [2024-04-06 03:08:02,667: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:08:02.672436490Z [2024-04-06 03:08:02,672: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:08:02.764032956Z [2024-04-06 03:08:02,763: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:08:02.772710613Z [2024-04-06 03:08:02,772: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:08:02.772729907Z [2024-04-06 03:08:02,772: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:08:02.772958348Z [2024-04-06 03:08:02,772: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:08:02.772997659Z [2024-04-06 03:08:02,772: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:08:02.773256170Z [2024-04-06 03:08:02,773: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:08:02.773283288Z [2024-04-06 03:08:02,773: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:08:02.878872327Z [2024-04-06 03:08:02,878: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:08:04.863220908Z [2024-04-06 03:08:04,862: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[adba5137-4167-4af6-a346-420b0c8f0592] succeeded in 4.530354894000084s: None 2024-04-06T03:08:04.864041757Z [2024-04-06 03:08:04,863: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f5685b03-7b01-4d10-8561-52389ab80701] succeeded in 4.5033012719995895s: None 2024-04-06T03:09:00.779971475Z [2024-04-06 03:09:00,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09a37309-b6a9-460f-8cc4-ee4ee60acfd9] received 2024-04-06T03:09:00.784481738Z [2024-04-06 03:09:00,784: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd60f16a-1d10-4b81-b4f2-6602434dcef0] received 2024-04-06T03:09:00.793229338Z [2024-04-06 03:09:00,792: INFO/ForkPoolWorker-15] [09a37309-b6a9-460f-8cc4-ee4ee60acfd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:09:00.805253617Z [2024-04-06 03:09:00,804: INFO/ForkPoolWorker-16] [fd60f16a-1d10-4b81-b4f2-6602434dcef0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:09:01.128469942Z [2024-04-06 03:09:01,125: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:09:01.133601440Z [2024-04-06 03:09:01,130: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:09:02.616018427Z [2024-04-06 03:09:02,615: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:09:02.620436118Z [2024-04-06 03:09:02,620: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:09:02.654217740Z [2024-04-06 03:09:02,654: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:09:02.656305844Z [2024-04-06 03:09:02,656: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:09:02.656322479Z [2024-04-06 03:09:02,656: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:09:02.656440560Z [2024-04-06 03:09:02,656: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:09:02.656470504Z [2024-04-06 03:09:02,656: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:09:02.656660062Z [2024-04-06 03:09:02,656: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:09:02.656714527Z [2024-04-06 03:09:02,656: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:09:02.740728166Z [2024-04-06 03:09:02,740: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:09:02.813631715Z [2024-04-06 03:09:02,813: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:09:02.817277555Z [2024-04-06 03:09:02,816: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:09:02.889423542Z [2024-04-06 03:09:02,889: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:09:02.894663180Z [2024-04-06 03:09:02,894: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:09:02.894815194Z [2024-04-06 03:09:02,894: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:09:02.895080183Z [2024-04-06 03:09:02,894: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:09:02.895234070Z [2024-04-06 03:09:02,895: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:09:02.895577816Z [2024-04-06 03:09:02,895: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:09:02.896197366Z [2024-04-06 03:09:02,896: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:09:02.994801304Z [2024-04-06 03:09:02,994: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:09:05.497372503Z [2024-04-06 03:09:05,496: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fd60f16a-1d10-4b81-b4f2-6602434dcef0] succeeded in 4.710767454999768s: None 2024-04-06T03:09:06.117186348Z [2024-04-06 03:09:06,116: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09a37309-b6a9-460f-8cc4-ee4ee60acfd9] succeeded in 5.3329723990000275s: None 2024-04-06T03:10:00.623721797Z [2024-04-06 03:10:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a99452a9-d5a1-412b-9084-c0f493b1c2d0] received 2024-04-06T03:10:00.627151477Z [2024-04-06 03:10:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1661fc88-e31c-486d-a2fa-3cd7683b2f26] received 2024-04-06T03:10:00.636058586Z [2024-04-06 03:10:00,635: INFO/ForkPoolWorker-15] [a99452a9-d5a1-412b-9084-c0f493b1c2d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:10:00.637747582Z [2024-04-06 03:10:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a5033ed-14c0-435d-b8f1-54918afb1b80] received 2024-04-06T03:10:00.640525878Z [2024-04-06 03:10:00,640: INFO/ForkPoolWorker-16] [1661fc88-e31c-486d-a2fa-3cd7683b2f26] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:10:00.641726291Z [2024-04-06 03:10:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62de4059-db6b-451c-a707-7b4e3373ce8a] received 2024-04-06T03:10:00.672606074Z [2024-04-06 03:10:00,672: INFO/ForkPoolWorker-1] [2a5033ed-14c0-435d-b8f1-54918afb1b80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:10:00.684314240Z [2024-04-06 03:10:00,683: INFO/ForkPoolWorker-2] [62de4059-db6b-451c-a707-7b4e3373ce8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:10:01.024810464Z [2024-04-06 03:10:01,020: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:10:01.053667843Z [2024-04-06 03:10:01,049: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:10:01.428426448Z [2024-04-06 03:10:01,424: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:10:01.502915858Z [2024-04-06 03:10:01,498: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:10:01.883024463Z [2024-04-06 03:10:01,882: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:10:03.460305973Z [2024-04-06 03:10:03,459: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1661fc88-e31c-486d-a2fa-3cd7683b2f26] succeeded in 2.829437332999987s: None 2024-04-06T03:10:03.774290855Z [2024-04-06 03:10:03,773: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T03:10:03.778698925Z [2024-04-06 03:10:03,778: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:10:03.838528253Z [2024-04-06 03:10:03,838: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T03:10:03.842841068Z [2024-04-06 03:10:03,842: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:10:03.843400755Z [2024-04-06 03:10:03,842: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:10:03.843673327Z [2024-04-06 03:10:03,843: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:10:03.843820181Z [2024-04-06 03:10:03,843: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T03:10:03.844134623Z [2024-04-06 03:10:03,844: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:10:03.844385910Z [2024-04-06 03:10:03,844: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:10:03.977999048Z [2024-04-06 03:10:03,977: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:10:04.174770341Z [2024-04-06 03:10:04,174: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:10:04.196864517Z [2024-04-06 03:10:04,195: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:10:04.371788941Z [2024-04-06 03:10:04,371: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:10:04.378399237Z [2024-04-06 03:10:04,378: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:10:04.378416355Z [2024-04-06 03:10:04,378: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:10:04.378508533Z [2024-04-06 03:10:04,378: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:10:04.378525382Z [2024-04-06 03:10:04,378: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:10:04.378760668Z [2024-04-06 03:10:04,378: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:10:04.378786109Z [2024-04-06 03:10:04,378: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:10:04.461454962Z [2024-04-06 03:10:04,461: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:10:04.472548461Z [2024-04-06 03:10:04,472: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:10:04.574473077Z [2024-04-06 03:10:04,574: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:10:04.586170779Z [2024-04-06 03:10:04,585: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:10:04.586229702Z [2024-04-06 03:10:04,586: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:10:04.586368211Z [2024-04-06 03:10:04,586: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:10:04.586396028Z [2024-04-06 03:10:04,586: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:10:04.589691982Z [2024-04-06 03:10:04,586: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:10:04.589743450Z [2024-04-06 03:10:04,589: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:10:04.650736062Z [2024-04-06 03:10:04,650: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:10:04.691455540Z [2024-04-06 03:10:04,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:10:05.710776063Z [2024-04-06 03:10:05,710: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a99452a9-d5a1-412b-9084-c0f493b1c2d0] succeeded in 5.081842198999766s: None 2024-04-06T03:10:05.821702684Z [2024-04-06 03:10:05,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3e5cd62-6da2-4382-b03c-3423bdf1c2bc] received 2024-04-06T03:10:05.842797522Z [2024-04-06 03:10:05,842: INFO/ForkPoolWorker-15] [b3e5cd62-6da2-4382-b03c-3423bdf1c2bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:10:06.216578023Z [2024-04-06 03:10:06,213: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:10:06.548768758Z [2024-04-06 03:10:06,548: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a5033ed-14c0-435d-b8f1-54918afb1b80] succeeded in 5.904846145999727s: None 2024-04-06T03:10:06.554837584Z [2024-04-06 03:10:06,554: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[62de4059-db6b-451c-a707-7b4e3373ce8a] succeeded in 5.897634803000074s: None 2024-04-06T03:10:07.314726211Z [2024-04-06 03:10:07,314: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:10:07.317738776Z [2024-04-06 03:10:07,317: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:10:07.351242743Z [2024-04-06 03:10:07,350: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:10:07.353068613Z [2024-04-06 03:10:07,352: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:10:07.353453356Z [2024-04-06 03:10:07,353: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:10:07.353905128Z [2024-04-06 03:10:07,353: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:10:07.354215329Z [2024-04-06 03:10:07,354: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:10:07.354744989Z [2024-04-06 03:10:07,354: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:10:07.355064272Z [2024-04-06 03:10:07,354: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:10:07.455519788Z [2024-04-06 03:10:07,455: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:10:08.166080892Z [2024-04-06 03:10:08,161: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3e5cd62-6da2-4382-b03c-3423bdf1c2bc] succeeded in 2.335134148999714s: None 2024-04-06T03:10:08.977876179Z [2024-04-06 03:10:08,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfe2be02-1cb4-4fe9-9b4b-4a78a3905872] received 2024-04-06T03:10:08.989728466Z [2024-04-06 03:10:08,989: INFO/ForkPoolWorker-15] [dfe2be02-1cb4-4fe9-9b4b-4a78a3905872] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:10:09.257441248Z [2024-04-06 03:10:09,253: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:10:10.675522130Z [2024-04-06 03:10:10,675: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:10:10.681770732Z [2024-04-06 03:10:10,681: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:10:10.778003289Z [2024-04-06 03:10:10,770: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:10:10.807055288Z [2024-04-06 03:10:10,806: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:10:10.807072812Z [2024-04-06 03:10:10,806: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:10:10.807082825Z [2024-04-06 03:10:10,806: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:10:10.807086835Z [2024-04-06 03:10:10,806: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:10:10.807092740Z [2024-04-06 03:10:10,806: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:10:10.809905913Z [2024-04-06 03:10:10,806: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:10:10.927176558Z [2024-04-06 03:10:10,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:10:12.519107643Z [2024-04-06 03:10:12,518: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfe2be02-1cb4-4fe9-9b4b-4a78a3905872] succeeded in 3.538040450000153s: None 2024-04-06T03:10:13.053306937Z [2024-04-06 03:10:13,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52b04c94-8312-4682-b9bf-2fe5ded186b8] received 2024-04-06T03:10:13.061740909Z [2024-04-06 03:10:13,061: INFO/ForkPoolWorker-15] [52b04c94-8312-4682-b9bf-2fe5ded186b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:10:13.444043268Z [2024-04-06 03:10:13,438: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:10:14.604663147Z [2024-04-06 03:10:14,604: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:10:14.607836431Z [2024-04-06 03:10:14,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:10:14.656992841Z [2024-04-06 03:10:14,656: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:10:14.659077864Z [2024-04-06 03:10:14,658: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:10:14.659313350Z [2024-04-06 03:10:14,659: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:10:14.659667282Z [2024-04-06 03:10:14,659: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:10:14.659940248Z [2024-04-06 03:10:14,659: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:10:14.662047392Z [2024-04-06 03:10:14,661: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:10:14.662730615Z [2024-04-06 03:10:14,662: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:10:14.751437696Z [2024-04-06 03:10:14,751: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:10:15.402917802Z [2024-04-06 03:10:15,402: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52b04c94-8312-4682-b9bf-2fe5ded186b8] succeeded in 2.346626572999412s: None 2024-04-06T03:11:00.571391150Z [2024-04-06 03:11:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e397704-9b70-4c7e-bd85-409a5b750e69] received 2024-04-06T03:11:00.577917428Z [2024-04-06 03:11:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35489eb4-74b9-4496-9235-c9538232427b] received 2024-04-06T03:11:00.597195732Z [2024-04-06 03:11:00,596: INFO/ForkPoolWorker-16] [35489eb4-74b9-4496-9235-c9538232427b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:11:00.599639022Z [2024-04-06 03:11:00,599: INFO/ForkPoolWorker-15] [5e397704-9b70-4c7e-bd85-409a5b750e69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:11:00.958619027Z [2024-04-06 03:11:00,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:11:01.057617994Z [2024-04-06 03:11:01,053: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:11:02.803884748Z [2024-04-06 03:11:02,803: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:11:02.806968012Z [2024-04-06 03:11:02,806: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:11:02.840812934Z [2024-04-06 03:11:02,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:11:02.842097272Z [2024-04-06 03:11:02,841: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:11:02.842114775Z [2024-04-06 03:11:02,842: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:11:02.842239112Z [2024-04-06 03:11:02,842: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:11:02.842272249Z [2024-04-06 03:11:02,842: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:11:02.842487828Z [2024-04-06 03:11:02,842: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:11:02.842523432Z [2024-04-06 03:11:02,842: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:11:02.914458699Z [2024-04-06 03:11:02,914: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:11:03.189263571Z [2024-04-06 03:11:03,188: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:11:03.192805419Z [2024-04-06 03:11:03,192: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:11:03.259245703Z [2024-04-06 03:11:03,258: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:11:03.264925293Z [2024-04-06 03:11:03,264: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:11:03.267281027Z [2024-04-06 03:11:03,267: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:11:03.267432447Z [2024-04-06 03:11:03,267: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:11:03.267494332Z [2024-04-06 03:11:03,267: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:11:03.267778024Z [2024-04-06 03:11:03,267: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:11:03.268344135Z [2024-04-06 03:11:03,268: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:11:03.415268443Z [2024-04-06 03:11:03,415: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:11:05.118926007Z [2024-04-06 03:11:05,118: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5e397704-9b70-4c7e-bd85-409a5b750e69] succeeded in 4.543949123999482s: None 2024-04-06T03:11:05.509802916Z [2024-04-06 03:11:05,509: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35489eb4-74b9-4496-9235-c9538232427b] succeeded in 4.929435742000351s: None 2024-04-06T03:12:01.063491262Z [2024-04-06 03:12:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21e0b62d-f57d-4674-b4aa-ac2f0895ea4f] received 2024-04-06T03:12:01.068531979Z [2024-04-06 03:12:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2671aad5-1963-477a-924c-a28fdcc92a96] received 2024-04-06T03:12:01.079634560Z [2024-04-06 03:12:01,079: INFO/ForkPoolWorker-16] [2671aad5-1963-477a-924c-a28fdcc92a96] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:12:01.084629957Z [2024-04-06 03:12:01,084: INFO/ForkPoolWorker-15] [21e0b62d-f57d-4674-b4aa-ac2f0895ea4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:12:01.100853695Z [2024-04-06 03:12:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[249447a8-fa25-4d7b-9bbc-3844d85ba88b] received 2024-04-06T03:12:01.119179064Z [2024-04-06 03:12:01,118: INFO/ForkPoolWorker-1] [249447a8-fa25-4d7b-9bbc-3844d85ba88b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:12:01.375000601Z [2024-04-06 03:12:01,371: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:12:01.458912900Z [2024-04-06 03:12:01,455: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:12:01.603373768Z [2024-04-06 03:12:01,597: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:12:02.039435035Z [2024-04-06 03:12:02,039: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:12:03.033208824Z [2024-04-06 03:12:03,032: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2671aad5-1963-477a-924c-a28fdcc92a96] succeeded in 1.962082396000369s: None 2024-04-06T03:12:03.175953504Z [2024-04-06 03:12:03,175: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:12:03.179328877Z [2024-04-06 03:12:03,178: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:12:03.242234022Z [2024-04-06 03:12:03,242: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:12:03.243842437Z [2024-04-06 03:12:03,243: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:12:03.243937297Z [2024-04-06 03:12:03,243: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:12:03.244089110Z [2024-04-06 03:12:03,243: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:12:03.244166079Z [2024-04-06 03:12:03,244: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:12:03.244552243Z [2024-04-06 03:12:03,244: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:12:03.244713571Z [2024-04-06 03:12:03,244: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:12:03.333324572Z [2024-04-06 03:12:03,333: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:12:03.969206882Z [2024-04-06 03:12:03,968: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:12:03.972299151Z [2024-04-06 03:12:03,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:12:04.037992115Z [2024-04-06 03:12:04,037: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:12:04.038995580Z [2024-04-06 03:12:04,038: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:12:04.039062313Z [2024-04-06 03:12:04,038: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:12:04.039209399Z [2024-04-06 03:12:04,039: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:12:04.039276282Z [2024-04-06 03:12:04,039: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:12:04.039872494Z [2024-04-06 03:12:04,039: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:12:04.041590565Z [2024-04-06 03:12:04,041: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:12:04.175490423Z [2024-04-06 03:12:04,175: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:12:04.918475947Z [2024-04-06 03:12:04,918: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[249447a8-fa25-4d7b-9bbc-3844d85ba88b] succeeded in 3.8156202929994834s: None 2024-04-06T03:12:07.287170919Z [2024-04-06 03:12:07,286: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21e0b62d-f57d-4674-b4aa-ac2f0895ea4f] succeeded in 6.213669142000072s: None 2024-04-06T03:13:00.424373324Z [2024-04-06 03:13:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa19595e-04bc-4450-a3fb-32db9c46880b] received 2024-04-06T03:13:00.433562169Z [2024-04-06 03:13:00,433: INFO/ForkPoolWorker-15] [fa19595e-04bc-4450-a3fb-32db9c46880b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:13:00.440608617Z [2024-04-06 03:13:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65b941ec-57a6-4a3f-878f-9b1b37655243] received 2024-04-06T03:13:00.450355349Z [2024-04-06 03:13:00,449: INFO/ForkPoolWorker-16] [65b941ec-57a6-4a3f-878f-9b1b37655243] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:13:00.720932604Z [2024-04-06 03:13:00,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:13:00.767444381Z [2024-04-06 03:13:00,755: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:13:02.140963625Z [2024-04-06 03:13:02,140: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:13:02.144950411Z [2024-04-06 03:13:02,144: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:13:02.221153777Z [2024-04-06 03:13:02,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:13:02.225649677Z [2024-04-06 03:13:02,224: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:13:02.225670005Z [2024-04-06 03:13:02,224: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:13:02.225679073Z [2024-04-06 03:13:02,224: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:13:02.225683544Z [2024-04-06 03:13:02,224: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:13:02.225687191Z [2024-04-06 03:13:02,224: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:13:02.225690636Z [2024-04-06 03:13:02,224: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:13:02.280620633Z [2024-04-06 03:13:02,280: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:13:02.284210669Z [2024-04-06 03:13:02,283: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:13:02.341709410Z [2024-04-06 03:13:02,341: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:13:02.346385817Z [2024-04-06 03:13:02,346: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:13:02.346540519Z [2024-04-06 03:13:02,346: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:13:02.346680454Z [2024-04-06 03:13:02,346: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:13:02.346763345Z [2024-04-06 03:13:02,346: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:13:02.347013426Z [2024-04-06 03:13:02,346: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:13:02.347095145Z [2024-04-06 03:13:02,347: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:13:02.405162596Z [2024-04-06 03:13:02,404: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:13:02.455353821Z [2024-04-06 03:13:02,455: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:13:04.596869090Z [2024-04-06 03:13:04,596: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65b941ec-57a6-4a3f-878f-9b1b37655243] succeeded in 4.1540309009997145s: None 2024-04-06T03:13:05.378301248Z [2024-04-06 03:13:05,377: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa19595e-04bc-4450-a3fb-32db9c46880b] succeeded in 4.950984680000147s: None 2024-04-06T03:14:01.165914173Z [2024-04-06 03:14:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec8f3cb6-ea33-4896-b4cd-e935db4bfefb] received 2024-04-06T03:14:01.170294280Z [2024-04-06 03:14:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f76c814f-2d40-4294-b96f-77333e6824ee] received 2024-04-06T03:14:01.180727905Z [2024-04-06 03:14:01,180: INFO/ForkPoolWorker-16] [f76c814f-2d40-4294-b96f-77333e6824ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:14:01.197151341Z [2024-04-06 03:14:01,196: INFO/ForkPoolWorker-15] [ec8f3cb6-ea33-4896-b4cd-e935db4bfefb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:14:01.197911508Z [2024-04-06 03:14:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8269c2d4-e016-4073-9cd1-a857aabe813e] received 2024-04-06T03:14:01.231082250Z [2024-04-06 03:14:01,230: INFO/ForkPoolWorker-1] [8269c2d4-e016-4073-9cd1-a857aabe813e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:14:01.569152494Z [2024-04-06 03:14:01,564: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:14:01.693908418Z [2024-04-06 03:14:01,683: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:14:01.821458770Z [2024-04-06 03:14:01,818: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:14:02.306762112Z [2024-04-06 03:14:02,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:14:02.934404454Z [2024-04-06 03:14:02,934: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec8f3cb6-ea33-4896-b4cd-e935db4bfefb] succeeded in 1.7589240019997305s: None 2024-04-06T03:14:03.450122855Z [2024-04-06 03:14:03,449: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:14:03.455833840Z [2024-04-06 03:14:03,455: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:14:03.515848719Z [2024-04-06 03:14:03,515: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:14:03.520337944Z [2024-04-06 03:14:03,520: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:14:03.520949726Z [2024-04-06 03:14:03,520: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:14:03.522051753Z [2024-04-06 03:14:03,520: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:14:03.523057821Z [2024-04-06 03:14:03,522: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:14:03.524603568Z [2024-04-06 03:14:03,524: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:14:03.524795148Z [2024-04-06 03:14:03,524: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:14:03.576619856Z [2024-04-06 03:14:03,576: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:14:03.579950999Z [2024-04-06 03:14:03,579: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:14:03.624609984Z [2024-04-06 03:14:03,624: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:14:03.628221520Z [2024-04-06 03:14:03,627: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:14:03.631144404Z [2024-04-06 03:14:03,628: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:14:03.631449598Z [2024-04-06 03:14:03,631: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:14:03.631502954Z [2024-04-06 03:14:03,631: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:14:03.631831288Z [2024-04-06 03:14:03,631: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:14:03.632006752Z [2024-04-06 03:14:03,631: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:14:03.659995111Z [2024-04-06 03:14:03,659: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:14:03.791546325Z [2024-04-06 03:14:03,791: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:14:05.772698207Z [2024-04-06 03:14:05,772: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8269c2d4-e016-4073-9cd1-a857aabe813e] succeeded in 4.5685046069993405s: None 2024-04-06T03:14:06.249374325Z [2024-04-06 03:14:06,248: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f76c814f-2d40-4294-b96f-77333e6824ee] succeeded in 5.076721331000044s: None 2024-04-06T03:15:00.262958623Z [2024-04-06 03:15:00,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfa13ca1-a5d3-4cd2-9462-d2380c4d0c10] received 2024-04-06T03:15:00.266347084Z [2024-04-06 03:15:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3555b2c-780b-4133-a896-017543a61535] received 2024-04-06T03:15:00.270593998Z [2024-04-06 03:15:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08faf3f9-d6d1-47a7-82fd-0c96a32fb010] received 2024-04-06T03:15:00.278870588Z [2024-04-06 03:15:00,278: INFO/ForkPoolWorker-16] [f3555b2c-780b-4133-a896-017543a61535] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:15:00.280704968Z [2024-04-06 03:15:00,280: INFO/ForkPoolWorker-15] [bfa13ca1-a5d3-4cd2-9462-d2380c4d0c10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:15:00.284618946Z [2024-04-06 03:15:00,284: INFO/ForkPoolWorker-1] [08faf3f9-d6d1-47a7-82fd-0c96a32fb010] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:15:00.574386825Z [2024-04-06 03:15:00,571: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:15:00.588977124Z [2024-04-06 03:15:00,585: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:15:00.645916845Z [2024-04-06 03:15:00,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:15:02.427589555Z [2024-04-06 03:15:02,427: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:15:02.432232350Z [2024-04-06 03:15:02,431: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:15:02.540141794Z [2024-04-06 03:15:02,539: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:15:02.547025033Z [2024-04-06 03:15:02,546: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:15:02.547186353Z [2024-04-06 03:15:02,546: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:15:02.547458346Z [2024-04-06 03:15:02,547: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:15:02.547581022Z [2024-04-06 03:15:02,547: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:15:02.548034890Z [2024-04-06 03:15:02,547: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:15:02.548220182Z [2024-04-06 03:15:02,548: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:15:02.769268328Z [2024-04-06 03:15:02,768: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:15:02.773088393Z [2024-04-06 03:15:02,772: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:15:02.782417733Z [2024-04-06 03:15:02,782: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:15:02.819646226Z [2024-04-06 03:15:02,819: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:15:02.822861816Z [2024-04-06 03:15:02,822: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:15:02.830835787Z [2024-04-06 03:15:02,830: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:15:02.831979320Z [2024-04-06 03:15:02,831: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:15:02.832009956Z [2024-04-06 03:15:02,831: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:15:02.832200216Z [2024-04-06 03:15:02,831: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:15:02.832237920Z [2024-04-06 03:15:02,832: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:15:02.832520945Z [2024-04-06 03:15:02,832: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:15:02.832558632Z [2024-04-06 03:15:02,832: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:15:02.946840006Z [2024-04-06 03:15:02,946: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:15:02.962428913Z [2024-04-06 03:15:02,962: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:15:02.962825255Z [2024-04-06 03:15:02,962: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:15:02.963066707Z [2024-04-06 03:15:02,962: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:15:02.963218293Z [2024-04-06 03:15:02,963: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:15:02.964104723Z [2024-04-06 03:15:02,963: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:15:02.964318527Z [2024-04-06 03:15:02,964: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:15:03.033781980Z [2024-04-06 03:15:03,033: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:15:03.285747792Z [2024-04-06 03:15:03,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:15:03.700749263Z [2024-04-06 03:15:03,698: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3555b2c-780b-4133-a896-017543a61535] succeeded in 3.4291813540003204s: None 2024-04-06T03:15:04.382783967Z [2024-04-06 03:15:04,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c80aff28-29ec-4018-8678-37b2e0f13820] received 2024-04-06T03:15:04.396802937Z [2024-04-06 03:15:04,396: INFO/ForkPoolWorker-16] [c80aff28-29ec-4018-8678-37b2e0f13820] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:15:04.732937595Z [2024-04-06 03:15:04,729: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:15:04.857150666Z [2024-04-06 03:15:04,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfa13ca1-a5d3-4cd2-9462-d2380c4d0c10] succeeded in 4.589479269000549s: None 2024-04-06T03:15:05.250309668Z [2024-04-06 03:15:05,249: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08faf3f9-d6d1-47a7-82fd-0c96a32fb010] succeeded in 4.977130754999962s: None 2024-04-06T03:15:06.037936712Z [2024-04-06 03:15:06,037: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:15:06.041284593Z [2024-04-06 03:15:06,040: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:15:06.065393965Z [2024-04-06 03:15:06,065: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:15:06.066884154Z [2024-04-06 03:15:06,066: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:15:06.066902882Z [2024-04-06 03:15:06,066: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:15:06.067051771Z [2024-04-06 03:15:06,066: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:15:06.067147249Z [2024-04-06 03:15:06,067: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:15:06.067718585Z [2024-04-06 03:15:06,067: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:15:06.067763112Z [2024-04-06 03:15:06,067: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:15:06.161553490Z [2024-04-06 03:15:06,161: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:15:06.782602433Z [2024-04-06 03:15:06,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ea71a70-4ceb-430c-8d99-74f303086655] received 2024-04-06T03:15:06.799682140Z [2024-04-06 03:15:06,799: INFO/ForkPoolWorker-15] [6ea71a70-4ceb-430c-8d99-74f303086655] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:15:06.853345170Z [2024-04-06 03:15:06,852: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c80aff28-29ec-4018-8678-37b2e0f13820] succeeded in 2.4688010640002176s: None 2024-04-06T03:15:07.071852052Z [2024-04-06 03:15:07,068: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:15:08.231777569Z [2024-04-06 03:15:08,229: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:15:08.240016656Z [2024-04-06 03:15:08,237: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:15:08.265924230Z [2024-04-06 03:15:08,265: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:15:08.266889896Z [2024-04-06 03:15:08,266: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:15:08.266926227Z [2024-04-06 03:15:08,266: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:15:08.267016917Z [2024-04-06 03:15:08,266: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:15:08.267047840Z [2024-04-06 03:15:08,266: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:15:08.267234004Z [2024-04-06 03:15:08,267: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:15:08.267267921Z [2024-04-06 03:15:08,267: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:15:08.359203069Z [2024-04-06 03:15:08,358: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:15:09.908429625Z [2024-04-06 03:15:09,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ea71a70-4ceb-430c-8d99-74f303086655] succeeded in 3.1214677710004253s: None 2024-04-06T03:15:10.534825285Z [2024-04-06 03:15:10,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc444bbd-5544-409b-9a2d-2b66a2574508] received 2024-04-06T03:15:10.544513215Z [2024-04-06 03:15:10,544: INFO/ForkPoolWorker-15] [fc444bbd-5544-409b-9a2d-2b66a2574508] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:15:10.860087773Z [2024-04-06 03:15:10,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:15:12.115675263Z [2024-04-06 03:15:12,115: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:15:12.119018194Z [2024-04-06 03:15:12,118: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:15:12.148785447Z [2024-04-06 03:15:12,148: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:15:12.149890844Z [2024-04-06 03:15:12,149: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:15:12.150108111Z [2024-04-06 03:15:12,149: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:15:12.150310333Z [2024-04-06 03:15:12,150: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:15:12.150422325Z [2024-04-06 03:15:12,150: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:15:12.150696539Z [2024-04-06 03:15:12,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:15:12.150829508Z [2024-04-06 03:15:12,150: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:15:12.237338792Z [2024-04-06 03:15:12,237: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:15:12.884918392Z [2024-04-06 03:15:12,884: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc444bbd-5544-409b-9a2d-2b66a2574508] succeeded in 2.34825864800041s: None 2024-04-06T03:16:00.894048963Z [2024-04-06 03:16:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80b1523d-f95c-41b0-a18f-49544ec41eeb] received 2024-04-06T03:16:00.897888826Z [2024-04-06 03:16:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7b14ef4-49f1-4813-b15c-cb8688675c75] received 2024-04-06T03:16:00.918826509Z [2024-04-06 03:16:00,918: INFO/ForkPoolWorker-16] [a7b14ef4-49f1-4813-b15c-cb8688675c75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:16:00.923704473Z [2024-04-06 03:16:00,923: INFO/ForkPoolWorker-15] [80b1523d-f95c-41b0-a18f-49544ec41eeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:16:00.932844317Z [2024-04-06 03:16:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60d22977-0016-42ea-b36a-d70659bbfbde] received 2024-04-06T03:16:00.968279943Z [2024-04-06 03:16:00,967: INFO/ForkPoolWorker-1] [60d22977-0016-42ea-b36a-d70659bbfbde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:16:01.300224645Z [2024-04-06 03:16:01,296: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:16:01.529521653Z [2024-04-06 03:16:01,523: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:16:01.696503867Z [2024-04-06 03:16:01,689: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:16:01.839768202Z [2024-04-06 03:16:01,839: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:16:02.809870180Z [2024-04-06 03:16:02,806: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80b1523d-f95c-41b0-a18f-49544ec41eeb] succeeded in 1.9069342839993624s: None 2024-04-06T03:16:03.508210001Z [2024-04-06 03:16:03,507: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:16:03.511370649Z [2024-04-06 03:16:03,510: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:16:03.562878854Z [2024-04-06 03:16:03,562: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:16:03.564231312Z [2024-04-06 03:16:03,564: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:16:03.564416396Z [2024-04-06 03:16:03,564: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:16:03.564650089Z [2024-04-06 03:16:03,564: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:16:03.564805439Z [2024-04-06 03:16:03,564: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:16:03.565146890Z [2024-04-06 03:16:03,564: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:16:03.565725962Z [2024-04-06 03:16:03,565: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:16:03.697628892Z [2024-04-06 03:16:03,697: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:16:03.798487593Z [2024-04-06 03:16:03,798: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:16:03.801707254Z [2024-04-06 03:16:03,801: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:16:03.858051975Z [2024-04-06 03:16:03,857: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:16:03.860434015Z [2024-04-06 03:16:03,860: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:16:03.860503920Z [2024-04-06 03:16:03,860: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:16:03.860662385Z [2024-04-06 03:16:03,860: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:16:03.860741000Z [2024-04-06 03:16:03,860: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:16:03.861013049Z [2024-04-06 03:16:03,860: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:16:03.861094446Z [2024-04-06 03:16:03,860: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:16:03.981962041Z [2024-04-06 03:16:03,981: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:16:06.239325507Z [2024-04-06 03:16:06,238: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60d22977-0016-42ea-b36a-d70659bbfbde] succeeded in 5.300031965999551s: None 2024-04-06T03:16:07.098715708Z [2024-04-06 03:16:07,098: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7b14ef4-49f1-4813-b15c-cb8688675c75] succeeded in 6.195698619999348s: None 2024-04-06T03:17:00.902612570Z [2024-04-06 03:17:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1a20c92-4eaf-4ab6-b46e-fe15b457fd05] received 2024-04-06T03:17:00.923788137Z [2024-04-06 03:17:00,923: INFO/ForkPoolWorker-15] [e1a20c92-4eaf-4ab6-b46e-fe15b457fd05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:17:00.927536466Z [2024-04-06 03:17:00,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff4e6b84-8068-4472-9600-0f0f7fc1fd62] received 2024-04-06T03:17:00.941959584Z [2024-04-06 03:17:00,941: INFO/ForkPoolWorker-16] [ff4e6b84-8068-4472-9600-0f0f7fc1fd62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:17:01.305194664Z [2024-04-06 03:17:01,301: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:17:01.356062168Z [2024-04-06 03:17:01,351: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:17:02.665082651Z [2024-04-06 03:17:02,664: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:17:02.668395719Z [2024-04-06 03:17:02,667: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:17:02.754074105Z [2024-04-06 03:17:02,753: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:17:02.763851465Z [2024-04-06 03:17:02,761: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:17:02.764070289Z [2024-04-06 03:17:02,763: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:17:02.764249425Z [2024-04-06 03:17:02,764: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:17:02.764290189Z [2024-04-06 03:17:02,764: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:17:02.764533229Z [2024-04-06 03:17:02,764: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:17:02.764549790Z [2024-04-06 03:17:02,764: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:17:02.793880180Z [2024-04-06 03:17:02,793: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:17:02.800304533Z [2024-04-06 03:17:02,799: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:17:02.862529500Z [2024-04-06 03:17:02,862: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:17:02.866507900Z [2024-04-06 03:17:02,866: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:17:02.866664971Z [2024-04-06 03:17:02,866: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:17:02.866864656Z [2024-04-06 03:17:02,866: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:17:02.866973161Z [2024-04-06 03:17:02,866: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:17:02.867273430Z [2024-04-06 03:17:02,867: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:17:02.867404134Z [2024-04-06 03:17:02,867: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:17:02.903322770Z [2024-04-06 03:17:02,903: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:17:02.988088190Z [2024-04-06 03:17:02,987: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:17:05.166769915Z [2024-04-06 03:17:05,166: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1a20c92-4eaf-4ab6-b46e-fe15b457fd05] succeeded in 4.252564634000009s: None 2024-04-06T03:17:06.457064088Z [2024-04-06 03:17:06,456: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff4e6b84-8068-4472-9600-0f0f7fc1fd62] succeeded in 5.5264845430001515s: None 2024-04-06T03:18:00.948733140Z [2024-04-06 03:18:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b6e7561-1efc-4a96-b91f-7f110ac7c7d4] received 2024-04-06T03:18:00.952521241Z [2024-04-06 03:18:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bbdc8a5-992c-4cee-be9a-2dcbce114823] received 2024-04-06T03:18:00.962645146Z [2024-04-06 03:18:00,962: INFO/ForkPoolWorker-16] [4bbdc8a5-992c-4cee-be9a-2dcbce114823] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:18:00.964353590Z [2024-04-06 03:18:00,964: INFO/ForkPoolWorker-15] [6b6e7561-1efc-4a96-b91f-7f110ac7c7d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:18:00.974870704Z [2024-04-06 03:18:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e30c7f92-9584-493e-beff-f4dc1ac5d620] received 2024-04-06T03:18:01.005902081Z [2024-04-06 03:18:01,005: INFO/ForkPoolWorker-1] [e30c7f92-9584-493e-beff-f4dc1ac5d620] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:18:01.344829288Z [2024-04-06 03:18:01,341: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:18:01.587469084Z [2024-04-06 03:18:01,580: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:18:01.915530708Z [2024-04-06 03:18:01,896: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:18:02.046277321Z [2024-04-06 03:18:02,046: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:18:03.303090067Z [2024-04-06 03:18:03,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b6e7561-1efc-4a96-b91f-7f110ac7c7d4] succeeded in 2.351007926999955s: None 2024-04-06T03:18:03.400998497Z [2024-04-06 03:18:03,400: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:18:03.405117676Z [2024-04-06 03:18:03,404: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:18:03.470995089Z [2024-04-06 03:18:03,470: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:18:03.474991662Z [2024-04-06 03:18:03,474: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:18:03.475086038Z [2024-04-06 03:18:03,474: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:18:03.475263101Z [2024-04-06 03:18:03,475: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:18:03.475361350Z [2024-04-06 03:18:03,475: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:18:03.475675227Z [2024-04-06 03:18:03,475: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:18:03.475755649Z [2024-04-06 03:18:03,475: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:18:03.616786452Z [2024-04-06 03:18:03,616: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:18:03.848252545Z [2024-04-06 03:18:03,847: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:18:03.855747795Z [2024-04-06 03:18:03,855: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:18:03.908451299Z [2024-04-06 03:18:03,908: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:18:03.910489696Z [2024-04-06 03:18:03,910: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:18:03.911268221Z [2024-04-06 03:18:03,910: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:18:03.911604629Z [2024-04-06 03:18:03,911: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:18:03.911875391Z [2024-04-06 03:18:03,911: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:18:03.912456574Z [2024-04-06 03:18:03,912: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:18:03.912795521Z [2024-04-06 03:18:03,912: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:18:04.015465256Z [2024-04-06 03:18:04,015: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:18:06.089389299Z [2024-04-06 03:18:06,088: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4bbdc8a5-992c-4cee-be9a-2dcbce114823] succeeded in 5.134254182999939s: None 2024-04-06T03:18:07.213363888Z [2024-04-06 03:18:07,212: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e30c7f92-9584-493e-beff-f4dc1ac5d620] succeeded in 6.235278268000002s: None 2024-04-06T03:19:00.867467685Z [2024-04-06 03:19:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[943ab92a-163c-4ac9-915b-48cfb69d7286] received 2024-04-06T03:19:00.875762786Z [2024-04-06 03:19:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da707e7e-08ae-48dc-bb88-a5c2dafbf031] received 2024-04-06T03:19:00.887239184Z [2024-04-06 03:19:00,886: INFO/ForkPoolWorker-16] [da707e7e-08ae-48dc-bb88-a5c2dafbf031] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:19:00.894304098Z [2024-04-06 03:19:00,887: INFO/ForkPoolWorker-15] [943ab92a-163c-4ac9-915b-48cfb69d7286] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:19:01.235932827Z [2024-04-06 03:19:01,232: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:19:01.285501539Z [2024-04-06 03:19:01,281: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:19:02.820457950Z [2024-04-06 03:19:02,819: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:19:02.823556896Z [2024-04-06 03:19:02,823: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:19:02.853499375Z [2024-04-06 03:19:02,853: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:19:02.857477753Z [2024-04-06 03:19:02,857: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:19:02.877180610Z [2024-04-06 03:19:02,876: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:19:02.878633683Z [2024-04-06 03:19:02,878: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:19:02.880887994Z [2024-04-06 03:19:02,878: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:19:02.881245440Z [2024-04-06 03:19:02,880: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:19:02.881384254Z [2024-04-06 03:19:02,881: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:19:02.881684649Z [2024-04-06 03:19:02,881: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:19:02.881891769Z [2024-04-06 03:19:02,881: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:19:02.910413367Z [2024-04-06 03:19:02,910: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:19:02.917137879Z [2024-04-06 03:19:02,916: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:19:02.917491362Z [2024-04-06 03:19:02,917: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:19:02.917667791Z [2024-04-06 03:19:02,917: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:19:02.917824499Z [2024-04-06 03:19:02,917: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:19:02.918195607Z [2024-04-06 03:19:02,918: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:19:02.918795039Z [2024-04-06 03:19:02,918: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:19:02.996499904Z [2024-04-06 03:19:02,996: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:19:03.077228386Z [2024-04-06 03:19:03,076: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:19:05.583908221Z [2024-04-06 03:19:05,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[943ab92a-163c-4ac9-915b-48cfb69d7286] succeeded in 4.710254869999517s: None 2024-04-06T03:19:06.159433112Z [2024-04-06 03:19:06,158: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[da707e7e-08ae-48dc-bb88-a5c2dafbf031] succeeded in 5.281252861000212s: None 2024-04-06T03:20:00.773908005Z [2024-04-06 03:20:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[433f2e46-9d9a-487f-bde4-6ae8786a7fee] received 2024-04-06T03:20:00.773962653Z [2024-04-06 03:20:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46ea179f-b54f-4eb0-91c1-5d2c66f1bde6] received 2024-04-06T03:20:00.779519661Z [2024-04-06 03:20:00,778: INFO/ForkPoolWorker-16] [46ea179f-b54f-4eb0-91c1-5d2c66f1bde6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:20:00.787670628Z [2024-04-06 03:20:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3db1cdb2-8288-46aa-8c97-8e347e6e8cf1] received 2024-04-06T03:20:00.791286167Z [2024-04-06 03:20:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fb67e43-9f2b-4b08-9a82-6e1cfc62ce2c] received 2024-04-06T03:20:00.791920276Z [2024-04-06 03:20:00,791: INFO/ForkPoolWorker-15] [433f2e46-9d9a-487f-bde4-6ae8786a7fee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:20:00.836327701Z [2024-04-06 03:20:00,835: INFO/ForkPoolWorker-1] [3db1cdb2-8288-46aa-8c97-8e347e6e8cf1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:20:00.847006008Z [2024-04-06 03:20:00,846: INFO/ForkPoolWorker-2] [3fb67e43-9f2b-4b08-9a82-6e1cfc62ce2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:20:01.218202662Z [2024-04-06 03:20:01,213: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:20:01.334470889Z [2024-04-06 03:20:01,330: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:20:01.701909176Z [2024-04-06 03:20:01,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:20:01.779661841Z [2024-04-06 03:20:01,734: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:20:02.308739785Z [2024-04-06 03:20:02,308: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:20:03.867409783Z [2024-04-06 03:20:03,867: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:20:03.870701803Z [2024-04-06 03:20:03,870: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:20:03.973138505Z [2024-04-06 03:20:03,972: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[46ea179f-b54f-4eb0-91c1-5d2c66f1bde6] succeeded in 3.2013645810002345s: None 2024-04-06T03:20:03.990177142Z [2024-04-06 03:20:03,989: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:20:03.994769673Z [2024-04-06 03:20:03,994: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:20:03.994790023Z [2024-04-06 03:20:03,994: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:20:03.994886119Z [2024-04-06 03:20:03,994: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:20:03.994915559Z [2024-04-06 03:20:03,994: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:20:03.995217417Z [2024-04-06 03:20:03,995: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:20:03.995228924Z [2024-04-06 03:20:03,995: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:20:04.142417666Z [2024-04-06 03:20:04,142: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:20:05.177772614Z [2024-04-06 03:20:05,177: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:20:05.181032032Z [2024-04-06 03:20:05,180: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:20:05.233870395Z [2024-04-06 03:20:05,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:20:05.243746313Z [2024-04-06 03:20:05,243: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:20:05.243842690Z [2024-04-06 03:20:05,243: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:20:05.244064347Z [2024-04-06 03:20:05,243: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:20:05.244194907Z [2024-04-06 03:20:05,244: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:20:05.248470473Z [2024-04-06 03:20:05,244: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:20:05.248631965Z [2024-04-06 03:20:05,248: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:20:05.366046603Z [2024-04-06 03:20:05,365: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:20:05.406754026Z [2024-04-06 03:20:05,406: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T03:20:05.409872397Z [2024-04-06 03:20:05,409: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:20:05.483361132Z [2024-04-06 03:20:05,483: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T03:20:05.488486719Z [2024-04-06 03:20:05,488: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:20:05.488504910Z [2024-04-06 03:20:05,488: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:20:05.488633468Z [2024-04-06 03:20:05,488: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:20:05.488658396Z [2024-04-06 03:20:05,488: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T03:20:05.488893180Z [2024-04-06 03:20:05,488: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:20:05.488927152Z [2024-04-06 03:20:05,488: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:20:05.652649487Z [2024-04-06 03:20:05,652: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:20:06.245695970Z [2024-04-06 03:20:06,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[433f2e46-9d9a-487f-bde4-6ae8786a7fee] succeeded in 5.4697960780004s: None 2024-04-06T03:20:06.469580591Z [2024-04-06 03:20:06,469: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3db1cdb2-8288-46aa-8c97-8e347e6e8cf1] succeeded in 5.672609580999961s: None 2024-04-06T03:20:07.230428433Z [2024-04-06 03:20:07,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e6d9ffc-48f2-44dc-b610-15f3c1516331] received 2024-04-06T03:20:07.237643505Z [2024-04-06 03:20:07,237: INFO/ForkPoolWorker-15] [8e6d9ffc-48f2-44dc-b610-15f3c1516331] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:20:07.525705174Z [2024-04-06 03:20:07,522: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:20:07.707340100Z [2024-04-06 03:20:07,706: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3fb67e43-9f2b-4b08-9a82-6e1cfc62ce2c] succeeded in 6.9126748369999405s: None 2024-04-06T03:20:08.784736686Z [2024-04-06 03:20:08,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:20:08.787858426Z [2024-04-06 03:20:08,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:20:08.815558876Z [2024-04-06 03:20:08,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:20:08.816707917Z [2024-04-06 03:20:08,816: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:20:08.816753747Z [2024-04-06 03:20:08,816: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:20:08.816886755Z [2024-04-06 03:20:08,816: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:20:08.816941898Z [2024-04-06 03:20:08,816: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:20:08.817177105Z [2024-04-06 03:20:08,817: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:20:08.817242344Z [2024-04-06 03:20:08,817: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:20:08.909622732Z [2024-04-06 03:20:08,909: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:20:09.567838442Z [2024-04-06 03:20:09,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea626d9c-6f1d-4827-8a49-aca2b708b5fb] received 2024-04-06T03:20:09.577869126Z [2024-04-06 03:20:09,577: INFO/ForkPoolWorker-16] [ea626d9c-6f1d-4827-8a49-aca2b708b5fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:20:09.613950204Z [2024-04-06 03:20:09,613: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e6d9ffc-48f2-44dc-b610-15f3c1516331] succeeded in 2.381125969000095s: None 2024-04-06T03:20:09.849838048Z [2024-04-06 03:20:09,846: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:20:11.052198553Z [2024-04-06 03:20:11,051: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:20:11.056015477Z [2024-04-06 03:20:11,055: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:20:11.108232564Z [2024-04-06 03:20:11,108: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:20:11.117014462Z [2024-04-06 03:20:11,116: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:20:11.117120906Z [2024-04-06 03:20:11,116: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:20:11.117322353Z [2024-04-06 03:20:11,117: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:20:11.117511601Z [2024-04-06 03:20:11,117: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:20:11.117829393Z [2024-04-06 03:20:11,117: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:20:11.117966028Z [2024-04-06 03:20:11,117: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:20:11.228003243Z [2024-04-06 03:20:11,227: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:20:12.884707050Z [2024-04-06 03:20:12,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ea626d9c-6f1d-4827-8a49-aca2b708b5fb] succeeded in 3.3122314610000103s: None 2024-04-06T03:20:13.460382222Z [2024-04-06 03:20:13,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae0aba6d-9d33-4d97-b3ab-f4cd1458d70b] received 2024-04-06T03:20:13.472285152Z [2024-04-06 03:20:13,471: INFO/ForkPoolWorker-15] [ae0aba6d-9d33-4d97-b3ab-f4cd1458d70b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:20:13.756558913Z [2024-04-06 03:20:13,753: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:20:15.014458313Z [2024-04-06 03:20:15,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:20:15.017990306Z [2024-04-06 03:20:15,017: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:20:15.102243985Z [2024-04-06 03:20:15,102: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:20:15.110438278Z [2024-04-06 03:20:15,110: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:20:15.110461356Z [2024-04-06 03:20:15,110: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:20:15.110499859Z [2024-04-06 03:20:15,110: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:20:15.111545934Z [2024-04-06 03:20:15,110: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:20:15.118340187Z [2024-04-06 03:20:15,118: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:20:15.118488281Z [2024-04-06 03:20:15,118: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:20:15.253510071Z [2024-04-06 03:20:15,253: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:20:15.887261158Z [2024-04-06 03:20:15,886: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae0aba6d-9d33-4d97-b3ab-f4cd1458d70b] succeeded in 2.4244832420008606s: None 2024-04-06T03:21:00.269884446Z [2024-04-06 03:21:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75c10fb0-4440-465c-916c-c5adc52378e0] received 2024-04-06T03:21:00.272198895Z [2024-04-06 03:21:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8db4bfd7-d5c8-4fe1-92d9-ab875a9a8ca7] received 2024-04-06T03:21:00.280817400Z [2024-04-06 03:21:00,280: INFO/ForkPoolWorker-15] [75c10fb0-4440-465c-916c-c5adc52378e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:21:00.284584461Z [2024-04-06 03:21:00,283: INFO/ForkPoolWorker-16] [8db4bfd7-d5c8-4fe1-92d9-ab875a9a8ca7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:21:00.534752514Z [2024-04-06 03:21:00,531: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:21:00.557472851Z [2024-04-06 03:21:00,554: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:21:01.829849073Z [2024-04-06 03:21:01,828: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:21:01.832844770Z [2024-04-06 03:21:01,832: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:21:01.875518792Z [2024-04-06 03:21:01,875: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:21:01.877880604Z [2024-04-06 03:21:01,877: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:21:01.878101844Z [2024-04-06 03:21:01,877: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:21:01.878368994Z [2024-04-06 03:21:01,878: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:21:01.878523094Z [2024-04-06 03:21:01,878: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:21:01.878870496Z [2024-04-06 03:21:01,878: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:21:01.879058268Z [2024-04-06 03:21:01,878: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:21:01.973440424Z [2024-04-06 03:21:01,973: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:21:01.978965885Z [2024-04-06 03:21:01,978: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:21:01.987194277Z [2024-04-06 03:21:01,986: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:21:02.058011824Z [2024-04-06 03:21:02,057: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:21:02.059780009Z [2024-04-06 03:21:02,059: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:21:02.060007593Z [2024-04-06 03:21:02,059: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:21:02.060262743Z [2024-04-06 03:21:02,060: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:21:02.060417656Z [2024-04-06 03:21:02,060: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:21:02.060730008Z [2024-04-06 03:21:02,060: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:21:02.060893458Z [2024-04-06 03:21:02,060: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:21:02.181693392Z [2024-04-06 03:21:02,181: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:21:04.217210222Z [2024-04-06 03:21:04,216: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8db4bfd7-d5c8-4fe1-92d9-ab875a9a8ca7] succeeded in 3.9434418069995445s: None 2024-04-06T03:21:04.778129334Z [2024-04-06 03:21:04,777: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75c10fb0-4440-465c-916c-c5adc52378e0] succeeded in 4.506347864000418s: None 2024-04-06T03:22:00.287961660Z [2024-04-06 03:22:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6060f05e-7e32-45fd-8a3e-64029d0a8e64] received 2024-04-06T03:22:00.292994021Z [2024-04-06 03:22:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f3bac33-0e7f-4230-9265-2bb4427bf220] received 2024-04-06T03:22:00.294764957Z [2024-04-06 03:22:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a4bd535-e9d3-4bed-b25c-6e3ac0b622b1] received 2024-04-06T03:22:00.305482284Z [2024-04-06 03:22:00,305: INFO/ForkPoolWorker-15] [6060f05e-7e32-45fd-8a3e-64029d0a8e64] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:22:00.307115958Z [2024-04-06 03:22:00,306: INFO/ForkPoolWorker-16] [0f3bac33-0e7f-4230-9265-2bb4427bf220] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:22:00.314565272Z [2024-04-06 03:22:00,314: INFO/ForkPoolWorker-1] [8a4bd535-e9d3-4bed-b25c-6e3ac0b622b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:22:00.595239490Z [2024-04-06 03:22:00,591: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:22:00.631918208Z [2024-04-06 03:22:00,628: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:22:00.641563932Z [2024-04-06 03:22:00,637: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:22:00.881733081Z [2024-04-06 03:22:00,881: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:22:01.859074668Z [2024-04-06 03:22:01,858: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6060f05e-7e32-45fd-8a3e-64029d0a8e64] succeeded in 1.5667845339994528s: None 2024-04-06T03:22:02.526485634Z [2024-04-06 03:22:02,526: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:22:02.531107642Z [2024-04-06 03:22:02,530: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:22:02.571961189Z [2024-04-06 03:22:02,571: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:22:02.573755004Z [2024-04-06 03:22:02,573: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:22:02.573972247Z [2024-04-06 03:22:02,573: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:22:02.574190824Z [2024-04-06 03:22:02,573: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:22:02.574320412Z [2024-04-06 03:22:02,574: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:22:02.574698618Z [2024-04-06 03:22:02,574: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:22:02.574778791Z [2024-04-06 03:22:02,574: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:22:02.677775648Z [2024-04-06 03:22:02,677: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:22:02.768012104Z [2024-04-06 03:22:02,767: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:22:02.771503249Z [2024-04-06 03:22:02,771: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:22:02.826597785Z [2024-04-06 03:22:02,826: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:22:02.830787520Z [2024-04-06 03:22:02,830: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:22:02.830867246Z [2024-04-06 03:22:02,830: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:22:02.831063162Z [2024-04-06 03:22:02,830: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:22:02.831160753Z [2024-04-06 03:22:02,831: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:22:02.831464220Z [2024-04-06 03:22:02,831: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:22:02.831554349Z [2024-04-06 03:22:02,831: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:22:02.987630322Z [2024-04-06 03:22:02,987: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:22:04.642520495Z [2024-04-06 03:22:04,642: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a4bd535-e9d3-4bed-b25c-6e3ac0b622b1] succeeded in 4.344595826000841s: None 2024-04-06T03:22:05.172899562Z [2024-04-06 03:22:05,172: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f3bac33-0e7f-4230-9265-2bb4427bf220] succeeded in 4.875963218999459s: None 2024-04-06T03:23:01.182829698Z [2024-04-06 03:23:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a72c7f0-5d11-439c-a071-da993c0766ed] received 2024-04-06T03:23:01.208046528Z [2024-04-06 03:23:01,207: INFO/ForkPoolWorker-15] [4a72c7f0-5d11-439c-a071-da993c0766ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:23:01.220603336Z [2024-04-06 03:23:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5aa37b2c-f1c4-42aa-89f1-7fc41b5bac4c] received 2024-04-06T03:23:01.230454091Z [2024-04-06 03:23:01,230: INFO/ForkPoolWorker-16] [5aa37b2c-f1c4-42aa-89f1-7fc41b5bac4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:23:01.538449813Z [2024-04-06 03:23:01,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:23:01.607106473Z [2024-04-06 03:23:01,602: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:23:02.951278816Z [2024-04-06 03:23:02,950: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:23:02.955374219Z [2024-04-06 03:23:02,954: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:23:03.012562266Z [2024-04-06 03:23:03,012: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:23:03.014407507Z [2024-04-06 03:23:03,014: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:23:03.014634212Z [2024-04-06 03:23:03,014: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:23:03.015101049Z [2024-04-06 03:23:03,014: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:23:03.015237483Z [2024-04-06 03:23:03,015: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:23:03.018138049Z [2024-04-06 03:23:03,017: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:23:03.020802720Z [2024-04-06 03:23:03,020: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:23:03.063256306Z [2024-04-06 03:23:03,062: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:23:03.067859671Z [2024-04-06 03:23:03,067: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:23:03.144413620Z [2024-04-06 03:23:03,144: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:23:03.157895385Z [2024-04-06 03:23:03,148: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:23:03.157914731Z [2024-04-06 03:23:03,148: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:23:03.157923896Z [2024-04-06 03:23:03,148: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:23:03.157928066Z [2024-04-06 03:23:03,149: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:23:03.157931184Z [2024-04-06 03:23:03,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:23:03.157934288Z [2024-04-06 03:23:03,150: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:23:03.157937676Z [2024-04-06 03:23:03,152: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:23:03.372585453Z [2024-04-06 03:23:03,372: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:23:05.240930288Z [2024-04-06 03:23:05,240: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5aa37b2c-f1c4-42aa-89f1-7fc41b5bac4c] succeeded in 4.017301025000052s: None 2024-04-06T03:23:06.831958817Z [2024-04-06 03:23:06,830: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a72c7f0-5d11-439c-a071-da993c0766ed] succeeded in 5.645520725000097s: None 2024-04-06T03:24:01.096329550Z [2024-04-06 03:24:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd573fde-9e03-4607-a3f0-68270a5de828] received 2024-04-06T03:24:01.106568477Z [2024-04-06 03:24:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d831e109-5f25-44e4-8262-db71febc4df7] received 2024-04-06T03:24:01.110397352Z [2024-04-06 03:24:01,110: INFO/ForkPoolWorker-15] [cd573fde-9e03-4607-a3f0-68270a5de828] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:24:01.111461683Z [2024-04-06 03:24:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0195b8fb-078c-45d1-b580-77b98399e2ed] received 2024-04-06T03:24:01.125416254Z [2024-04-06 03:24:01,125: INFO/ForkPoolWorker-1] [0195b8fb-078c-45d1-b580-77b98399e2ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:24:01.134521218Z [2024-04-06 03:24:01,134: INFO/ForkPoolWorker-16] [d831e109-5f25-44e4-8262-db71febc4df7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:24:01.524199292Z [2024-04-06 03:24:01,520: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:24:01.563750895Z [2024-04-06 03:24:01,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:24:01.582841607Z [2024-04-06 03:24:01,579: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:24:01.903487067Z [2024-04-06 03:24:01,903: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:24:02.891037051Z [2024-04-06 03:24:02,890: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0195b8fb-078c-45d1-b580-77b98399e2ed] succeeded in 1.7768790499994793s: None 2024-04-06T03:24:03.137342935Z [2024-04-06 03:24:03,136: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:24:03.140722159Z [2024-04-06 03:24:03,140: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:24:03.187979499Z [2024-04-06 03:24:03,187: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:24:03.190342945Z [2024-04-06 03:24:03,190: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:24:03.190750983Z [2024-04-06 03:24:03,190: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:24:03.191148392Z [2024-04-06 03:24:03,190: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:24:03.191531728Z [2024-04-06 03:24:03,191: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:24:03.192308210Z [2024-04-06 03:24:03,192: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:24:03.192517321Z [2024-04-06 03:24:03,192: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:24:03.290631406Z [2024-04-06 03:24:03,290: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:24:03.295661350Z [2024-04-06 03:24:03,295: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:24:03.298766831Z [2024-04-06 03:24:03,298: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:24:03.376144436Z [2024-04-06 03:24:03,375: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:24:03.377253228Z [2024-04-06 03:24:03,377: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:24:03.377423051Z [2024-04-06 03:24:03,377: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:24:03.377538538Z [2024-04-06 03:24:03,377: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:24:03.377600628Z [2024-04-06 03:24:03,377: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:24:03.377894484Z [2024-04-06 03:24:03,377: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:24:03.378336619Z [2024-04-06 03:24:03,378: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:24:03.483279310Z [2024-04-06 03:24:03,482: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:24:05.150211944Z [2024-04-06 03:24:05,149: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd573fde-9e03-4607-a3f0-68270a5de828] succeeded in 4.047767078000106s: None 2024-04-06T03:24:05.392465350Z [2024-04-06 03:24:05,392: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d831e109-5f25-44e4-8262-db71febc4df7] succeeded in 4.28317411199987s: None 2024-04-06T03:25:00.482235135Z [2024-04-06 03:25:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4f89656-c84c-44a1-a17f-7ca36038e5d1] received 2024-04-06T03:25:00.485049426Z [2024-04-06 03:25:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7988d1a6-e75e-4d43-a2f7-a49591f55743] received 2024-04-06T03:25:00.493991461Z [2024-04-06 03:25:00,493: INFO/ForkPoolWorker-15] [a4f89656-c84c-44a1-a17f-7ca36038e5d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:25:00.497129118Z [2024-04-06 03:25:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f044b691-04b7-4880-a6a6-239b72be217b] received 2024-04-06T03:25:00.508164368Z [2024-04-06 03:25:00,507: INFO/ForkPoolWorker-16] [7988d1a6-e75e-4d43-a2f7-a49591f55743] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:25:00.510733812Z [2024-04-06 03:25:00,510: INFO/ForkPoolWorker-1] [f044b691-04b7-4880-a6a6-239b72be217b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:25:00.892892062Z [2024-04-06 03:25:00,887: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:25:00.942518083Z [2024-04-06 03:25:00,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:25:00.957967392Z [2024-04-06 03:25:00,953: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:25:02.745362783Z [2024-04-06 03:25:02,744: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:25:02.757598220Z [2024-04-06 03:25:02,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:25:02.911170662Z [2024-04-06 03:25:02,910: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:25:02.912379629Z [2024-04-06 03:25:02,912: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:25:02.914295080Z [2024-04-06 03:25:02,914: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:25:02.914396131Z [2024-04-06 03:25:02,914: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:25:02.914436374Z [2024-04-06 03:25:02,914: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:25:02.914673745Z [2024-04-06 03:25:02,914: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:25:02.914720771Z [2024-04-06 03:25:02,914: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:25:03.167410852Z [2024-04-06 03:25:03,167: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:25:03.326881587Z [2024-04-06 03:25:03,326: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:25:03.330044701Z [2024-04-06 03:25:03,329: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:25:03.419011134Z [2024-04-06 03:25:03,418: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:25:03.424328961Z [2024-04-06 03:25:03,424: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:25:03.424353901Z [2024-04-06 03:25:03,424: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:25:03.424475705Z [2024-04-06 03:25:03,424: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:25:03.424485444Z [2024-04-06 03:25:03,424: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:25:03.424718403Z [2024-04-06 03:25:03,424: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:25:03.424759926Z [2024-04-06 03:25:03,424: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:25:03.573454932Z [2024-04-06 03:25:03,573: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:25:04.189474646Z [2024-04-06 03:25:04,189: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:25:04.192672284Z [2024-04-06 03:25:04,192: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:25:04.293622442Z [2024-04-06 03:25:04,292: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:25:04.312626898Z [2024-04-06 03:25:04,312: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:25:04.312690254Z [2024-04-06 03:25:04,312: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:25:04.313022599Z [2024-04-06 03:25:04,312: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:25:04.313039767Z [2024-04-06 03:25:04,312: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:25:04.314112359Z [2024-04-06 03:25:04,313: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:25:04.314166760Z [2024-04-06 03:25:04,314: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:25:04.371035501Z [2024-04-06 03:25:04,370: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7988d1a6-e75e-4d43-a2f7-a49591f55743] succeeded in 3.87960923799983s: None 2024-04-06T03:25:04.460071827Z [2024-04-06 03:25:04,459: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:25:04.503867901Z [2024-04-06 03:25:04,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a42ee5dc-2b5c-4f30-ba62-da7eb5857fcd] received 2024-04-06T03:25:04.531078952Z [2024-04-06 03:25:04,530: INFO/ForkPoolWorker-16] [a42ee5dc-2b5c-4f30-ba62-da7eb5857fcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:25:05.141465104Z [2024-04-06 03:25:05,138: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:25:05.500493732Z [2024-04-06 03:25:05,500: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4f89656-c84c-44a1-a17f-7ca36038e5d1] succeeded in 5.013988550999784s: None 2024-04-06T03:25:06.461739907Z [2024-04-06 03:25:06,461: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:25:06.465451761Z [2024-04-06 03:25:06,465: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:25:06.498863341Z [2024-04-06 03:25:06,498: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:25:06.501681074Z [2024-04-06 03:25:06,501: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:25:06.501915242Z [2024-04-06 03:25:06,501: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:25:06.502649833Z [2024-04-06 03:25:06,501: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:25:06.502824675Z [2024-04-06 03:25:06,502: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:25:06.503169242Z [2024-04-06 03:25:06,503: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:25:06.503349527Z [2024-04-06 03:25:06,503: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:25:06.550093932Z [2024-04-06 03:25:06,549: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f044b691-04b7-4880-a6a6-239b72be217b] succeeded in 6.0461594839998725s: None 2024-04-06T03:25:06.592653635Z [2024-04-06 03:25:06,592: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:25:07.153146881Z [2024-04-06 03:25:07,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c40a8e5e-dfeb-4239-840a-66e538f3969f] received 2024-04-06T03:25:07.162096597Z [2024-04-06 03:25:07,161: INFO/ForkPoolWorker-15] [c40a8e5e-dfeb-4239-840a-66e538f3969f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:25:07.229476757Z [2024-04-06 03:25:07,229: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a42ee5dc-2b5c-4f30-ba62-da7eb5857fcd] succeeded in 2.722904818000643s: None 2024-04-06T03:25:07.446323140Z [2024-04-06 03:25:07,443: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:25:08.595431961Z [2024-04-06 03:25:08,595: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:25:08.598482915Z [2024-04-06 03:25:08,598: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:25:08.651197153Z [2024-04-06 03:25:08,646: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:25:08.653176343Z [2024-04-06 03:25:08,652: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:25:08.653195854Z [2024-04-06 03:25:08,653: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:25:08.653199984Z [2024-04-06 03:25:08,653: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:25:08.653209608Z [2024-04-06 03:25:08,653: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:25:08.653589332Z [2024-04-06 03:25:08,653: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:25:08.653701777Z [2024-04-06 03:25:08,653: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:25:08.739705156Z [2024-04-06 03:25:08,739: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:25:10.363054010Z [2024-04-06 03:25:10,362: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c40a8e5e-dfeb-4239-840a-66e538f3969f] succeeded in 3.2076981160007563s: None 2024-04-06T03:25:10.574252854Z [2024-04-06 03:25:10,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9284663-9426-4369-b169-a7472d089ed9] received 2024-04-06T03:25:10.586915718Z [2024-04-06 03:25:10,586: INFO/ForkPoolWorker-15] [f9284663-9426-4369-b169-a7472d089ed9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:25:10.881629280Z [2024-04-06 03:25:10,878: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:25:12.139443665Z [2024-04-06 03:25:12,139: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:25:12.142526257Z [2024-04-06 03:25:12,142: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:25:12.169280232Z [2024-04-06 03:25:12,169: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:25:12.171433659Z [2024-04-06 03:25:12,171: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:25:12.171483117Z [2024-04-06 03:25:12,171: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:25:12.171602865Z [2024-04-06 03:25:12,171: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:25:12.171623501Z [2024-04-06 03:25:12,171: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:25:12.171840483Z [2024-04-06 03:25:12,171: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:25:12.171863835Z [2024-04-06 03:25:12,171: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:25:12.258711722Z [2024-04-06 03:25:12,258: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:25:12.907730698Z [2024-04-06 03:25:12,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9284663-9426-4369-b169-a7472d089ed9] succeeded in 2.3290401370004474s: None 2024-04-06T03:26:00.975907389Z [2024-04-06 03:26:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[776e3934-191c-44ed-83e1-166077263755] received 2024-04-06T03:26:00.984982085Z [2024-04-06 03:26:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[621181f3-e946-403f-b58d-a8025397f957] received 2024-04-06T03:26:01.000360844Z [2024-04-06 03:26:01,000: INFO/ForkPoolWorker-15] [776e3934-191c-44ed-83e1-166077263755] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:26:01.010704685Z [2024-04-06 03:26:01,010: INFO/ForkPoolWorker-16] [621181f3-e946-403f-b58d-a8025397f957] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:26:01.018812088Z [2024-04-06 03:26:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f4f76e4-cf00-4b60-8eae-bdca1bae787a] received 2024-04-06T03:26:01.042493923Z [2024-04-06 03:26:01,042: INFO/ForkPoolWorker-1] [2f4f76e4-cf00-4b60-8eae-bdca1bae787a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:26:01.507982900Z [2024-04-06 03:26:01,504: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:26:01.535824347Z [2024-04-06 03:26:01,531: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:26:01.568561907Z [2024-04-06 03:26:01,552: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:26:01.961372790Z [2024-04-06 03:26:01,961: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:26:03.213575965Z [2024-04-06 03:26:03,213: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:26:03.220931974Z [2024-04-06 03:26:03,220: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:26:03.231339587Z [2024-04-06 03:26:03,230: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:26:03.234849995Z [2024-04-06 03:26:03,234: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:26:03.267680943Z [2024-04-06 03:26:03,267: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:26:03.269564364Z [2024-04-06 03:26:03,269: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:26:03.269651321Z [2024-04-06 03:26:03,269: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:26:03.269850861Z [2024-04-06 03:26:03,269: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:26:03.272595246Z [2024-04-06 03:26:03,269: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:26:03.273390181Z [2024-04-06 03:26:03,272: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:26:03.273557971Z [2024-04-06 03:26:03,273: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:26:03.302403583Z [2024-04-06 03:26:03,302: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:26:03.308109230Z [2024-04-06 03:26:03,307: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:26:03.308249098Z [2024-04-06 03:26:03,308: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:26:03.308447421Z [2024-04-06 03:26:03,308: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:26:03.308566728Z [2024-04-06 03:26:03,308: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:26:03.309391263Z [2024-04-06 03:26:03,309: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:26:03.309452957Z [2024-04-06 03:26:03,309: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:26:03.430293601Z [2024-04-06 03:26:03,430: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:26:03.445371801Z [2024-04-06 03:26:03,444: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[776e3934-191c-44ed-83e1-166077263755] succeeded in 2.4659860120000303s: None 2024-04-06T03:26:03.459658391Z [2024-04-06 03:26:03,459: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:26:06.575592589Z [2024-04-06 03:26:06,574: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f4f76e4-cf00-4b60-8eae-bdca1bae787a] succeeded in 5.551519590999305s: None 2024-04-06T03:26:07.902634055Z [2024-04-06 03:26:07,901: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[621181f3-e946-403f-b58d-a8025397f957] succeeded in 6.914024709999467s: None 2024-04-06T03:26:39.015343437Z [2024-04-06 03:26:39,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[556e9042-525a-4ee3-8a0c-b2011e6e378c] received 2024-04-06T03:26:39.033041074Z [2024-04-06 03:26:39,032: INFO/ForkPoolWorker-15] [556e9042-525a-4ee3-8a0c-b2011e6e378c] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240406032638_492028', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-06T03:26:39.328862805Z [2024-04-06 03:26:39,325: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-06T03:26:39.640185249Z [2024-04-06 03:26:39,639: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:26:40.326407531Z [2024-04-06 03:26:40,326: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[556e9042-525a-4ee3-8a0c-b2011e6e378c] succeeded in 1.3073564110000007s: None 2024-04-06T03:27:00.375301925Z [2024-04-06 03:27:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c173b92d-7f41-47b8-a264-b1f37ed23eee] received 2024-04-06T03:27:00.381681751Z [2024-04-06 03:27:00,381: INFO/ForkPoolWorker-15] [c173b92d-7f41-47b8-a264-b1f37ed23eee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:27:00.386337350Z [2024-04-06 03:27:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d983c5a-ad4e-441e-b231-17cf98f5a254] received 2024-04-06T03:27:00.398807206Z [2024-04-06 03:27:00,398: INFO/ForkPoolWorker-16] [3d983c5a-ad4e-441e-b231-17cf98f5a254] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:27:00.649630151Z [2024-04-06 03:27:00,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:27:00.725220981Z [2024-04-06 03:27:00,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:27:02.012184215Z [2024-04-06 03:27:02,011: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:27:02.016294001Z [2024-04-06 03:27:02,015: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:27:02.022499088Z [2024-04-06 03:27:02,022: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:27:02.025891331Z [2024-04-06 03:27:02,025: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:27:02.069029396Z [2024-04-06 03:27:02,068: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:27:02.072128910Z [2024-04-06 03:27:02,071: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:27:02.072228573Z [2024-04-06 03:27:02,072: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:27:02.072412482Z [2024-04-06 03:27:02,072: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:27:02.072486286Z [2024-04-06 03:27:02,072: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:27:02.072763528Z [2024-04-06 03:27:02,072: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:27:02.073219783Z [2024-04-06 03:27:02,073: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:27:02.097082063Z [2024-04-06 03:27:02,096: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:27:02.102085090Z [2024-04-06 03:27:02,101: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:27:02.102115948Z [2024-04-06 03:27:02,101: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:27:02.102269815Z [2024-04-06 03:27:02,102: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:27:02.102316039Z [2024-04-06 03:27:02,102: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:27:02.102604388Z [2024-04-06 03:27:02,102: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:27:02.102643652Z [2024-04-06 03:27:02,102: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:27:02.183218998Z [2024-04-06 03:27:02,182: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:27:02.294689286Z [2024-04-06 03:27:02,294: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:27:04.401210283Z [2024-04-06 03:27:04,400: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d983c5a-ad4e-441e-b231-17cf98f5a254] succeeded in 4.01247460400009s: None 2024-04-06T03:27:05.034201591Z [2024-04-06 03:27:05,033: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c173b92d-7f41-47b8-a264-b1f37ed23eee] succeeded in 4.657401026999651s: None 2024-04-06T03:28:00.294346862Z [2024-04-06 03:28:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed8ef454-c012-45ec-90b1-8af2606e3f90] received 2024-04-06T03:28:00.309004494Z [2024-04-06 03:28:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a223a8d9-a42d-460b-8c41-bd2c519a7054] received 2024-04-06T03:28:00.309605765Z [2024-04-06 03:28:00,309: INFO/ForkPoolWorker-15] [ed8ef454-c012-45ec-90b1-8af2606e3f90] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:28:00.311724905Z [2024-04-06 03:28:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26f18761-15ea-4a7c-9f50-90e4b30ab790] received 2024-04-06T03:28:00.320559847Z [2024-04-06 03:28:00,319: INFO/ForkPoolWorker-16] [a223a8d9-a42d-460b-8c41-bd2c519a7054] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:28:00.326666392Z [2024-04-06 03:28:00,326: INFO/ForkPoolWorker-1] [26f18761-15ea-4a7c-9f50-90e4b30ab790] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:28:00.620992384Z [2024-04-06 03:28:00,616: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:28:00.640713123Z [2024-04-06 03:28:00,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:28:00.789015186Z [2024-04-06 03:28:00,779: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:28:01.009949970Z [2024-04-06 03:28:01,009: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:28:01.894423124Z [2024-04-06 03:28:01,894: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed8ef454-c012-45ec-90b1-8af2606e3f90] succeeded in 1.5962151639996591s: None 2024-04-06T03:28:02.912745089Z [2024-04-06 03:28:02,912: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:28:02.918463414Z [2024-04-06 03:28:02,917: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:28:02.992034889Z [2024-04-06 03:28:02,991: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:28:02.993196618Z [2024-04-06 03:28:02,993: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:28:02.993402404Z [2024-04-06 03:28:02,993: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:28:02.993678871Z [2024-04-06 03:28:02,993: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:28:02.994355356Z [2024-04-06 03:28:02,994: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:28:02.994766393Z [2024-04-06 03:28:02,994: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:28:02.995025831Z [2024-04-06 03:28:02,994: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:28:03.123633331Z [2024-04-06 03:28:03,123: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:28:03.127240925Z [2024-04-06 03:28:03,126: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:28:03.210298775Z [2024-04-06 03:28:03,210: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:28:03.214330174Z [2024-04-06 03:28:03,214: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:28:03.214583468Z [2024-04-06 03:28:03,214: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:28:03.214803102Z [2024-04-06 03:28:03,214: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:28:03.214948708Z [2024-04-06 03:28:03,214: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:28:03.215247508Z [2024-04-06 03:28:03,215: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:28:03.217558805Z [2024-04-06 03:28:03,217: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:28:03.346296616Z [2024-04-06 03:28:03,346: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:28:03.346345705Z [2024-04-06 03:28:03,346: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:28:05.724063111Z [2024-04-06 03:28:05,723: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a223a8d9-a42d-460b-8c41-bd2c519a7054] succeeded in 5.413141073000588s: None 2024-04-06T03:28:06.051802414Z [2024-04-06 03:28:06,051: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26f18761-15ea-4a7c-9f50-90e4b30ab790] succeeded in 5.735651942999539s: None 2024-04-06T03:29:00.322962672Z [2024-04-06 03:29:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e894e49-a102-4a12-9bbb-02897459852e] received 2024-04-06T03:29:00.327963251Z [2024-04-06 03:29:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34c5a19c-9413-4dd9-ac26-703feafeffe2] received 2024-04-06T03:29:00.341302669Z [2024-04-06 03:29:00,340: INFO/ForkPoolWorker-16] [34c5a19c-9413-4dd9-ac26-703feafeffe2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:29:00.346842001Z [2024-04-06 03:29:00,346: INFO/ForkPoolWorker-15] [0e894e49-a102-4a12-9bbb-02897459852e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:29:00.615494745Z [2024-04-06 03:29:00,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:29:00.661769491Z [2024-04-06 03:29:00,658: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:29:01.963716083Z [2024-04-06 03:29:01,963: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:29:01.967925913Z [2024-04-06 03:29:01,967: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:29:02.008402661Z [2024-04-06 03:29:02,008: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:29:02.009591332Z [2024-04-06 03:29:02,009: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:29:02.009745398Z [2024-04-06 03:29:02,009: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:29:02.009990498Z [2024-04-06 03:29:02,009: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:29:02.010119615Z [2024-04-06 03:29:02,009: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:29:02.010565185Z [2024-04-06 03:29:02,010: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:29:02.010697026Z [2024-04-06 03:29:02,010: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:29:02.118735815Z [2024-04-06 03:29:02,118: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:29:02.155068756Z [2024-04-06 03:29:02,154: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:29:02.164551005Z [2024-04-06 03:29:02,160: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:29:02.267220324Z [2024-04-06 03:29:02,266: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:29:02.268593498Z [2024-04-06 03:29:02,268: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:29:02.270272301Z [2024-04-06 03:29:02,268: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:29:02.270511699Z [2024-04-06 03:29:02,270: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:29:02.271181904Z [2024-04-06 03:29:02,271: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:29:02.271934488Z [2024-04-06 03:29:02,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:29:02.271944357Z [2024-04-06 03:29:02,271: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:29:02.376791033Z [2024-04-06 03:29:02,376: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:29:03.729433708Z [2024-04-06 03:29:03,728: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[34c5a19c-9413-4dd9-ac26-703feafeffe2] succeeded in 3.3974841999997807s: None 2024-04-06T03:29:05.100985756Z [2024-04-06 03:29:05,100: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e894e49-a102-4a12-9bbb-02897459852e] succeeded in 4.770634688000428s: None 2024-04-06T03:30:00.555446758Z [2024-04-06 03:30:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4410b79f-aaa7-4371-a51c-b20b65bdf2e3] received 2024-04-06T03:30:00.558344318Z [2024-04-06 03:30:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6561ced-ced3-41f7-a432-2102aa852097] received 2024-04-06T03:30:00.561878944Z [2024-04-06 03:30:00,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f046b3e3-1180-4ba8-b9b0-505d9d76d026] received 2024-04-06T03:30:00.565732929Z [2024-04-06 03:30:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba1804ab-d577-4c8c-bc19-f93e88b038f4] received 2024-04-06T03:30:00.566704725Z [2024-04-06 03:30:00,566: INFO/ForkPoolWorker-15] [4410b79f-aaa7-4371-a51c-b20b65bdf2e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:30:00.570143930Z [2024-04-06 03:30:00,569: INFO/ForkPoolWorker-1] [f046b3e3-1180-4ba8-b9b0-505d9d76d026] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:30:00.580787641Z [2024-04-06 03:30:00,580: INFO/ForkPoolWorker-16] [b6561ced-ced3-41f7-a432-2102aa852097] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:30:00.581946487Z [2024-04-06 03:30:00,581: INFO/ForkPoolWorker-2] [ba1804ab-d577-4c8c-bc19-f93e88b038f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:30:00.958062923Z [2024-04-06 03:30:00,946: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:30:01.073177345Z [2024-04-06 03:30:01,070: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:30:01.174714900Z [2024-04-06 03:30:01,169: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:30:01.221181375Z [2024-04-06 03:30:01,217: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:30:01.481909493Z [2024-04-06 03:30:01,481: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:30:02.392860632Z [2024-04-06 03:30:02,392: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ba1804ab-d577-4c8c-bc19-f93e88b038f4] succeeded in 1.8202196649999678s: None 2024-04-06T03:30:03.007853342Z [2024-04-06 03:30:03,007: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:30:03.011169515Z [2024-04-06 03:30:03,010: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:30:03.042527510Z [2024-04-06 03:30:03,042: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:30:03.043701591Z [2024-04-06 03:30:03,043: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:30:03.043795000Z [2024-04-06 03:30:03,043: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:30:03.043926285Z [2024-04-06 03:30:03,043: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:30:03.044004554Z [2024-04-06 03:30:03,043: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:30:03.044231767Z [2024-04-06 03:30:03,044: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:30:03.044306656Z [2024-04-06 03:30:03,044: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:30:03.173147947Z [2024-04-06 03:30:03,172: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:30:03.601061401Z [2024-04-06 03:30:03,600: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:30:03.604869520Z [2024-04-06 03:30:03,604: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:30:03.652140872Z [2024-04-06 03:30:03,651: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:30:03.654993908Z [2024-04-06 03:30:03,654: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:30:03.655636958Z [2024-04-06 03:30:03,655: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:30:03.655837730Z [2024-04-06 03:30:03,655: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:30:03.655961505Z [2024-04-06 03:30:03,655: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:30:03.656293389Z [2024-04-06 03:30:03,656: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:30:03.656841423Z [2024-04-06 03:30:03,656: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:30:03.805778252Z [2024-04-06 03:30:03,805: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:30:03.809394589Z [2024-04-06 03:30:03,809: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:30:03.822623711Z [2024-04-06 03:30:03,822: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:30:03.869924209Z [2024-04-06 03:30:03,869: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:30:03.871742945Z [2024-04-06 03:30:03,871: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:30:03.871759777Z [2024-04-06 03:30:03,871: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:30:03.871880416Z [2024-04-06 03:30:03,871: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:30:03.871894989Z [2024-04-06 03:30:03,871: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:30:03.872121591Z [2024-04-06 03:30:03,872: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:30:03.872132999Z [2024-04-06 03:30:03,872: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:30:03.978791676Z [2024-04-06 03:30:03,978: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:30:04.840912580Z [2024-04-06 03:30:04,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4410b79f-aaa7-4371-a51c-b20b65bdf2e3] succeeded in 4.280945390999477s: None 2024-04-06T03:30:04.862290944Z [2024-04-06 03:30:04,861: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f046b3e3-1180-4ba8-b9b0-505d9d76d026] succeeded in 4.300073913000233s: None 2024-04-06T03:30:05.057932624Z [2024-04-06 03:30:05,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1ba0902-b3d5-4d12-a205-dc1dfa5829d5] received 2024-04-06T03:30:05.072283690Z [2024-04-06 03:30:05,072: INFO/ForkPoolWorker-15] [d1ba0902-b3d5-4d12-a205-dc1dfa5829d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:30:05.401746685Z [2024-04-06 03:30:05,397: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:30:06.201593817Z [2024-04-06 03:30:06,201: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6561ced-ced3-41f7-a432-2102aa852097] succeeded in 5.640899029999673s: None 2024-04-06T03:30:06.638627598Z [2024-04-06 03:30:06,638: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:30:06.641583108Z [2024-04-06 03:30:06,641: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:30:06.680821488Z [2024-04-06 03:30:06,680: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:30:06.682167288Z [2024-04-06 03:30:06,681: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:30:06.682224621Z [2024-04-06 03:30:06,682: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:30:06.685514795Z [2024-04-06 03:30:06,684: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:30:06.685585640Z [2024-04-06 03:30:06,685: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:30:06.687820097Z [2024-04-06 03:30:06,685: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:30:06.688560752Z [2024-04-06 03:30:06,688: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:30:06.794574015Z [2024-04-06 03:30:06,794: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:30:07.464201086Z [2024-04-06 03:30:07,463: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1ba0902-b3d5-4d12-a205-dc1dfa5829d5] succeeded in 2.404676405999453s: None 2024-04-06T03:30:07.687960575Z [2024-04-06 03:30:07,687: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d115775-026f-4177-ab4a-be688ab01772] received 2024-04-06T03:30:07.696953814Z [2024-04-06 03:30:07,696: INFO/ForkPoolWorker-15] [6d115775-026f-4177-ab4a-be688ab01772] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:30:07.961210855Z [2024-04-06 03:30:07,957: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:30:09.342377592Z [2024-04-06 03:30:09,342: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:30:09.345538686Z [2024-04-06 03:30:09,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:30:09.387454599Z [2024-04-06 03:30:09,386: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:30:09.393305908Z [2024-04-06 03:30:09,393: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:30:09.393413066Z [2024-04-06 03:30:09,393: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:30:09.393559017Z [2024-04-06 03:30:09,393: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:30:09.393610412Z [2024-04-06 03:30:09,393: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:30:09.393915105Z [2024-04-06 03:30:09,393: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:30:09.395680730Z [2024-04-06 03:30:09,393: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:30:09.519064761Z [2024-04-06 03:30:09,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:30:11.285977656Z [2024-04-06 03:30:11,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d115775-026f-4177-ab4a-be688ab01772] succeeded in 3.595484143000249s: None 2024-04-06T03:30:11.527014276Z [2024-04-06 03:30:11,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4ee5147-331c-4a3d-91a4-bef384e53c00] received 2024-04-06T03:30:11.533072027Z [2024-04-06 03:30:11,532: INFO/ForkPoolWorker-15] [e4ee5147-331c-4a3d-91a4-bef384e53c00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:30:11.811100429Z [2024-04-06 03:30:11,808: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:30:13.075600621Z [2024-04-06 03:30:13,075: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:30:13.078650503Z [2024-04-06 03:30:13,078: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:30:13.106256229Z [2024-04-06 03:30:13,105: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:30:13.107881239Z [2024-04-06 03:30:13,107: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:30:13.107934985Z [2024-04-06 03:30:13,107: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:30:13.108824621Z [2024-04-06 03:30:13,107: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:30:13.109139547Z [2024-04-06 03:30:13,108: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:30:13.109966270Z [2024-04-06 03:30:13,109: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:30:13.110516602Z [2024-04-06 03:30:13,110: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:30:13.194644012Z [2024-04-06 03:30:13,194: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:30:13.755158157Z [2024-04-06 03:30:13,754: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4ee5147-331c-4a3d-91a4-bef384e53c00] succeeded in 2.226376199999322s: None 2024-04-06T03:31:00.924191262Z [2024-04-06 03:31:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3db3e3a1-b9c3-4439-9d79-6cc5ac8f1590] received 2024-04-06T03:31:00.932039543Z [2024-04-06 03:31:00,931: INFO/ForkPoolWorker-15] [3db3e3a1-b9c3-4439-9d79-6cc5ac8f1590] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:31:00.941948606Z [2024-04-06 03:31:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2000b87-dbde-4b23-920e-dca88976506b] received 2024-04-06T03:31:00.969178455Z [2024-04-06 03:31:00,966: INFO/ForkPoolWorker-16] [b2000b87-dbde-4b23-920e-dca88976506b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:31:01.293075839Z [2024-04-06 03:31:01,289: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:31:01.413783859Z [2024-04-06 03:31:01,408: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:31:02.644866652Z [2024-04-06 03:31:02,644: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:31:02.647894361Z [2024-04-06 03:31:02,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:31:02.724559019Z [2024-04-06 03:31:02,724: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:31:02.725683282Z [2024-04-06 03:31:02,725: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:31:02.728512199Z [2024-04-06 03:31:02,725: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:31:02.729693733Z [2024-04-06 03:31:02,728: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:31:02.733295490Z [2024-04-06 03:31:02,729: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:31:02.733614908Z [2024-04-06 03:31:02,733: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:31:02.734215678Z [2024-04-06 03:31:02,733: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:31:02.793609779Z [2024-04-06 03:31:02,793: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:31:02.800649250Z [2024-04-06 03:31:02,800: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:31:02.833371472Z [2024-04-06 03:31:02,833: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:31:02.836819539Z [2024-04-06 03:31:02,836: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:31:02.836901343Z [2024-04-06 03:31:02,836: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:31:02.837104679Z [2024-04-06 03:31:02,836: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:31:02.837187232Z [2024-04-06 03:31:02,837: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:31:02.838256647Z [2024-04-06 03:31:02,838: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:31:02.839449165Z [2024-04-06 03:31:02,837: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:31:02.842209176Z [2024-04-06 03:31:02,841: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:31:02.963265700Z [2024-04-06 03:31:02,963: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:31:04.748822107Z [2024-04-06 03:31:04,748: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3db3e3a1-b9c3-4439-9d79-6cc5ac8f1590] succeeded in 3.8218117790001997s: None 2024-04-06T03:31:05.392561790Z [2024-04-06 03:31:05,392: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2000b87-dbde-4b23-920e-dca88976506b] succeeded in 4.448045465999712s: None 2024-04-06T03:32:00.250951994Z [2024-04-06 03:32:00,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e07df300-7470-4db9-9fbd-95c3208bc87d] received 2024-04-06T03:32:00.252503174Z [2024-04-06 03:32:00,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[081ed6c2-a0e9-4b19-b5dd-e13b52a5f79a] received 2024-04-06T03:32:00.256681206Z [2024-04-06 03:32:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63ed4c6f-5747-44e4-8ea5-f38967158566] received 2024-04-06T03:32:00.266791143Z [2024-04-06 03:32:00,266: INFO/ForkPoolWorker-15] [e07df300-7470-4db9-9fbd-95c3208bc87d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:32:00.276013289Z [2024-04-06 03:32:00,275: INFO/ForkPoolWorker-1] [63ed4c6f-5747-44e4-8ea5-f38967158566] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:32:00.276702477Z [2024-04-06 03:32:00,276: INFO/ForkPoolWorker-16] [081ed6c2-a0e9-4b19-b5dd-e13b52a5f79a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:32:00.564502452Z [2024-04-06 03:32:00,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:32:00.591492138Z [2024-04-06 03:32:00,587: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:32:00.605452490Z [2024-04-06 03:32:00,600: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:32:00.939537849Z [2024-04-06 03:32:00,939: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:32:01.745492266Z [2024-04-06 03:32:01,740: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[63ed4c6f-5747-44e4-8ea5-f38967158566] succeeded in 1.4809542249995502s: None 2024-04-06T03:32:02.156725428Z [2024-04-06 03:32:02,156: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:32:02.161987398Z [2024-04-06 03:32:02,161: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:32:02.237259614Z [2024-04-06 03:32:02,225: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:32:02.237279912Z [2024-04-06 03:32:02,227: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:32:02.237283694Z [2024-04-06 03:32:02,227: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:32:02.237287272Z [2024-04-06 03:32:02,227: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:32:02.237291365Z [2024-04-06 03:32:02,227: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:32:02.237294435Z [2024-04-06 03:32:02,227: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:32:02.237297449Z [2024-04-06 03:32:02,227: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:32:02.265926605Z [2024-04-06 03:32:02,263: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:32:02.267639065Z [2024-04-06 03:32:02,267: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:32:02.336831759Z [2024-04-06 03:32:02,336: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:32:02.341658823Z [2024-04-06 03:32:02,341: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:32:02.341885606Z [2024-04-06 03:32:02,341: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:32:02.342070600Z [2024-04-06 03:32:02,341: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:32:02.342160609Z [2024-04-06 03:32:02,342: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:32:02.342399503Z [2024-04-06 03:32:02,342: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:32:02.342505095Z [2024-04-06 03:32:02,342: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:32:02.377716744Z [2024-04-06 03:32:02,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:32:02.504769171Z [2024-04-06 03:32:02,504: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:32:04.200098190Z [2024-04-06 03:32:04,199: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e07df300-7470-4db9-9fbd-95c3208bc87d] succeeded in 3.9428628200003004s: None 2024-04-06T03:32:04.922933389Z [2024-04-06 03:32:04,921: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[081ed6c2-a0e9-4b19-b5dd-e13b52a5f79a] succeeded in 4.666748781000024s: None 2024-04-06T03:32:39.058677363Z [2024-04-06 03:32:39,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4670d40-3cb2-44ab-83ae-65f79c529593] received 2024-04-06T03:32:39.075697102Z [2024-04-06 03:32:39,075: INFO/ForkPoolWorker-15] [e4670d40-3cb2-44ab-83ae-65f79c529593] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240406033238_630310', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-06T03:32:39.370566696Z [2024-04-06 03:32:39,366: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-06T03:32:39.720823738Z [2024-04-06 03:32:39,720: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:32:40.308236294Z [2024-04-06 03:32:40,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4670d40-3cb2-44ab-83ae-65f79c529593] succeeded in 1.245245211999645s: None 2024-04-06T03:33:00.630474390Z [2024-04-06 03:33:00,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a421e4c2-e484-4dbd-af9c-2da6dcb5d860] received 2024-04-06T03:33:00.636586639Z [2024-04-06 03:33:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fd34087-a7ec-4c01-a9bf-7b33fbc6f57a] received 2024-04-06T03:33:00.639226533Z [2024-04-06 03:33:00,638: INFO/ForkPoolWorker-15] [a421e4c2-e484-4dbd-af9c-2da6dcb5d860] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:33:00.648873211Z [2024-04-06 03:33:00,645: INFO/ForkPoolWorker-16] [8fd34087-a7ec-4c01-a9bf-7b33fbc6f57a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:33:00.932731073Z [2024-04-06 03:33:00,929: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:33:00.972758405Z [2024-04-06 03:33:00,969: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:33:02.228817050Z [2024-04-06 03:33:02,228: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:33:02.242423949Z [2024-04-06 03:33:02,238: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:33:02.343334651Z [2024-04-06 03:33:02,343: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:33:02.344942855Z [2024-04-06 03:33:02,344: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:33:02.344959351Z [2024-04-06 03:33:02,344: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:33:02.345104408Z [2024-04-06 03:33:02,344: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:33:02.345154609Z [2024-04-06 03:33:02,345: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:33:02.345795042Z [2024-04-06 03:33:02,345: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:33:02.346480047Z [2024-04-06 03:33:02,345: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:33:02.377466483Z [2024-04-06 03:33:02,377: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:33:02.380856262Z [2024-04-06 03:33:02,380: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:33:02.407369505Z [2024-04-06 03:33:02,407: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:33:02.408435569Z [2024-04-06 03:33:02,408: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:33:02.408555417Z [2024-04-06 03:33:02,408: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:33:02.408738584Z [2024-04-06 03:33:02,408: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:33:02.408834927Z [2024-04-06 03:33:02,408: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:33:02.409065499Z [2024-04-06 03:33:02,408: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:33:02.409493023Z [2024-04-06 03:33:02,409: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:33:02.491276917Z [2024-04-06 03:33:02,490: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:33:02.491847723Z [2024-04-06 03:33:02,491: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:33:04.149129796Z [2024-04-06 03:33:04,148: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a421e4c2-e484-4dbd-af9c-2da6dcb5d860] succeeded in 3.5166556389995094s: None 2024-04-06T03:33:04.415605874Z [2024-04-06 03:33:04,415: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8fd34087-a7ec-4c01-a9bf-7b33fbc6f57a] succeeded in 3.7775370030003614s: None 2024-04-06T03:34:00.592373172Z [2024-04-06 03:34:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e304ed2e-cc0c-41a0-8fcf-19ab22abe474] received 2024-04-06T03:34:00.595981514Z [2024-04-06 03:34:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be15744a-4b78-4522-a2ee-4ea644a709a3] received 2024-04-06T03:34:00.598168776Z [2024-04-06 03:34:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b2fd097-4d1f-40f6-8931-9860eaeeb135] received 2024-04-06T03:34:00.601435776Z [2024-04-06 03:34:00,601: INFO/ForkPoolWorker-15] [e304ed2e-cc0c-41a0-8fcf-19ab22abe474] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:34:00.615285963Z [2024-04-06 03:34:00,614: INFO/ForkPoolWorker-16] [be15744a-4b78-4522-a2ee-4ea644a709a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:34:00.616473086Z [2024-04-06 03:34:00,616: INFO/ForkPoolWorker-1] [7b2fd097-4d1f-40f6-8931-9860eaeeb135] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:34:00.932338914Z [2024-04-06 03:34:00,927: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:34:01.198075082Z [2024-04-06 03:34:01,187: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:34:01.270131106Z [2024-04-06 03:34:01,269: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:34:01.305910881Z [2024-04-06 03:34:01,302: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:34:02.013999212Z [2024-04-06 03:34:02,013: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e304ed2e-cc0c-41a0-8fcf-19ab22abe474] succeeded in 1.4191788759999326s: None 2024-04-06T03:34:02.759830688Z [2024-04-06 03:34:02,759: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:34:02.763567898Z [2024-04-06 03:34:02,763: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:34:02.801000751Z [2024-04-06 03:34:02,800: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:34:02.802439565Z [2024-04-06 03:34:02,802: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:34:02.802451552Z [2024-04-06 03:34:02,802: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:34:02.802587391Z [2024-04-06 03:34:02,802: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:34:02.802655224Z [2024-04-06 03:34:02,802: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:34:02.803035602Z [2024-04-06 03:34:02,802: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:34:02.803044110Z [2024-04-06 03:34:02,802: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:34:02.935750240Z [2024-04-06 03:34:02,935: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:34:02.939755182Z [2024-04-06 03:34:02,939: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:34:02.971585783Z [2024-04-06 03:34:02,971: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:34:02.984165581Z [2024-04-06 03:34:02,983: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:34:02.985361843Z [2024-04-06 03:34:02,985: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:34:02.985488536Z [2024-04-06 03:34:02,985: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:34:02.985840829Z [2024-04-06 03:34:02,985: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:34:02.985979386Z [2024-04-06 03:34:02,985: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:34:02.986248859Z [2024-04-06 03:34:02,986: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:34:02.986728429Z [2024-04-06 03:34:02,986: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:34:03.134017027Z [2024-04-06 03:34:03,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:34:04.712124576Z [2024-04-06 03:34:04,711: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7b2fd097-4d1f-40f6-8931-9860eaeeb135] succeeded in 4.110534817000371s: None 2024-04-06T03:34:05.485740605Z [2024-04-06 03:34:05,485: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be15744a-4b78-4522-a2ee-4ea644a709a3] succeeded in 4.887458706999496s: None 2024-04-06T03:34:39.641218253Z [2024-04-06 03:34:39,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbf19e44-9506-40ae-8fa8-719631c1cf8b] received 2024-04-06T03:34:39.675204602Z [2024-04-06 03:34:39,674: INFO/ForkPoolWorker-15] [dbf19e44-9506-40ae-8fa8-719631c1cf8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240406033438_213091', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-06T03:34:39.943327543Z [2024-04-06 03:34:39,940: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-06T03:34:40.291670620Z [2024-04-06 03:34:40,291: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:34:40.935938624Z [2024-04-06 03:34:40,935: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dbf19e44-9506-40ae-8fa8-719631c1cf8b] succeeded in 1.2828183669998907s: None 2024-04-06T03:35:01.098455116Z [2024-04-06 03:35:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[104bc87f-2225-40ce-941f-8bcfec2e64d4] received 2024-04-06T03:35:01.114718955Z [2024-04-06 03:35:01,114: INFO/ForkPoolWorker-15] [104bc87f-2225-40ce-941f-8bcfec2e64d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:35:01.126403292Z [2024-04-06 03:35:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ec68868-1b2b-495b-ac0b-332436e2b9eb] received 2024-04-06T03:35:01.137806833Z [2024-04-06 03:35:01,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[653a4ec6-111f-400c-98cb-ad882cc48144] received 2024-04-06T03:35:01.162554755Z [2024-04-06 03:35:01,162: INFO/ForkPoolWorker-16] [2ec68868-1b2b-495b-ac0b-332436e2b9eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:35:01.168048891Z [2024-04-06 03:35:01,167: INFO/ForkPoolWorker-1] [653a4ec6-111f-400c-98cb-ad882cc48144] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:35:01.502013426Z [2024-04-06 03:35:01,497: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:35:01.630638368Z [2024-04-06 03:35:01,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:35:01.749305600Z [2024-04-06 03:35:01,745: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:35:03.395290211Z [2024-04-06 03:35:03,394: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:35:03.398652796Z [2024-04-06 03:35:03,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:35:03.449510467Z [2024-04-06 03:35:03,449: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:35:03.461410237Z [2024-04-06 03:35:03,461: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:35:03.461533146Z [2024-04-06 03:35:03,461: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:35:03.461709645Z [2024-04-06 03:35:03,461: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:35:03.461881387Z [2024-04-06 03:35:03,461: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:35:03.462691217Z [2024-04-06 03:35:03,462: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:35:03.464524166Z [2024-04-06 03:35:03,464: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:35:03.586042776Z [2024-04-06 03:35:03,585: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:35:03.589092013Z [2024-04-06 03:35:03,588: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:35:03.600319701Z [2024-04-06 03:35:03,600: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:35:03.631105227Z [2024-04-06 03:35:03,630: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:35:03.635819272Z [2024-04-06 03:35:03,635: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:35:03.635841875Z [2024-04-06 03:35:03,635: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:35:03.635969462Z [2024-04-06 03:35:03,635: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:35:03.635980900Z [2024-04-06 03:35:03,635: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:35:03.636316729Z [2024-04-06 03:35:03,636: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:35:03.636326479Z [2024-04-06 03:35:03,636: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:35:03.954232117Z [2024-04-06 03:35:03,953: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:35:04.630154836Z [2024-04-06 03:35:04,629: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:35:04.635133645Z [2024-04-06 03:35:04,634: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:35:04.718741821Z [2024-04-06 03:35:04,718: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:35:04.726393707Z [2024-04-06 03:35:04,726: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:35:04.726559895Z [2024-04-06 03:35:04,726: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:35:04.726800243Z [2024-04-06 03:35:04,726: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:35:04.726910145Z [2024-04-06 03:35:04,726: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:35:04.727214257Z [2024-04-06 03:35:04,727: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:35:04.727314654Z [2024-04-06 03:35:04,727: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:35:04.865931612Z [2024-04-06 03:35:04,865: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:35:05.518001237Z [2024-04-06 03:35:05,517: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ec68868-1b2b-495b-ac0b-332436e2b9eb] succeeded in 4.38771138500033s: None 2024-04-06T03:35:05.898675464Z [2024-04-06 03:35:05,898: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[104bc87f-2225-40ce-941f-8bcfec2e64d4] succeeded in 4.796680435000781s: None 2024-04-06T03:35:06.304598442Z [2024-04-06 03:35:06,303: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[653a4ec6-111f-400c-98cb-ad882cc48144] succeeded in 5.163973276999968s: None 2024-04-06T03:35:06.532157944Z [2024-04-06 03:35:06,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f65c9f0-45db-491f-9507-178b0413b681] received 2024-04-06T03:35:06.546811385Z [2024-04-06 03:35:06,546: INFO/ForkPoolWorker-15] [6f65c9f0-45db-491f-9507-178b0413b681] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:35:06.800955036Z [2024-04-06 03:35:06,798: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:35:07.824813481Z [2024-04-06 03:35:07,824: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:35:07.827824216Z [2024-04-06 03:35:07,827: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:35:07.860507879Z [2024-04-06 03:35:07,860: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:35:07.861565046Z [2024-04-06 03:35:07,861: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:35:07.861730555Z [2024-04-06 03:35:07,861: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:35:07.862020769Z [2024-04-06 03:35:07,861: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:35:07.862188171Z [2024-04-06 03:35:07,861: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:35:07.862530235Z [2024-04-06 03:35:07,862: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:35:07.862692314Z [2024-04-06 03:35:07,862: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:35:07.948480041Z [2024-04-06 03:35:07,947: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:35:08.696865705Z [2024-04-06 03:35:08,694: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f65c9f0-45db-491f-9507-178b0413b681] succeeded in 2.160639053999148s: None 2024-04-06T03:35:09.192515408Z [2024-04-06 03:35:09,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da77345f-ee57-4754-894c-9889dcd259b4] received 2024-04-06T03:35:09.209778834Z [2024-04-06 03:35:09,203: INFO/ForkPoolWorker-15] [da77345f-ee57-4754-894c-9889dcd259b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:35:09.528306925Z [2024-04-06 03:35:09,525: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:35:10.679832411Z [2024-04-06 03:35:10,679: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:35:10.682879054Z [2024-04-06 03:35:10,682: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:35:10.736270538Z [2024-04-06 03:35:10,736: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:35:10.741943657Z [2024-04-06 03:35:10,738: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:35:10.741961178Z [2024-04-06 03:35:10,739: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:35:10.741966974Z [2024-04-06 03:35:10,739: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:35:10.741970361Z [2024-04-06 03:35:10,739: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:35:10.741973410Z [2024-04-06 03:35:10,739: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:35:10.741976616Z [2024-04-06 03:35:10,739: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:35:10.885600267Z [2024-04-06 03:35:10,885: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:35:12.271676921Z [2024-04-06 03:35:12,271: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da77345f-ee57-4754-894c-9889dcd259b4] succeeded in 3.079647630999716s: None 2024-04-06T03:35:13.170758331Z [2024-04-06 03:35:13,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7e4be1d-2bff-4e97-8d99-c800b1eeb347] received 2024-04-06T03:35:13.184630765Z [2024-04-06 03:35:13,184: INFO/ForkPoolWorker-15] [d7e4be1d-2bff-4e97-8d99-c800b1eeb347] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:35:13.479956172Z [2024-04-06 03:35:13,476: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:35:14.563913598Z [2024-04-06 03:35:14,563: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:35:14.566860079Z [2024-04-06 03:35:14,566: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:35:14.591712967Z [2024-04-06 03:35:14,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:35:14.593230524Z [2024-04-06 03:35:14,592: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:35:14.593320322Z [2024-04-06 03:35:14,593: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:35:14.593523510Z [2024-04-06 03:35:14,593: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:35:14.593756834Z [2024-04-06 03:35:14,593: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:35:14.594435859Z [2024-04-06 03:35:14,594: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:35:14.594627562Z [2024-04-06 03:35:14,594: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:35:14.694151376Z [2024-04-06 03:35:14,693: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:35:15.267455723Z [2024-04-06 03:35:15,266: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7e4be1d-2bff-4e97-8d99-c800b1eeb347] succeeded in 2.0933774729992365s: None 2024-04-06T03:36:00.342345879Z [2024-04-06 03:36:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e2d76b7-63d5-4ff0-ad85-9c7280faab9e] received 2024-04-06T03:36:00.344853681Z [2024-04-06 03:36:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb3635fa-3bd5-4ee6-b064-ff08033f3011] received 2024-04-06T03:36:00.357760866Z [2024-04-06 03:36:00,357: INFO/ForkPoolWorker-15] [1e2d76b7-63d5-4ff0-ad85-9c7280faab9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:36:00.359128014Z [2024-04-06 03:36:00,358: INFO/ForkPoolWorker-16] [cb3635fa-3bd5-4ee6-b064-ff08033f3011] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:36:00.369594994Z [2024-04-06 03:36:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76c66231-9c2a-4dc9-92df-fed21087662f] received 2024-04-06T03:36:00.378056509Z [2024-04-06 03:36:00,377: INFO/ForkPoolWorker-1] [76c66231-9c2a-4dc9-92df-fed21087662f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:36:00.646834823Z [2024-04-06 03:36:00,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:36:00.684729565Z [2024-04-06 03:36:00,680: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:36:00.725924032Z [2024-04-06 03:36:00,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:36:00.918488332Z [2024-04-06 03:36:00,918: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:36:02.037846184Z [2024-04-06 03:36:02,037: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e2d76b7-63d5-4ff0-ad85-9c7280faab9e] succeeded in 1.6872667970001203s: None 2024-04-06T03:36:03.147319456Z [2024-04-06 03:36:03,146: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:36:03.153016704Z [2024-04-06 03:36:03,152: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:36:03.195815605Z [2024-04-06 03:36:03,195: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:36:03.197483963Z [2024-04-06 03:36:03,197: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:36:03.197504709Z [2024-04-06 03:36:03,197: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:36:03.197807383Z [2024-04-06 03:36:03,197: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:36:03.197974093Z [2024-04-06 03:36:03,197: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:36:03.198260714Z [2024-04-06 03:36:03,198: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:36:03.198359404Z [2024-04-06 03:36:03,198: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:36:03.326715924Z [2024-04-06 03:36:03,326: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:36:03.808631822Z [2024-04-06 03:36:03,808: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:36:03.818761837Z [2024-04-06 03:36:03,818: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:36:03.910269473Z [2024-04-06 03:36:03,907: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:36:03.918757260Z [2024-04-06 03:36:03,918: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:36:03.919065551Z [2024-04-06 03:36:03,918: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:36:03.919263036Z [2024-04-06 03:36:03,919: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:36:03.919381097Z [2024-04-06 03:36:03,919: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:36:03.919701448Z [2024-04-06 03:36:03,919: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:36:03.919850033Z [2024-04-06 03:36:03,919: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:36:04.078035210Z [2024-04-06 03:36:04,077: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:36:06.712844196Z [2024-04-06 03:36:06,712: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb3635fa-3bd5-4ee6-b064-ff08033f3011] succeeded in 6.364626616000351s: None 2024-04-06T03:36:07.983943661Z [2024-04-06 03:36:07,983: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[76c66231-9c2a-4dc9-92df-fed21087662f] succeeded in 7.61208957999952s: None 2024-04-06T03:37:00.330681977Z [2024-04-06 03:37:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afb51c4f-aba6-499f-a8ee-37cfdec7944d] received 2024-04-06T03:37:00.333204583Z [2024-04-06 03:37:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[558aee23-1b4b-4934-a64b-4a95561403ec] received 2024-04-06T03:37:00.341122428Z [2024-04-06 03:37:00,340: INFO/ForkPoolWorker-15] [afb51c4f-aba6-499f-a8ee-37cfdec7944d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:37:00.346340792Z [2024-04-06 03:37:00,346: INFO/ForkPoolWorker-16] [558aee23-1b4b-4934-a64b-4a95561403ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:37:00.607590012Z [2024-04-06 03:37:00,603: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:37:00.657798020Z [2024-04-06 03:37:00,653: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:37:01.946250040Z [2024-04-06 03:37:01,945: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:37:01.950352478Z [2024-04-06 03:37:01,949: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:37:02.031602837Z [2024-04-06 03:37:02,031: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:37:02.036952452Z [2024-04-06 03:37:02,036: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:37:02.037001581Z [2024-04-06 03:37:02,036: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:37:02.037683415Z [2024-04-06 03:37:02,037: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:37:02.037712539Z [2024-04-06 03:37:02,037: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:37:02.037981970Z [2024-04-06 03:37:02,037: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:37:02.038119392Z [2024-04-06 03:37:02,037: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:37:02.060127908Z [2024-04-06 03:37:02,059: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:37:02.063369755Z [2024-04-06 03:37:02,062: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:37:02.117539693Z [2024-04-06 03:37:02,117: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:37:02.118939868Z [2024-04-06 03:37:02,118: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:37:02.118965783Z [2024-04-06 03:37:02,118: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:37:02.119066223Z [2024-04-06 03:37:02,118: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:37:02.119078733Z [2024-04-06 03:37:02,119: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:37:02.119307639Z [2024-04-06 03:37:02,119: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:37:02.119318194Z [2024-04-06 03:37:02,119: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:37:02.131198756Z [2024-04-06 03:37:02,130: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:37:02.236413887Z [2024-04-06 03:37:02,227: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:37:04.076693626Z [2024-04-06 03:37:04,075: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[afb51c4f-aba6-499f-a8ee-37cfdec7944d] succeeded in 3.7433729429994855s: None 2024-04-06T03:37:04.337268414Z [2024-04-06 03:37:04,336: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[558aee23-1b4b-4934-a64b-4a95561403ec] succeeded in 4.001653862000239s: None 2024-04-06T03:38:01.213310795Z [2024-04-06 03:38:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d30f5f59-749a-44d6-901d-76ba3c271f20] received 2024-04-06T03:38:01.234408639Z [2024-04-06 03:38:01,234: INFO/ForkPoolWorker-15] [d30f5f59-749a-44d6-901d-76ba3c271f20] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:38:01.244818951Z [2024-04-06 03:38:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3f4cd1a-08b9-42c9-a4cc-428831b3fdbd] received 2024-04-06T03:38:01.265343945Z [2024-04-06 03:38:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[590ac5fa-4e8c-42b0-8a86-a96f884bb97a] received 2024-04-06T03:38:01.278274586Z [2024-04-06 03:38:01,277: INFO/ForkPoolWorker-16] [c3f4cd1a-08b9-42c9-a4cc-428831b3fdbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:38:01.300155398Z [2024-04-06 03:38:01,299: INFO/ForkPoolWorker-1] [590ac5fa-4e8c-42b0-8a86-a96f884bb97a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:38:01.644478027Z [2024-04-06 03:38:01,641: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:38:01.787846304Z [2024-04-06 03:38:01,783: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:38:01.789004181Z [2024-04-06 03:38:01,783: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:38:02.255303331Z [2024-04-06 03:38:02,255: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:38:03.142703551Z [2024-04-06 03:38:03,142: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d30f5f59-749a-44d6-901d-76ba3c271f20] succeeded in 1.9249418060007883s: None 2024-04-06T03:38:03.474805046Z [2024-04-06 03:38:03,474: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:38:03.478219873Z [2024-04-06 03:38:03,477: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:38:03.528991194Z [2024-04-06 03:38:03,528: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:38:03.530732189Z [2024-04-06 03:38:03,530: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:38:03.530879434Z [2024-04-06 03:38:03,530: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:38:03.531265911Z [2024-04-06 03:38:03,531: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:38:03.531404466Z [2024-04-06 03:38:03,531: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:38:03.531713346Z [2024-04-06 03:38:03,531: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:38:03.532046133Z [2024-04-06 03:38:03,531: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:38:03.603343470Z [2024-04-06 03:38:03,603: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:38:03.661726783Z [2024-04-06 03:38:03,661: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:38:03.664938342Z [2024-04-06 03:38:03,664: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:38:03.719131604Z [2024-04-06 03:38:03,718: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:38:03.720422229Z [2024-04-06 03:38:03,720: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:38:03.720623837Z [2024-04-06 03:38:03,720: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:38:03.720814954Z [2024-04-06 03:38:03,720: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:38:03.720948985Z [2024-04-06 03:38:03,720: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:38:03.721644411Z [2024-04-06 03:38:03,721: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:38:03.721654889Z [2024-04-06 03:38:03,721: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:38:03.877265723Z [2024-04-06 03:38:03,876: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:38:05.612258876Z [2024-04-06 03:38:05,611: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[590ac5fa-4e8c-42b0-8a86-a96f884bb97a] succeeded in 4.340937381999538s: None 2024-04-06T03:38:06.084585845Z [2024-04-06 03:38:06,084: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3f4cd1a-08b9-42c9-a4cc-428831b3fdbd] succeeded in 4.833634290000191s: None 2024-04-06T03:39:00.311363399Z [2024-04-06 03:39:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6041d022-b003-4897-8807-314561bee5ac] received 2024-04-06T03:39:00.316008385Z [2024-04-06 03:39:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a87619a7-1754-4b7d-844e-577efd6bf416] received 2024-04-06T03:39:00.321899517Z [2024-04-06 03:39:00,321: INFO/ForkPoolWorker-15] [6041d022-b003-4897-8807-314561bee5ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:39:00.340191824Z [2024-04-06 03:39:00,339: INFO/ForkPoolWorker-16] [a87619a7-1754-4b7d-844e-577efd6bf416] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:39:00.573524467Z [2024-04-06 03:39:00,570: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:39:00.581075754Z [2024-04-06 03:39:00,578: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:39:01.616320601Z [2024-04-06 03:39:01,615: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:39:01.619144991Z [2024-04-06 03:39:01,618: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:39:01.664071560Z [2024-04-06 03:39:01,660: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:39:01.673909337Z [2024-04-06 03:39:01,669: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:39:01.673931376Z [2024-04-06 03:39:01,671: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:39:01.673937992Z [2024-04-06 03:39:01,671: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:39:01.673941691Z [2024-04-06 03:39:01,671: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:39:01.675195706Z [2024-04-06 03:39:01,674: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:39:01.675216025Z [2024-04-06 03:39:01,674: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:39:01.832355378Z [2024-04-06 03:39:01,832: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:39:01.833446525Z [2024-04-06 03:39:01,833: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:39:01.835456106Z [2024-04-06 03:39:01,835: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:39:01.871720696Z [2024-04-06 03:39:01,871: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:39:01.880628092Z [2024-04-06 03:39:01,880: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:39:01.880664854Z [2024-04-06 03:39:01,880: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:39:01.880749468Z [2024-04-06 03:39:01,880: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:39:01.880808035Z [2024-04-06 03:39:01,880: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:39:01.881125415Z [2024-04-06 03:39:01,880: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:39:01.881236590Z [2024-04-06 03:39:01,881: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:39:01.984642594Z [2024-04-06 03:39:01,984: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:39:03.684268233Z [2024-04-06 03:39:03,683: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a87619a7-1754-4b7d-844e-577efd6bf416] succeeded in 3.3593627980008023s: None 2024-04-06T03:39:04.649035147Z [2024-04-06 03:39:04,648: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6041d022-b003-4897-8807-314561bee5ac] succeeded in 4.3348247579997405s: None 2024-04-06T03:40:00.366234210Z [2024-04-06 03:40:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1979248-791d-4e5a-a245-8519d7c0c864] received 2024-04-06T03:40:00.369520340Z [2024-04-06 03:40:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0a94c0d-8351-4413-9311-b4815e9743fb] received 2024-04-06T03:40:00.384603273Z [2024-04-06 03:40:00,384: INFO/ForkPoolWorker-15] [a1979248-791d-4e5a-a245-8519d7c0c864] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:40:00.384621588Z [2024-04-06 03:40:00,384: INFO/ForkPoolWorker-16] [e0a94c0d-8351-4413-9311-b4815e9743fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:40:00.386484884Z [2024-04-06 03:40:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd46d4b9-25c6-4cf0-8b56-b6485fdcf33c] received 2024-04-06T03:40:00.389828978Z [2024-04-06 03:40:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d416d33d-83e7-485c-b9fb-517d13c25203] received 2024-04-06T03:40:00.403546270Z [2024-04-06 03:40:00,403: INFO/ForkPoolWorker-1] [dd46d4b9-25c6-4cf0-8b56-b6485fdcf33c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:40:00.411857596Z [2024-04-06 03:40:00,411: INFO/ForkPoolWorker-2] [d416d33d-83e7-485c-b9fb-517d13c25203] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:40:00.709379897Z [2024-04-06 03:40:00,706: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:40:00.726937469Z [2024-04-06 03:40:00,714: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:40:00.987792205Z [2024-04-06 03:40:00,981: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:40:01.012020501Z [2024-04-06 03:40:00,974: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:40:01.359863825Z [2024-04-06 03:40:01,359: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:40:02.153464848Z [2024-04-06 03:40:02,153: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d416d33d-83e7-485c-b9fb-517d13c25203] succeeded in 1.7590986910017818s: None 2024-04-06T03:40:02.712469900Z [2024-04-06 03:40:02,712: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:40:02.731680357Z [2024-04-06 03:40:02,731: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:40:02.838616335Z [2024-04-06 03:40:02,838: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:40:02.846548270Z [2024-04-06 03:40:02,846: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:40:02.846580551Z [2024-04-06 03:40:02,846: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:40:02.846626502Z [2024-04-06 03:40:02,846: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:40:02.846639274Z [2024-04-06 03:40:02,846: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:40:02.846982966Z [2024-04-06 03:40:02,846: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:40:02.846994921Z [2024-04-06 03:40:02,846: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:40:03.123774046Z [2024-04-06 03:40:03,123: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:40:03.308863792Z [2024-04-06 03:40:03,308: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:40:03.312284738Z [2024-04-06 03:40:03,311: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:40:03.366180877Z [2024-04-06 03:40:03,365: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:40:03.370186255Z [2024-04-06 03:40:03,369: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:40:03.370204001Z [2024-04-06 03:40:03,370: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:40:03.370292701Z [2024-04-06 03:40:03,370: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:40:03.370306764Z [2024-04-06 03:40:03,370: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:40:03.371487534Z [2024-04-06 03:40:03,370: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:40:03.371506034Z [2024-04-06 03:40:03,371: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:40:03.451322324Z [2024-04-06 03:40:03,451: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:40:03.731423537Z [2024-04-06 03:40:03,730: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:40:03.734835516Z [2024-04-06 03:40:03,734: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:40:03.782924914Z [2024-04-06 03:40:03,782: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:40:03.786159374Z [2024-04-06 03:40:03,785: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:40:03.786174667Z [2024-04-06 03:40:03,786: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:40:03.786314862Z [2024-04-06 03:40:03,786: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:40:03.786340984Z [2024-04-06 03:40:03,786: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:40:03.786697043Z [2024-04-06 03:40:03,786: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:40:03.786784857Z [2024-04-06 03:40:03,786: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:40:03.969123886Z [2024-04-06 03:40:03,968: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:40:04.362739079Z [2024-04-06 03:40:04,362: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0a94c0d-8351-4413-9311-b4815e9743fb] succeeded in 3.9878753020002478s: None 2024-04-06T03:40:05.108039466Z [2024-04-06 03:40:05,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d794008f-04a2-4b45-b4a7-2acec8e1f316] received 2024-04-06T03:40:05.118396049Z [2024-04-06 03:40:05,118: INFO/ForkPoolWorker-16] [d794008f-04a2-4b45-b4a7-2acec8e1f316] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:40:05.464421297Z [2024-04-06 03:40:05,461: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:40:05.628102558Z [2024-04-06 03:40:05,627: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1979248-791d-4e5a-a245-8519d7c0c864] succeeded in 5.255976239001029s: None 2024-04-06T03:40:05.703620608Z [2024-04-06 03:40:05,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dd46d4b9-25c6-4cf0-8b56-b6485fdcf33c] succeeded in 5.313794787000006s: None 2024-04-06T03:40:06.600084164Z [2024-04-06 03:40:06,599: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:40:06.603301215Z [2024-04-06 03:40:06,602: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:40:06.634148805Z [2024-04-06 03:40:06,633: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:40:06.635412956Z [2024-04-06 03:40:06,635: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:40:06.635517015Z [2024-04-06 03:40:06,635: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:40:06.635755986Z [2024-04-06 03:40:06,635: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:40:06.635870132Z [2024-04-06 03:40:06,635: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:40:06.636174970Z [2024-04-06 03:40:06,636: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:40:06.636270710Z [2024-04-06 03:40:06,636: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:40:06.748734049Z [2024-04-06 03:40:06,748: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:40:07.498433142Z [2024-04-06 03:40:07,497: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d794008f-04a2-4b45-b4a7-2acec8e1f316] succeeded in 2.3873198660003254s: None 2024-04-06T03:40:08.230228821Z [2024-04-06 03:40:08,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef83618b-83d4-410c-b193-1c9a481e26f4] received 2024-04-06T03:40:08.244513215Z [2024-04-06 03:40:08,244: INFO/ForkPoolWorker-15] [ef83618b-83d4-410c-b193-1c9a481e26f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:40:08.552117363Z [2024-04-06 03:40:08,548: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:40:09.637657400Z [2024-04-06 03:40:09,637: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:40:09.640644279Z [2024-04-06 03:40:09,640: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:40:09.692077542Z [2024-04-06 03:40:09,691: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:40:09.693781095Z [2024-04-06 03:40:09,693: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:40:09.694026165Z [2024-04-06 03:40:09,693: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:40:09.694611547Z [2024-04-06 03:40:09,694: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:40:09.694793007Z [2024-04-06 03:40:09,694: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:40:09.695066154Z [2024-04-06 03:40:09,694: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:40:09.695203320Z [2024-04-06 03:40:09,695: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:40:09.782000150Z [2024-04-06 03:40:09,781: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:40:11.190645592Z [2024-04-06 03:40:11,190: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef83618b-83d4-410c-b193-1c9a481e26f4] succeeded in 2.959235685000749s: None 2024-04-06T03:40:11.619543128Z [2024-04-06 03:40:11,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3df1db16-5eb5-49e2-9aa0-34015df16adf] received 2024-04-06T03:40:11.635186240Z [2024-04-06 03:40:11,633: INFO/ForkPoolWorker-15] [3df1db16-5eb5-49e2-9aa0-34015df16adf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:40:11.946308172Z [2024-04-06 03:40:11,942: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:40:13.046701192Z [2024-04-06 03:40:13,046: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:40:13.049791058Z [2024-04-06 03:40:13,049: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:40:13.083406714Z [2024-04-06 03:40:13,083: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:40:13.084944784Z [2024-04-06 03:40:13,084: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:40:13.085091227Z [2024-04-06 03:40:13,084: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:40:13.085312574Z [2024-04-06 03:40:13,085: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:40:13.085425565Z [2024-04-06 03:40:13,085: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:40:13.085769242Z [2024-04-06 03:40:13,085: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:40:13.085964557Z [2024-04-06 03:40:13,085: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:40:13.184736877Z [2024-04-06 03:40:13,184: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:40:13.894729548Z [2024-04-06 03:40:13,894: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3df1db16-5eb5-49e2-9aa0-34015df16adf] succeeded in 2.2727715960008936s: None 2024-04-06T03:41:01.109688637Z [2024-04-06 03:41:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db489ca4-05d9-488e-9be3-7f10dc713cf0] received 2024-04-06T03:41:01.116130022Z [2024-04-06 03:41:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfa343c7-28ef-45c0-a6a1-dde35e1635dd] received 2024-04-06T03:41:01.129154632Z [2024-04-06 03:41:01,128: INFO/ForkPoolWorker-15] [db489ca4-05d9-488e-9be3-7f10dc713cf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:41:01.136223899Z [2024-04-06 03:41:01,135: INFO/ForkPoolWorker-16] [cfa343c7-28ef-45c0-a6a1-dde35e1635dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:41:01.464825548Z [2024-04-06 03:41:01,460: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:41:01.526225068Z [2024-04-06 03:41:01,522: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:41:02.955866803Z [2024-04-06 03:41:02,955: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:41:02.959434268Z [2024-04-06 03:41:02,959: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:41:03.016119886Z [2024-04-06 03:41:03,015: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:41:03.019793845Z [2024-04-06 03:41:03,019: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:41:03.019881302Z [2024-04-06 03:41:03,019: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:41:03.020049642Z [2024-04-06 03:41:03,019: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:41:03.020131822Z [2024-04-06 03:41:03,020: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:41:03.020899285Z [2024-04-06 03:41:03,020: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:41:03.022276559Z [2024-04-06 03:41:03,021: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:41:03.116416849Z [2024-04-06 03:41:03,116: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:41:03.119870890Z [2024-04-06 03:41:03,119: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:41:03.137125294Z [2024-04-06 03:41:03,136: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:41:03.155067086Z [2024-04-06 03:41:03,154: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:41:03.156334398Z [2024-04-06 03:41:03,156: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:41:03.156454620Z [2024-04-06 03:41:03,156: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:41:03.156641832Z [2024-04-06 03:41:03,156: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:41:03.156722658Z [2024-04-06 03:41:03,156: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:41:03.156995705Z [2024-04-06 03:41:03,156: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:41:03.157059426Z [2024-04-06 03:41:03,156: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:41:03.282045620Z [2024-04-06 03:41:03,281: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:41:05.591086783Z [2024-04-06 03:41:05,590: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cfa343c7-28ef-45c0-a6a1-dde35e1635dd] succeeded in 4.469418910999593s: None 2024-04-06T03:41:06.943930311Z [2024-04-06 03:41:06,942: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db489ca4-05d9-488e-9be3-7f10dc713cf0] succeeded in 5.827602510000361s: None 2024-04-06T03:41:49.858352237Z [2024-04-06 03:41:49,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8bf0513-0092-4250-b45f-491b50381c9d] received 2024-04-06T03:41:49.877919623Z [2024-04-06 03:41:49,877: INFO/ForkPoolWorker-15] [d8bf0513-0092-4250-b45f-491b50381c9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240406034148_065508', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-06T03:41:50.164539781Z [2024-04-06 03:41:50,161: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-06T03:41:50.437932715Z [2024-04-06 03:41:50,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:41:51.048777723Z [2024-04-06 03:41:51,048: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8bf0513-0092-4250-b45f-491b50381c9d] succeeded in 1.187132170998666s: None 2024-04-06T03:42:01.294530568Z [2024-04-06 03:42:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fcb3af0-652f-45ca-bee9-00ce7e50a210] received 2024-04-06T03:42:01.301967034Z [2024-04-06 03:42:01,301: INFO/ForkPoolWorker-15] [6fcb3af0-652f-45ca-bee9-00ce7e50a210] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:42:01.306009730Z [2024-04-06 03:42:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bcfd295-9506-40b7-9a7d-f6d7e531b371] received 2024-04-06T03:42:01.309045380Z [2024-04-06 03:42:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6919140c-388a-43f0-a952-f6e8d2c71817] received 2024-04-06T03:42:01.324752183Z [2024-04-06 03:42:01,324: INFO/ForkPoolWorker-16] [8bcfd295-9506-40b7-9a7d-f6d7e531b371] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:42:01.334862929Z [2024-04-06 03:42:01,334: INFO/ForkPoolWorker-1] [6919140c-388a-43f0-a952-f6e8d2c71817] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:42:01.817995134Z [2024-04-06 03:42:01,814: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:42:01.993085683Z [2024-04-06 03:42:01,981: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:42:02.260912621Z [2024-04-06 03:42:02,234: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:42:02.806740836Z [2024-04-06 03:42:02,806: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:42:03.496462774Z [2024-04-06 03:42:03,496: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6fcb3af0-652f-45ca-bee9-00ce7e50a210] succeeded in 2.1993565789998684s: None 2024-04-06T03:42:03.757380519Z [2024-04-06 03:42:03,756: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:42:03.760844683Z [2024-04-06 03:42:03,760: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:42:03.805340394Z [2024-04-06 03:42:03,805: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:42:03.807172508Z [2024-04-06 03:42:03,806: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:42:03.809996549Z [2024-04-06 03:42:03,807: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:42:03.810765046Z [2024-04-06 03:42:03,810: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:42:03.810943359Z [2024-04-06 03:42:03,810: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:42:03.813874128Z [2024-04-06 03:42:03,813: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:42:03.814024041Z [2024-04-06 03:42:03,813: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:42:03.908467055Z [2024-04-06 03:42:03,908: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:42:04.092755257Z [2024-04-06 03:42:04,092: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:42:04.097194802Z [2024-04-06 03:42:04,096: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:42:04.156183237Z [2024-04-06 03:42:04,155: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:42:04.163286570Z [2024-04-06 03:42:04,163: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:42:04.163304848Z [2024-04-06 03:42:04,163: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:42:04.168387801Z [2024-04-06 03:42:04,163: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:42:04.168446987Z [2024-04-06 03:42:04,168: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:42:04.170120921Z [2024-04-06 03:42:04,169: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:42:04.170135719Z [2024-04-06 03:42:04,170: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:42:04.285958525Z [2024-04-06 03:42:04,284: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:42:06.663795628Z [2024-04-06 03:42:06,662: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6919140c-388a-43f0-a952-f6e8d2c71817] succeeded in 5.352179985000475s: None 2024-04-06T03:42:07.241212893Z [2024-04-06 03:42:07,240: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8bcfd295-9506-40b7-9a7d-f6d7e531b371] succeeded in 5.931457575001332s: None 2024-04-06T03:43:01.143936826Z [2024-04-06 03:43:01,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2925be1c-c65d-45a5-91bf-e9b860a395de] received 2024-04-06T03:43:01.149550811Z [2024-04-06 03:43:01,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cf13256-73f5-4ad5-a9ca-24f28884fec0] received 2024-04-06T03:43:01.168999414Z [2024-04-06 03:43:01,168: INFO/ForkPoolWorker-16] [6cf13256-73f5-4ad5-a9ca-24f28884fec0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:43:01.175352959Z [2024-04-06 03:43:01,175: INFO/ForkPoolWorker-15] [2925be1c-c65d-45a5-91bf-e9b860a395de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:43:01.709333897Z [2024-04-06 03:43:01,702: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:43:01.709359983Z [2024-04-06 03:43:01,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:43:04.148347194Z [2024-04-06 03:43:04,148: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:43:04.152331405Z [2024-04-06 03:43:04,151: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:43:04.215797889Z [2024-04-06 03:43:04,215: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:43:04.218425332Z [2024-04-06 03:43:04,218: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:43:04.218445787Z [2024-04-06 03:43:04,218: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:43:04.218617315Z [2024-04-06 03:43:04,218: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:43:04.218632348Z [2024-04-06 03:43:04,218: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:43:04.218951164Z [2024-04-06 03:43:04,218: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:43:04.218966048Z [2024-04-06 03:43:04,218: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:43:04.424983577Z [2024-04-06 03:43:04,424: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:43:04.450069555Z [2024-04-06 03:43:04,443: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:43:04.456949396Z [2024-04-06 03:43:04,456: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:43:04.609933426Z [2024-04-06 03:43:04,606: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:43:04.609952321Z [2024-04-06 03:43:04,607: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:43:04.609956188Z [2024-04-06 03:43:04,607: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:43:04.609961295Z [2024-04-06 03:43:04,607: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:43:04.609965201Z [2024-04-06 03:43:04,608: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:43:04.609968122Z [2024-04-06 03:43:04,608: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:43:04.609970904Z [2024-04-06 03:43:04,608: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:43:04.902094166Z [2024-04-06 03:43:04,898: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:43:07.065386803Z [2024-04-06 03:43:07,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2925be1c-c65d-45a5-91bf-e9b860a395de] succeeded in 5.908620752999923s: None 2024-04-06T03:43:07.574239161Z [2024-04-06 03:43:07,573: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6cf13256-73f5-4ad5-a9ca-24f28884fec0] succeeded in 6.416789588000029s: None 2024-04-06T03:44:01.024210558Z [2024-04-06 03:44:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8932362d-eae6-4d81-b2b6-b8adc1e558f3] received 2024-04-06T03:44:01.038570927Z [2024-04-06 03:44:01,038: INFO/ForkPoolWorker-15] [8932362d-eae6-4d81-b2b6-b8adc1e558f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:44:01.039442432Z [2024-04-06 03:44:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a0e54d9-af63-4774-856e-bd07f320515e] received 2024-04-06T03:44:01.052957206Z [2024-04-06 03:44:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb2dfc4f-8feb-4e0e-a721-3f6b4a3235a7] received 2024-04-06T03:44:01.071322997Z [2024-04-06 03:44:01,071: INFO/ForkPoolWorker-16] [1a0e54d9-af63-4774-856e-bd07f320515e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:44:01.083966027Z [2024-04-06 03:44:01,083: INFO/ForkPoolWorker-1] [eb2dfc4f-8feb-4e0e-a721-3f6b4a3235a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:44:01.568223441Z [2024-04-06 03:44:01,564: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:44:01.640915737Z [2024-04-06 03:44:01,637: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:44:01.690238678Z [2024-04-06 03:44:01,675: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:44:02.078855581Z [2024-04-06 03:44:02,078: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:44:03.145319742Z [2024-04-06 03:44:03,144: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1a0e54d9-af63-4774-856e-bd07f320515e] succeeded in 2.0999248959997203s: None 2024-04-06T03:44:03.704296449Z [2024-04-06 03:44:03,703: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:44:03.708247277Z [2024-04-06 03:44:03,707: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:44:03.713481470Z [2024-04-06 03:44:03,713: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:44:03.717101641Z [2024-04-06 03:44:03,716: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:44:03.746067291Z [2024-04-06 03:44:03,745: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:44:03.750398109Z [2024-04-06 03:44:03,750: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:44:03.750419591Z [2024-04-06 03:44:03,750: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:44:03.750560999Z [2024-04-06 03:44:03,750: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:44:03.750568548Z [2024-04-06 03:44:03,750: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:44:03.750765653Z [2024-04-06 03:44:03,750: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:44:03.750775596Z [2024-04-06 03:44:03,750: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:44:03.758875078Z [2024-04-06 03:44:03,758: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:44:03.760231500Z [2024-04-06 03:44:03,760: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:44:03.760242643Z [2024-04-06 03:44:03,760: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:44:03.760326073Z [2024-04-06 03:44:03,760: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:44:03.760376010Z [2024-04-06 03:44:03,760: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:44:03.760706594Z [2024-04-06 03:44:03,760: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:44:03.760716970Z [2024-04-06 03:44:03,760: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:44:03.866450394Z [2024-04-06 03:44:03,866: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:44:03.881116887Z [2024-04-06 03:44:03,880: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:44:05.674904621Z [2024-04-06 03:44:05,674: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb2dfc4f-8feb-4e0e-a721-3f6b4a3235a7] succeeded in 4.61567624700001s: None 2024-04-06T03:44:06.113410462Z [2024-04-06 03:44:06,113: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8932362d-eae6-4d81-b2b6-b8adc1e558f3] succeeded in 5.0861065089993645s: None 2024-04-06T03:45:00.623244636Z [2024-04-06 03:45:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[200d7c4f-6c22-4236-8398-fb8901b95aa9] received 2024-04-06T03:45:00.633833931Z [2024-04-06 03:45:00,633: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1089a69d-ebeb-45a7-965d-a24cd8116a17] received 2024-04-06T03:45:00.636990114Z [2024-04-06 03:45:00,636: INFO/ForkPoolWorker-15] [200d7c4f-6c22-4236-8398-fb8901b95aa9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:45:00.648997179Z [2024-04-06 03:45:00,648: INFO/ForkPoolWorker-16] [1089a69d-ebeb-45a7-965d-a24cd8116a17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:45:00.660215479Z [2024-04-06 03:45:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f817142-54ea-42c2-ba75-92a0bad8c474] received 2024-04-06T03:45:00.676670818Z [2024-04-06 03:45:00,676: INFO/ForkPoolWorker-1] [9f817142-54ea-42c2-ba75-92a0bad8c474] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:45:01.223810823Z [2024-04-06 03:45:01,219: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:45:01.325415314Z [2024-04-06 03:45:01,314: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:45:01.460699004Z [2024-04-06 03:45:01,457: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:45:03.567836310Z [2024-04-06 03:45:03,567: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:45:03.573985751Z [2024-04-06 03:45:03,571: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:45:03.624398254Z [2024-04-06 03:45:03,624: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:45:03.641859985Z [2024-04-06 03:45:03,641: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:45:03.642070795Z [2024-04-06 03:45:03,641: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:45:03.642340926Z [2024-04-06 03:45:03,642: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:45:03.642643968Z [2024-04-06 03:45:03,642: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:45:03.642987830Z [2024-04-06 03:45:03,642: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:45:03.644348778Z [2024-04-06 03:45:03,644: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:45:03.760230552Z [2024-04-06 03:45:03,759: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:45:03.816802137Z [2024-04-06 03:45:03,816: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:45:03.820360289Z [2024-04-06 03:45:03,819: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:45:03.901045679Z [2024-04-06 03:45:03,900: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:45:03.902506249Z [2024-04-06 03:45:03,902: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:45:03.902702722Z [2024-04-06 03:45:03,902: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:45:03.902930482Z [2024-04-06 03:45:03,902: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:45:03.903103701Z [2024-04-06 03:45:03,902: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:45:03.903429487Z [2024-04-06 03:45:03,903: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:45:03.903590392Z [2024-04-06 03:45:03,903: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:45:04.143185444Z [2024-04-06 03:45:04,142: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:45:04.416013377Z [2024-04-06 03:45:04,414: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:45:04.434301277Z [2024-04-06 03:45:04,433: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:45:04.566894209Z [2024-04-06 03:45:04,566: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:45:04.582846367Z [2024-04-06 03:45:04,582: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:45:04.582872273Z [2024-04-06 03:45:04,582: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:45:04.590180341Z [2024-04-06 03:45:04,582: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:45:04.590215280Z [2024-04-06 03:45:04,590: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:45:04.590399053Z [2024-04-06 03:45:04,590: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:45:04.590410196Z [2024-04-06 03:45:04,590: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:45:04.716176298Z [2024-04-06 03:45:04,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:45:05.592644356Z [2024-04-06 03:45:05,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77b7dfcc-189a-4441-a5ea-98fb38b30008] received 2024-04-06T03:45:05.627456469Z [2024-04-06 03:45:05,627: INFO/ForkPoolWorker-2] [77b7dfcc-189a-4441-a5ea-98fb38b30008] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:45:05.702849369Z [2024-04-06 03:45:05,702: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[200d7c4f-6c22-4236-8398-fb8901b95aa9] succeeded in 5.077007767000396s: None 2024-04-06T03:45:06.054814054Z [2024-04-06 03:45:06,054: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1089a69d-ebeb-45a7-965d-a24cd8116a17] succeeded in 5.417432876000021s: None 2024-04-06T03:45:06.322610845Z [2024-04-06 03:45:06,318: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:45:06.906100904Z [2024-04-06 03:45:06,905: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f817142-54ea-42c2-ba75-92a0bad8c474] succeeded in 6.243985902001441s: None 2024-04-06T03:45:07.484636864Z [2024-04-06 03:45:07,484: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T03:45:07.487593675Z [2024-04-06 03:45:07,487: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:45:07.517246101Z [2024-04-06 03:45:07,516: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T03:45:07.519071376Z [2024-04-06 03:45:07,518: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:45:07.519252369Z [2024-04-06 03:45:07,518: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:45:07.519450895Z [2024-04-06 03:45:07,519: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:45:07.519602408Z [2024-04-06 03:45:07,519: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T03:45:07.520391418Z [2024-04-06 03:45:07,519: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:45:07.520407763Z [2024-04-06 03:45:07,520: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:45:07.619824972Z [2024-04-06 03:45:07,619: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:45:08.275617092Z [2024-04-06 03:45:08,275: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[77b7dfcc-189a-4441-a5ea-98fb38b30008] succeeded in 2.680224158000783s: None 2024-04-06T03:45:08.520232457Z [2024-04-06 03:45:08,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f4c5533-9f0b-415c-b414-4a09451dab38] received 2024-04-06T03:45:08.534459589Z [2024-04-06 03:45:08,534: INFO/ForkPoolWorker-15] [9f4c5533-9f0b-415c-b414-4a09451dab38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:45:08.851678019Z [2024-04-06 03:45:08,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:45:09.963797606Z [2024-04-06 03:45:09,963: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:45:09.967186633Z [2024-04-06 03:45:09,966: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:45:10.001564806Z [2024-04-06 03:45:10,001: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:45:10.007735944Z [2024-04-06 03:45:10,007: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:45:10.007982261Z [2024-04-06 03:45:10,007: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:45:10.008193723Z [2024-04-06 03:45:10,007: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:45:10.008350557Z [2024-04-06 03:45:10,008: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:45:10.009408974Z [2024-04-06 03:45:10,009: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:45:10.009682584Z [2024-04-06 03:45:10,009: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:45:10.104806752Z [2024-04-06 03:45:10,104: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:45:10.781927190Z [2024-04-06 03:45:10,771: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f4c5533-9f0b-415c-b414-4a09451dab38] succeeded in 2.2492113480002445s: None 2024-04-06T03:45:10.862752477Z [2024-04-06 03:45:10,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cf08295-b907-4841-8fd8-81191e935d4b] received 2024-04-06T03:45:10.872217135Z [2024-04-06 03:45:10,871: INFO/ForkPoolWorker-15] [7cf08295-b907-4841-8fd8-81191e935d4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:45:11.180459111Z [2024-04-06 03:45:11,173: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:45:12.369531443Z [2024-04-06 03:45:12,369: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:45:12.372586024Z [2024-04-06 03:45:12,372: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:45:12.410591873Z [2024-04-06 03:45:12,410: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:45:12.412158378Z [2024-04-06 03:45:12,411: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:45:12.412232626Z [2024-04-06 03:45:12,412: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:45:12.412494258Z [2024-04-06 03:45:12,412: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:45:12.412630759Z [2024-04-06 03:45:12,412: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:45:12.413149226Z [2024-04-06 03:45:12,412: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:45:12.413176162Z [2024-04-06 03:45:12,413: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:45:12.538159380Z [2024-04-06 03:45:12,537: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:45:13.148293578Z [2024-04-06 03:45:13,146: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7cf08295-b907-4841-8fd8-81191e935d4b] succeeded in 2.2823886980004318s: None 2024-04-06T03:45:49.715486574Z [2024-04-06 03:45:49,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee80a5d5-3f44-43cb-bc70-03d782cbb51f] received 2024-04-06T03:45:49.735042386Z [2024-04-06 03:45:49,734: INFO/ForkPoolWorker-15] [ee80a5d5-3f44-43cb-bc70-03d782cbb51f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240406034548_196957', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-06T03:45:50.047710483Z [2024-04-06 03:45:50,044: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-06T03:45:50.310873757Z [2024-04-06 03:45:50,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:45:50.922249843Z [2024-04-06 03:45:50,921: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee80a5d5-3f44-43cb-bc70-03d782cbb51f] succeeded in 1.2036761629988177s: None 2024-04-06T03:46:00.522964103Z [2024-04-06 03:46:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffde47cb-53da-4adf-b91d-32d274e72e90] received 2024-04-06T03:46:00.527843592Z [2024-04-06 03:46:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c94d066-2f55-4436-acb6-c1809ac1f0e7] received 2024-04-06T03:46:00.530292405Z [2024-04-06 03:46:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[402e1c3e-845e-41f4-9086-ede86ce9f014] received 2024-04-06T03:46:00.536622916Z [2024-04-06 03:46:00,536: INFO/ForkPoolWorker-15] [ffde47cb-53da-4adf-b91d-32d274e72e90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:46:00.537458401Z [2024-04-06 03:46:00,537: INFO/ForkPoolWorker-16] [1c94d066-2f55-4436-acb6-c1809ac1f0e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:46:00.541022679Z [2024-04-06 03:46:00,540: INFO/ForkPoolWorker-1] [402e1c3e-845e-41f4-9086-ede86ce9f014] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:46:00.899337522Z [2024-04-06 03:46:00,893: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:46:00.989748018Z [2024-04-06 03:46:00,977: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:46:01.039450050Z [2024-04-06 03:46:01,034: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:46:01.687294908Z [2024-04-06 03:46:01,687: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:46:02.708160961Z [2024-04-06 03:46:02,707: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[402e1c3e-845e-41f4-9086-ede86ce9f014] succeeded in 2.1754863370006206s: None 2024-04-06T03:46:02.823419124Z [2024-04-06 03:46:02,823: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:46:02.830721616Z [2024-04-06 03:46:02,830: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:46:02.880133215Z [2024-04-06 03:46:02,879: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:46:02.882107266Z [2024-04-06 03:46:02,881: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:46:02.882259343Z [2024-04-06 03:46:02,882: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:46:02.882421916Z [2024-04-06 03:46:02,882: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:46:02.882482655Z [2024-04-06 03:46:02,882: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:46:02.882735832Z [2024-04-06 03:46:02,882: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:46:02.883149770Z [2024-04-06 03:46:02,882: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:46:03.049367766Z [2024-04-06 03:46:03,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:46:03.247723534Z [2024-04-06 03:46:03,247: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:46:03.251541845Z [2024-04-06 03:46:03,251: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:46:03.296751976Z [2024-04-06 03:46:03,296: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:46:03.298471141Z [2024-04-06 03:46:03,298: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:46:03.299564284Z [2024-04-06 03:46:03,298: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:46:03.299849694Z [2024-04-06 03:46:03,299: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:46:03.300004438Z [2024-04-06 03:46:03,299: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:46:03.300295671Z [2024-04-06 03:46:03,300: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:46:03.300619670Z [2024-04-06 03:46:03,300: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:46:03.398904946Z [2024-04-06 03:46:03,398: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:46:05.000581170Z [2024-04-06 03:46:05,000: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffde47cb-53da-4adf-b91d-32d274e72e90] succeeded in 4.475581888000306s: None 2024-04-06T03:46:05.342783082Z [2024-04-06 03:46:05,342: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1c94d066-2f55-4436-acb6-c1809ac1f0e7] succeeded in 4.811630197000341s: None 2024-04-06T03:47:00.352566286Z [2024-04-06 03:47:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ec54bc6-d945-4e33-afee-06ceaa043b61] received 2024-04-06T03:47:00.356504460Z [2024-04-06 03:47:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af0f4b8c-f707-46bc-bc14-611ea5d6ac14] received 2024-04-06T03:47:00.367468973Z [2024-04-06 03:47:00,367: INFO/ForkPoolWorker-15] [9ec54bc6-d945-4e33-afee-06ceaa043b61] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:47:00.369247709Z [2024-04-06 03:47:00,368: INFO/ForkPoolWorker-16] [af0f4b8c-f707-46bc-bc14-611ea5d6ac14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:47:00.648103333Z [2024-04-06 03:47:00,644: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:47:00.648148005Z [2024-04-06 03:47:00,644: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:47:02.011099149Z [2024-04-06 03:47:02,010: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:47:02.014214873Z [2024-04-06 03:47:02,013: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:47:02.086397885Z [2024-04-06 03:47:02,086: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:47:02.089922159Z [2024-04-06 03:47:02,089: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:47:02.090064536Z [2024-04-06 03:47:02,089: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:47:02.090212985Z [2024-04-06 03:47:02,090: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:47:02.090250023Z [2024-04-06 03:47:02,090: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:47:02.090513481Z [2024-04-06 03:47:02,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:47:02.090583347Z [2024-04-06 03:47:02,090: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:47:02.138871258Z [2024-04-06 03:47:02,138: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:47:02.143306067Z [2024-04-06 03:47:02,142: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:47:02.198017299Z [2024-04-06 03:47:02,192: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:47:02.207010366Z [2024-04-06 03:47:02,206: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:47:02.211329658Z [2024-04-06 03:47:02,210: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:47:02.211735790Z [2024-04-06 03:47:02,211: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:47:02.212076701Z [2024-04-06 03:47:02,211: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:47:02.212361053Z [2024-04-06 03:47:02,212: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:47:02.213122060Z [2024-04-06 03:47:02,212: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:47:02.213346671Z [2024-04-06 03:47:02,213: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:47:02.386508490Z [2024-04-06 03:47:02,386: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:47:04.146791321Z [2024-04-06 03:47:04,146: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af0f4b8c-f707-46bc-bc14-611ea5d6ac14] succeeded in 3.787946192000163s: None 2024-04-06T03:47:04.513724389Z [2024-04-06 03:47:04,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ec54bc6-d945-4e33-afee-06ceaa043b61] succeeded in 4.157278909000524s: None 2024-04-06T03:48:00.305106839Z [2024-04-06 03:48:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ae0d8ff-5f3b-4789-b681-8770d8c0d025] received 2024-04-06T03:48:00.307092291Z [2024-04-06 03:48:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a35548f-a46b-493b-a4c0-b9b7cdc8cbc2] received 2024-04-06T03:48:00.316278896Z [2024-04-06 03:48:00,315: INFO/ForkPoolWorker-15] [3ae0d8ff-5f3b-4789-b681-8770d8c0d025] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:48:00.321350421Z [2024-04-06 03:48:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[692e50bc-aaf1-461a-87f8-2f12656f716f] received 2024-04-06T03:48:00.326886827Z [2024-04-06 03:48:00,325: INFO/ForkPoolWorker-16] [8a35548f-a46b-493b-a4c0-b9b7cdc8cbc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:48:00.341346109Z [2024-04-06 03:48:00,340: INFO/ForkPoolWorker-1] [692e50bc-aaf1-461a-87f8-2f12656f716f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:48:00.609051631Z [2024-04-06 03:48:00,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:48:00.632241763Z [2024-04-06 03:48:00,629: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:48:00.701414000Z [2024-04-06 03:48:00,697: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:48:00.983951404Z [2024-04-06 03:48:00,983: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:48:01.838170557Z [2024-04-06 03:48:01,837: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ae0d8ff-5f3b-4789-b681-8770d8c0d025] succeeded in 1.5295896560000983s: None 2024-04-06T03:48:02.056188022Z [2024-04-06 03:48:02,055: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:48:02.060051313Z [2024-04-06 03:48:02,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:48:02.152728015Z [2024-04-06 03:48:02,152: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:48:02.154276111Z [2024-04-06 03:48:02,154: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:48:02.158619131Z [2024-04-06 03:48:02,154: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:48:02.158840259Z [2024-04-06 03:48:02,158: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:48:02.158935687Z [2024-04-06 03:48:02,158: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:48:02.159535749Z [2024-04-06 03:48:02,159: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:48:02.159596571Z [2024-04-06 03:48:02,159: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:48:02.333069033Z [2024-04-06 03:48:02,332: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:48:02.349891915Z [2024-04-06 03:48:02,349: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:48:02.353291561Z [2024-04-06 03:48:02,352: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:48:02.431446728Z [2024-04-06 03:48:02,431: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:48:02.434834636Z [2024-04-06 03:48:02,434: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:48:02.434921806Z [2024-04-06 03:48:02,434: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:48:02.435072540Z [2024-04-06 03:48:02,434: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:48:02.435152915Z [2024-04-06 03:48:02,435: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:48:02.435674718Z [2024-04-06 03:48:02,435: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:48:02.437326252Z [2024-04-06 03:48:02,437: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:48:02.537316565Z [2024-04-06 03:48:02,537: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:48:04.468983343Z [2024-04-06 03:48:04,468: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[692e50bc-aaf1-461a-87f8-2f12656f716f] succeeded in 4.14429440099957s: None 2024-04-06T03:48:04.928844679Z [2024-04-06 03:48:04,928: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a35548f-a46b-493b-a4c0-b9b7cdc8cbc2] succeeded in 4.617434788000537s: None 2024-04-06T03:49:00.181132894Z [2024-04-06 03:49:00,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23f0b297-9efc-4182-8609-b91fed938907] received 2024-04-06T03:49:00.190380429Z [2024-04-06 03:49:00,190: INFO/ForkPoolWorker-15] [23f0b297-9efc-4182-8609-b91fed938907] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:49:00.192689177Z [2024-04-06 03:49:00,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71452294-e62a-4cdb-971b-063d538ad07a] received 2024-04-06T03:49:00.205197791Z [2024-04-06 03:49:00,204: INFO/ForkPoolWorker-16] [71452294-e62a-4cdb-971b-063d538ad07a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:49:00.496536922Z [2024-04-06 03:49:00,492: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:49:00.519050061Z [2024-04-06 03:49:00,514: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:49:01.898213022Z [2024-04-06 03:49:01,897: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:49:01.901779381Z [2024-04-06 03:49:01,901: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:49:01.910339960Z [2024-04-06 03:49:01,909: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:49:01.913472730Z [2024-04-06 03:49:01,913: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:49:01.948835275Z [2024-04-06 03:49:01,948: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:49:01.952446784Z [2024-04-06 03:49:01,952: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:49:01.952594082Z [2024-04-06 03:49:01,952: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:49:01.952876640Z [2024-04-06 03:49:01,952: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:49:01.953010542Z [2024-04-06 03:49:01,952: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:49:01.953346845Z [2024-04-06 03:49:01,953: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:49:01.953411029Z [2024-04-06 03:49:01,953: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:49:01.957689147Z [2024-04-06 03:49:01,957: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:49:01.958789973Z [2024-04-06 03:49:01,958: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:49:01.958853276Z [2024-04-06 03:49:01,958: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:49:01.959016427Z [2024-04-06 03:49:01,958: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:49:01.959067431Z [2024-04-06 03:49:01,959: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:49:01.959296931Z [2024-04-06 03:49:01,959: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:49:01.959370295Z [2024-04-06 03:49:01,959: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:49:02.059455922Z [2024-04-06 03:49:02,059: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:49:02.075071225Z [2024-04-06 03:49:02,074: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:49:03.750781165Z [2024-04-06 03:49:03,750: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71452294-e62a-4cdb-971b-063d538ad07a] succeeded in 3.555772188999981s: None 2024-04-06T03:49:04.000801010Z [2024-04-06 03:49:04,000: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23f0b297-9efc-4182-8609-b91fed938907] succeeded in 3.8177372019999893s: None 2024-04-06T03:50:00.709602078Z [2024-04-06 03:50:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad3a6c29-315d-4027-841f-6f448781822f] received 2024-04-06T03:50:00.712218457Z [2024-04-06 03:50:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[734f09d9-2821-4b68-a34b-c1a729b2d9df] received 2024-04-06T03:50:00.725952747Z [2024-04-06 03:50:00,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45ff9797-0742-4a35-a159-82a69e2d5513] received 2024-04-06T03:50:00.725970681Z [2024-04-06 03:50:00,724: INFO/ForkPoolWorker-15] [ad3a6c29-315d-4027-841f-6f448781822f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:50:00.747618855Z [2024-04-06 03:50:00,741: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7f54c20-9b2a-43c4-9ea6-0a1522a17c78] received 2024-04-06T03:50:00.747926082Z [2024-04-06 03:50:00,744: INFO/ForkPoolWorker-1] [45ff9797-0742-4a35-a159-82a69e2d5513] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:50:00.747936286Z [2024-04-06 03:50:00,744: INFO/ForkPoolWorker-16] [734f09d9-2821-4b68-a34b-c1a729b2d9df] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:50:00.761881703Z [2024-04-06 03:50:00,760: INFO/ForkPoolWorker-2] [b7f54c20-9b2a-43c4-9ea6-0a1522a17c78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:50:01.225963240Z [2024-04-06 03:50:01,221: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:50:01.240384542Z [2024-04-06 03:50:01,235: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:50:01.301334943Z [2024-04-06 03:50:01,297: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:50:01.520101570Z [2024-04-06 03:50:01,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:50:01.605352738Z [2024-04-06 03:50:01,605: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:50:02.739209388Z [2024-04-06 03:50:02,738: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[734f09d9-2821-4b68-a34b-c1a729b2d9df] succeeded in 2.0250129000014567s: None 2024-04-06T03:50:04.144570778Z [2024-04-06 03:50:04,142: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:50:04.149212953Z [2024-04-06 03:50:04,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:50:04.194742215Z [2024-04-06 03:50:04,194: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:50:04.199195578Z [2024-04-06 03:50:04,198: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:50:04.199329712Z [2024-04-06 03:50:04,199: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:50:04.199507937Z [2024-04-06 03:50:04,199: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:50:04.199614854Z [2024-04-06 03:50:04,199: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:50:04.199943794Z [2024-04-06 03:50:04,199: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:50:04.200026698Z [2024-04-06 03:50:04,199: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:50:04.414420205Z [2024-04-06 03:50:04,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:50:04.480226657Z [2024-04-06 03:50:04,479: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:50:04.507648006Z [2024-04-06 03:50:04,507: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:50:04.579212320Z [2024-04-06 03:50:04,578: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T03:50:04.597071456Z [2024-04-06 03:50:04,595: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:50:04.681891277Z [2024-04-06 03:50:04,681: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T03:50:04.683735496Z [2024-04-06 03:50:04,683: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:50:04.684014189Z [2024-04-06 03:50:04,683: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:50:04.684222287Z [2024-04-06 03:50:04,684: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:50:04.684361131Z [2024-04-06 03:50:04,684: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T03:50:04.684690257Z [2024-04-06 03:50:04,684: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:50:04.684805111Z [2024-04-06 03:50:04,684: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:50:04.701316283Z [2024-04-06 03:50:04,701: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:50:04.703105175Z [2024-04-06 03:50:04,702: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:50:04.703220630Z [2024-04-06 03:50:04,703: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:50:04.703386364Z [2024-04-06 03:50:04,703: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:50:04.703496881Z [2024-04-06 03:50:04,703: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:50:04.703774658Z [2024-04-06 03:50:04,703: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:50:04.703963878Z [2024-04-06 03:50:04,703: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:50:04.853350246Z [2024-04-06 03:50:04,853: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:50:04.854511308Z [2024-04-06 03:50:04,854: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:50:05.150581859Z [2024-04-06 03:50:05,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0078a52d-fe6a-48b2-b2a6-2c30a1df41fa] received 2024-04-06T03:50:05.160024707Z [2024-04-06 03:50:05,159: INFO/ForkPoolWorker-16] [0078a52d-fe6a-48b2-b2a6-2c30a1df41fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:50:05.343613962Z [2024-04-06 03:50:05,343: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad3a6c29-315d-4027-841f-6f448781822f] succeeded in 4.628608461000113s: None 2024-04-06T03:50:05.689971473Z [2024-04-06 03:50:05,685: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:50:06.690484128Z [2024-04-06 03:50:06,690: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b7f54c20-9b2a-43c4-9ea6-0a1522a17c78] succeeded in 5.943912075001208s: None 2024-04-06T03:50:06.965577396Z [2024-04-06 03:50:06,965: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:50:06.969786004Z [2024-04-06 03:50:06,969: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:50:06.999341231Z [2024-04-06 03:50:06,999: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:50:07.003759989Z [2024-04-06 03:50:07,003: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:50:07.003782000Z [2024-04-06 03:50:07,003: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:50:07.003866144Z [2024-04-06 03:50:07,003: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:50:07.003893623Z [2024-04-06 03:50:07,003: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:50:07.004117506Z [2024-04-06 03:50:07,004: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:50:07.004220060Z [2024-04-06 03:50:07,004: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:50:07.064662451Z [2024-04-06 03:50:07,064: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[45ff9797-0742-4a35-a159-82a69e2d5513] succeeded in 6.337286629999653s: None 2024-04-06T03:50:07.086259891Z [2024-04-06 03:50:07,085: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:50:07.701846397Z [2024-04-06 03:50:07,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6389f84e-71a4-4239-9fb0-dbd6a6397c93] received 2024-04-06T03:50:07.710851424Z [2024-04-06 03:50:07,710: INFO/ForkPoolWorker-15] [6389f84e-71a4-4239-9fb0-dbd6a6397c93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:50:07.732963080Z [2024-04-06 03:50:07,732: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0078a52d-fe6a-48b2-b2a6-2c30a1df41fa] succeeded in 2.580569817000651s: None 2024-04-06T03:50:07.968894042Z [2024-04-06 03:50:07,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:50:09.429877251Z [2024-04-06 03:50:09,424: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:50:09.445954359Z [2024-04-06 03:50:09,433: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:50:09.483472038Z [2024-04-06 03:50:09,483: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:50:09.484924206Z [2024-04-06 03:50:09,484: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:50:09.485037182Z [2024-04-06 03:50:09,484: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:50:09.485214202Z [2024-04-06 03:50:09,484: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:50:09.485274939Z [2024-04-06 03:50:09,485: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:50:09.485529918Z [2024-04-06 03:50:09,485: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:50:09.485694086Z [2024-04-06 03:50:09,485: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:50:09.614324389Z [2024-04-06 03:50:09,614: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:50:10.306623811Z [2024-04-06 03:50:10,306: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6389f84e-71a4-4239-9fb0-dbd6a6397c93] succeeded in 2.603024911999455s: None 2024-04-06T03:50:10.672769116Z [2024-04-06 03:50:10,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a501456b-dde2-42a0-adac-41f4a5fbf3ff] received 2024-04-06T03:50:10.685459118Z [2024-04-06 03:50:10,685: INFO/ForkPoolWorker-15] [a501456b-dde2-42a0-adac-41f4a5fbf3ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:50:11.027953954Z [2024-04-06 03:50:11,024: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:50:12.463422877Z [2024-04-06 03:50:12,463: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:50:12.466772186Z [2024-04-06 03:50:12,466: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:50:12.493471997Z [2024-04-06 03:50:12,493: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:50:12.494876701Z [2024-04-06 03:50:12,494: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:50:12.494941393Z [2024-04-06 03:50:12,494: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:50:12.495100822Z [2024-04-06 03:50:12,494: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:50:12.495507196Z [2024-04-06 03:50:12,495: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:50:12.497852674Z [2024-04-06 03:50:12,497: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:50:12.497953734Z [2024-04-06 03:50:12,497: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:50:12.629206227Z [2024-04-06 03:50:12,628: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:50:13.302943094Z [2024-04-06 03:50:13,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a501456b-dde2-42a0-adac-41f4a5fbf3ff] succeeded in 2.6283135909998236s: None 2024-04-06T03:51:01.041497611Z [2024-04-06 03:51:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f87e282e-5b59-40be-acaa-9ede686b216c] received 2024-04-06T03:51:01.048967252Z [2024-04-06 03:51:01,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebfbb70e-f45f-498e-a6df-4876782ac9e7] received 2024-04-06T03:51:01.052333846Z [2024-04-06 03:51:01,052: INFO/ForkPoolWorker-15] [f87e282e-5b59-40be-acaa-9ede686b216c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:51:01.076246926Z [2024-04-06 03:51:01,075: INFO/ForkPoolWorker-16] [ebfbb70e-f45f-498e-a6df-4876782ac9e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:51:01.401980321Z [2024-04-06 03:51:01,397: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:51:01.460846882Z [2024-04-06 03:51:01,456: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:51:03.110476240Z [2024-04-06 03:51:03,110: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:51:03.113680343Z [2024-04-06 03:51:03,113: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:51:03.182994556Z [2024-04-06 03:51:03,182: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:51:03.185903223Z [2024-04-06 03:51:03,185: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:51:03.185939996Z [2024-04-06 03:51:03,185: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:51:03.186194873Z [2024-04-06 03:51:03,185: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:51:03.186349191Z [2024-04-06 03:51:03,186: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:51:03.186710622Z [2024-04-06 03:51:03,186: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:51:03.186901546Z [2024-04-06 03:51:03,186: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:51:03.342760910Z [2024-04-06 03:51:03,342: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:51:03.646767081Z [2024-04-06 03:51:03,646: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:51:03.652301332Z [2024-04-06 03:51:03,651: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:51:03.682851128Z [2024-04-06 03:51:03,682: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:51:03.684984397Z [2024-04-06 03:51:03,684: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:51:03.685118601Z [2024-04-06 03:51:03,684: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:51:03.685293560Z [2024-04-06 03:51:03,685: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:51:03.685417328Z [2024-04-06 03:51:03,685: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:51:03.685760347Z [2024-04-06 03:51:03,685: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:51:03.685895821Z [2024-04-06 03:51:03,685: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:51:03.765905501Z [2024-04-06 03:51:03,765: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:51:05.451450187Z [2024-04-06 03:51:05,451: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f87e282e-5b59-40be-acaa-9ede686b216c] succeeded in 4.406721938999908s: None 2024-04-06T03:51:06.081550375Z [2024-04-06 03:51:06,081: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebfbb70e-f45f-498e-a6df-4876782ac9e7] succeeded in 5.030550367000615s: None 2024-04-06T03:52:00.870957621Z [2024-04-06 03:52:00,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f1dcb25-cb39-4533-835f-a0c5004893f0] received 2024-04-06T03:52:00.877739992Z [2024-04-06 03:52:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7efa66a5-d80d-4fff-ba22-c00a09456e60] received 2024-04-06T03:52:00.880482058Z [2024-04-06 03:52:00,880: INFO/ForkPoolWorker-15] [3f1dcb25-cb39-4533-835f-a0c5004893f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:52:00.884399347Z [2024-04-06 03:52:00,884: INFO/ForkPoolWorker-16] [7efa66a5-d80d-4fff-ba22-c00a09456e60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:52:00.894629637Z [2024-04-06 03:52:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[969d7501-f877-484a-b71c-bdd029f62a2a] received 2024-04-06T03:52:00.919577089Z [2024-04-06 03:52:00,919: INFO/ForkPoolWorker-1] [969d7501-f877-484a-b71c-bdd029f62a2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:52:01.173639262Z [2024-04-06 03:52:01,169: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:52:01.440282167Z [2024-04-06 03:52:01,433: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:52:01.525105307Z [2024-04-06 03:52:01,511: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:52:01.927170892Z [2024-04-06 03:52:01,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:52:02.664408809Z [2024-04-06 03:52:02,664: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:52:02.668097400Z [2024-04-06 03:52:02,667: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:52:02.770460389Z [2024-04-06 03:52:02,770: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:52:02.774350139Z [2024-04-06 03:52:02,774: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:52:02.775730417Z [2024-04-06 03:52:02,775: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:52:02.775899594Z [2024-04-06 03:52:02,775: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:52:02.780192658Z [2024-04-06 03:52:02,780: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:52:02.780489785Z [2024-04-06 03:52:02,780: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:52:02.780598962Z [2024-04-06 03:52:02,780: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:52:02.962356853Z [2024-04-06 03:52:02,962: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:52:03.176591924Z [2024-04-06 03:52:03,175: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f1dcb25-cb39-4533-835f-a0c5004893f0] succeeded in 2.3020418280011654s: None 2024-04-06T03:52:03.389700896Z [2024-04-06 03:52:03,389: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:52:03.393364579Z [2024-04-06 03:52:03,392: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:52:03.443512402Z [2024-04-06 03:52:03,442: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:52:03.444599377Z [2024-04-06 03:52:03,444: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:52:03.444785789Z [2024-04-06 03:52:03,444: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:52:03.444935920Z [2024-04-06 03:52:03,444: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:52:03.444948324Z [2024-04-06 03:52:03,444: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:52:03.445226452Z [2024-04-06 03:52:03,445: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:52:03.445276871Z [2024-04-06 03:52:03,445: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:52:03.589067961Z [2024-04-06 03:52:03,588: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:52:05.511944637Z [2024-04-06 03:52:05,511: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[969d7501-f877-484a-b71c-bdd029f62a2a] succeeded in 4.611066605000815s: None 2024-04-06T03:52:05.612490936Z [2024-04-06 03:52:05,612: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7efa66a5-d80d-4fff-ba22-c00a09456e60] succeeded in 4.732888369000648s: None 2024-04-06T03:53:00.789947092Z [2024-04-06 03:53:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abe5c1d0-00d0-476c-9991-96825a94ccd4] received 2024-04-06T03:53:00.795895080Z [2024-04-06 03:53:00,795: INFO/ForkPoolWorker-15] [abe5c1d0-00d0-476c-9991-96825a94ccd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:53:00.803852694Z [2024-04-06 03:53:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e54a8214-9751-4b95-95f4-ef634c0d8d3c] received 2024-04-06T03:53:00.820278713Z [2024-04-06 03:53:00,819: INFO/ForkPoolWorker-16] [e54a8214-9751-4b95-95f4-ef634c0d8d3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:53:01.235559812Z [2024-04-06 03:53:01,231: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:53:01.518233866Z [2024-04-06 03:53:01,504: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:53:03.609542597Z [2024-04-06 03:53:03,609: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:53:03.613120697Z [2024-04-06 03:53:03,612: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:53:03.684627318Z [2024-04-06 03:53:03,684: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:53:03.686931278Z [2024-04-06 03:53:03,686: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:53:03.687116468Z [2024-04-06 03:53:03,686: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:53:03.687332004Z [2024-04-06 03:53:03,687: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:53:03.687485182Z [2024-04-06 03:53:03,687: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:53:03.687842870Z [2024-04-06 03:53:03,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:53:03.688020083Z [2024-04-06 03:53:03,687: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:53:03.930554733Z [2024-04-06 03:53:03,930: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:53:04.013424411Z [2024-04-06 03:53:04,012: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:53:04.032304642Z [2024-04-06 03:53:04,031: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:53:04.102409484Z [2024-04-06 03:53:04,102: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:53:04.106597235Z [2024-04-06 03:53:04,106: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:53:04.106635494Z [2024-04-06 03:53:04,106: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:53:04.106663779Z [2024-04-06 03:53:04,106: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:53:04.106721147Z [2024-04-06 03:53:04,106: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:53:04.106929679Z [2024-04-06 03:53:04,106: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:53:04.106941205Z [2024-04-06 03:53:04,106: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:53:04.227529051Z [2024-04-06 03:53:04,227: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:53:06.226574776Z [2024-04-06 03:53:06,225: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[abe5c1d0-00d0-476c-9991-96825a94ccd4] succeeded in 5.439085694999449s: None 2024-04-06T03:53:06.522603185Z [2024-04-06 03:53:06,521: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e54a8214-9751-4b95-95f4-ef634c0d8d3c] succeeded in 5.716229456000292s: None 2024-04-06T03:54:00.324428028Z [2024-04-06 03:54:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7997df8e-1537-4727-9bff-b7d95bd2fc94] received 2024-04-06T03:54:00.335222124Z [2024-04-06 03:54:00,334: INFO/ForkPoolWorker-15] [7997df8e-1537-4727-9bff-b7d95bd2fc94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:54:00.339479953Z [2024-04-06 03:54:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3f884be-728b-4977-9f80-b6b14dbdcc0f] received 2024-04-06T03:54:00.348165503Z [2024-04-06 03:54:00,347: INFO/ForkPoolWorker-16] [c3f884be-728b-4977-9f80-b6b14dbdcc0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:54:00.353750396Z [2024-04-06 03:54:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a189460-e382-4306-ad7b-35ed54b71751] received 2024-04-06T03:54:00.369556402Z [2024-04-06 03:54:00,369: INFO/ForkPoolWorker-1] [0a189460-e382-4306-ad7b-35ed54b71751] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:54:00.645475028Z [2024-04-06 03:54:00,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:54:00.667428889Z [2024-04-06 03:54:00,663: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:54:00.677043443Z [2024-04-06 03:54:00,673: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:54:01.099618008Z [2024-04-06 03:54:01,099: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:54:01.819808671Z [2024-04-06 03:54:01,819: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3f884be-728b-4977-9f80-b6b14dbdcc0f] succeeded in 1.4785206260003179s: None 2024-04-06T03:54:02.307902589Z [2024-04-06 03:54:02,307: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:54:02.312329920Z [2024-04-06 03:54:02,311: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:54:02.367536271Z [2024-04-06 03:54:02,367: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:54:02.369859182Z [2024-04-06 03:54:02,369: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:54:02.370223985Z [2024-04-06 03:54:02,369: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:54:02.370380336Z [2024-04-06 03:54:02,370: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:54:02.370448753Z [2024-04-06 03:54:02,370: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:54:02.372122358Z [2024-04-06 03:54:02,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:54:02.372252921Z [2024-04-06 03:54:02,372: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:54:02.559735496Z [2024-04-06 03:54:02,559: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:54:02.584315503Z [2024-04-06 03:54:02,583: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:54:02.588232668Z [2024-04-06 03:54:02,587: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:54:02.649002977Z [2024-04-06 03:54:02,648: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:54:02.656410038Z [2024-04-06 03:54:02,656: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:54:02.656498303Z [2024-04-06 03:54:02,656: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:54:02.656682428Z [2024-04-06 03:54:02,656: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:54:02.656792205Z [2024-04-06 03:54:02,656: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:54:02.657118158Z [2024-04-06 03:54:02,656: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:54:02.657185536Z [2024-04-06 03:54:02,657: INFO/ForkPoolWorker-1] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:54:02.823812964Z [2024-04-06 03:54:02,823: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:54:04.726842818Z [2024-04-06 03:54:04,726: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a189460-e382-4306-ad7b-35ed54b71751] succeeded in 4.37106267299896s: None 2024-04-06T03:54:05.343973537Z [2024-04-06 03:54:05,343: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7997df8e-1537-4727-9bff-b7d95bd2fc94] succeeded in 5.016247666000709s: None 2024-04-06T03:55:00.354522393Z [2024-04-06 03:55:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8f98739-1689-4f11-a777-1aad4588c8ca] received 2024-04-06T03:55:00.358988766Z [2024-04-06 03:55:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30626899-4edd-4132-b0f0-1e4fc1141f06] received 2024-04-06T03:55:00.360300552Z [2024-04-06 03:55:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb68a428-ab6c-4777-bcab-4553a57b2267] received 2024-04-06T03:55:00.377116953Z [2024-04-06 03:55:00,376: INFO/ForkPoolWorker-16] [30626899-4edd-4132-b0f0-1e4fc1141f06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:55:00.377282342Z [2024-04-06 03:55:00,376: INFO/ForkPoolWorker-1] [bb68a428-ab6c-4777-bcab-4553a57b2267] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:55:00.378609451Z [2024-04-06 03:55:00,378: INFO/ForkPoolWorker-15] [e8f98739-1689-4f11-a777-1aad4588c8ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:55:00.654232128Z [2024-04-06 03:55:00,637: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:55:00.690459270Z [2024-04-06 03:55:00,686: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:55:00.714664798Z [2024-04-06 03:55:00,709: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:55:02.144890067Z [2024-04-06 03:55:02,144: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:55:02.148051168Z [2024-04-06 03:55:02,147: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:55:02.189442921Z [2024-04-06 03:55:02,189: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:55:02.193872654Z [2024-04-06 03:55:02,192: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:55:02.193887301Z [2024-04-06 03:55:02,193: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:55:02.193908081Z [2024-04-06 03:55:02,193: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:55:02.193911896Z [2024-04-06 03:55:02,193: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:55:02.217346260Z [2024-04-06 03:55:02,193: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:55:02.217374994Z [2024-04-06 03:55:02,214: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:55:02.426350793Z [2024-04-06 03:55:02,425: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:55:02.433124773Z [2024-04-06 03:55:02,432: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:55:02.461564535Z [2024-04-06 03:55:02,461: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:55:02.530471102Z [2024-04-06 03:55:02,530: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:55:02.534181691Z [2024-04-06 03:55:02,533: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:55:02.534217956Z [2024-04-06 03:55:02,534: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:55:02.534520479Z [2024-04-06 03:55:02,534: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:55:02.534673424Z [2024-04-06 03:55:02,534: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:55:02.535498253Z [2024-04-06 03:55:02,535: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:55:02.535631837Z [2024-04-06 03:55:02,535: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:55:02.636371435Z [2024-04-06 03:55:02,636: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:55:03.200064650Z [2024-04-06 03:55:03,199: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:55:03.203424812Z [2024-04-06 03:55:03,203: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:55:03.280211467Z [2024-04-06 03:55:03,280: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:55:03.281174347Z [2024-04-06 03:55:03,280: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:55:03.281190762Z [2024-04-06 03:55:03,281: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:55:03.281305989Z [2024-04-06 03:55:03,281: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:55:03.281333814Z [2024-04-06 03:55:03,281: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:55:03.282312429Z [2024-04-06 03:55:03,282: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:55:03.282329105Z [2024-04-06 03:55:03,282: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:55:03.452602541Z [2024-04-06 03:55:03,452: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:55:04.202038076Z [2024-04-06 03:55:04,201: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8f98739-1689-4f11-a777-1aad4588c8ca] succeeded in 3.8446906580011273s: None 2024-04-06T03:55:04.527659019Z [2024-04-06 03:55:04,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50965593-2694-4d7d-bfb3-9be87c3f63c3] received 2024-04-06T03:55:04.537607366Z [2024-04-06 03:55:04,537: INFO/ForkPoolWorker-15] [50965593-2694-4d7d-bfb3-9be87c3f63c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:55:04.886882575Z [2024-04-06 03:55:04,886: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb68a428-ab6c-4777-bcab-4553a57b2267] succeeded in 4.524486569000146s: None 2024-04-06T03:55:04.959123324Z [2024-04-06 03:55:04,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:55:05.241147491Z [2024-04-06 03:55:05,240: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30626899-4edd-4132-b0f0-1e4fc1141f06] succeeded in 4.8791901799995685s: None 2024-04-06T03:55:06.302302984Z [2024-04-06 03:55:06,301: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:55:06.305316785Z [2024-04-06 03:55:06,304: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:55:06.341386343Z [2024-04-06 03:55:06,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:55:06.343861121Z [2024-04-06 03:55:06,343: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:55:06.343884432Z [2024-04-06 03:55:06,343: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:55:06.344045815Z [2024-04-06 03:55:06,343: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:55:06.344062104Z [2024-04-06 03:55:06,343: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:55:06.344746878Z [2024-04-06 03:55:06,344: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:55:06.344931661Z [2024-04-06 03:55:06,344: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:55:06.449313331Z [2024-04-06 03:55:06,448: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:55:07.108142730Z [2024-04-06 03:55:07,107: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50965593-2694-4d7d-bfb3-9be87c3f63c3] succeeded in 2.5769620230003056s: None 2024-04-06T03:55:07.709166810Z [2024-04-06 03:55:07,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02f33789-ce2f-49e3-8c55-34970ee2969c] received 2024-04-06T03:55:07.715982315Z [2024-04-06 03:55:07,715: INFO/ForkPoolWorker-15] [02f33789-ce2f-49e3-8c55-34970ee2969c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:55:07.987202612Z [2024-04-06 03:55:07,984: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:55:09.324912713Z [2024-04-06 03:55:09,324: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:55:09.328153780Z [2024-04-06 03:55:09,327: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:55:09.362835120Z [2024-04-06 03:55:09,362: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:55:09.365556907Z [2024-04-06 03:55:09,365: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:55:09.369005997Z [2024-04-06 03:55:09,368: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:55:09.369162822Z [2024-04-06 03:55:09,368: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:55:09.369275050Z [2024-04-06 03:55:09,369: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:55:09.369550207Z [2024-04-06 03:55:09,369: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:55:09.369744060Z [2024-04-06 03:55:09,369: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:55:09.484397235Z [2024-04-06 03:55:09,484: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:55:10.029770378Z [2024-04-06 03:55:10,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02f33789-ce2f-49e3-8c55-34970ee2969c] succeeded in 2.3191688660008367s: None 2024-04-06T03:55:10.717119720Z [2024-04-06 03:55:10,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d068a612-d1eb-4c43-973e-c94ef42d66ae] received 2024-04-06T03:55:10.746072267Z [2024-04-06 03:55:10,745: INFO/ForkPoolWorker-15] [d068a612-d1eb-4c43-973e-c94ef42d66ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:55:11.034544393Z [2024-04-06 03:55:11,031: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T03:55:12.306395516Z [2024-04-06 03:55:12,306: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:55:12.309628247Z [2024-04-06 03:55:12,309: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:55:12.343698675Z [2024-04-06 03:55:12,343: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:55:12.347462729Z [2024-04-06 03:55:12,347: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:55:12.347612737Z [2024-04-06 03:55:12,347: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:55:12.347762565Z [2024-04-06 03:55:12,347: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:55:12.347815735Z [2024-04-06 03:55:12,347: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:55:12.348098984Z [2024-04-06 03:55:12,347: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T03:55:12.348124537Z [2024-04-06 03:55:12,348: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:55:12.436627577Z [2024-04-06 03:55:12,436: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:55:13.066982704Z [2024-04-06 03:55:13,066: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d068a612-d1eb-4c43-973e-c94ef42d66ae] succeeded in 2.3487677769990114s: None 2024-04-06T03:56:00.520487542Z [2024-04-06 03:56:00,520: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff5b3253-4aa3-4814-9325-c6053901bb8b] received 2024-04-06T03:56:00.532601389Z [2024-04-06 03:56:00,532: INFO/ForkPoolWorker-15] [ff5b3253-4aa3-4814-9325-c6053901bb8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:56:00.538582857Z [2024-04-06 03:56:00,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9d4bf1c-ddcf-4e08-8c59-bfd2dc370ab0] received 2024-04-06T03:56:00.541134942Z [2024-04-06 03:56:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e12c5bfe-3b57-4ff2-8298-1aef974c4526] received 2024-04-06T03:56:00.551810920Z [2024-04-06 03:56:00,551: INFO/ForkPoolWorker-1] [e12c5bfe-3b57-4ff2-8298-1aef974c4526] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:56:00.555405856Z [2024-04-06 03:56:00,555: INFO/ForkPoolWorker-16] [f9d4bf1c-ddcf-4e08-8c59-bfd2dc370ab0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:56:00.885958951Z [2024-04-06 03:56:00,882: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:56:00.926680439Z [2024-04-06 03:56:00,922: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:56:01.031356564Z [2024-04-06 03:56:01,021: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:56:01.367069885Z [2024-04-06 03:56:01,366: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:56:02.167974949Z [2024-04-06 03:56:02,167: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff5b3253-4aa3-4814-9325-c6053901bb8b] succeeded in 1.6455622779994883s: None 2024-04-06T03:56:02.823406611Z [2024-04-06 03:56:02,823: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:56:02.831997437Z [2024-04-06 03:56:02,831: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:56:02.909090925Z [2024-04-06 03:56:02,908: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:56:02.918895141Z [2024-04-06 03:56:02,918: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:56:02.920616912Z [2024-04-06 03:56:02,918: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:56:02.920875101Z [2024-04-06 03:56:02,920: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:56:02.924925393Z [2024-04-06 03:56:02,924: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:56:02.925403050Z [2024-04-06 03:56:02,925: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:56:02.925414614Z [2024-04-06 03:56:02,925: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:56:03.095795645Z [2024-04-06 03:56:03,095: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:56:03.184455416Z [2024-04-06 03:56:03,184: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T03:56:03.198388927Z [2024-04-06 03:56:03,189: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:56:03.269904410Z [2024-04-06 03:56:03,269: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T03:56:03.271719637Z [2024-04-06 03:56:03,271: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:56:03.271828892Z [2024-04-06 03:56:03,271: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:56:03.272018078Z [2024-04-06 03:56:03,271: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:56:03.272184217Z [2024-04-06 03:56:03,272: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T03:56:03.272448534Z [2024-04-06 03:56:03,272: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:56:03.272595773Z [2024-04-06 03:56:03,272: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:56:03.357176657Z [2024-04-06 03:56:03,356: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:56:04.892869198Z [2024-04-06 03:56:04,892: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f9d4bf1c-ddcf-4e08-8c59-bfd2dc370ab0] succeeded in 4.349391306999678s: None 2024-04-06T03:56:05.448804559Z [2024-04-06 03:56:05,447: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e12c5bfe-3b57-4ff2-8298-1aef974c4526] succeeded in 4.904775208999126s: None 2024-04-06T03:57:00.347051582Z [2024-04-06 03:57:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36f2d49c-21e5-464c-b215-5c7b34acef93] received 2024-04-06T03:57:00.357284255Z [2024-04-06 03:57:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30447556-efad-4e69-a127-bd0aaf2e3c84] received 2024-04-06T03:57:00.360054483Z [2024-04-06 03:57:00,359: INFO/ForkPoolWorker-15] [36f2d49c-21e5-464c-b215-5c7b34acef93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:57:00.376088738Z [2024-04-06 03:57:00,375: INFO/ForkPoolWorker-16] [30447556-efad-4e69-a127-bd0aaf2e3c84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:57:00.661905128Z [2024-04-06 03:57:00,658: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:57:00.677540165Z [2024-04-06 03:57:00,673: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:57:01.989029405Z [2024-04-06 03:57:01,988: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:57:01.992769896Z [2024-04-06 03:57:01,992: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:57:02.029144721Z [2024-04-06 03:57:02,028: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:57:02.036344619Z [2024-04-06 03:57:02,035: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:57:02.045145848Z [2024-04-06 03:57:02,044: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:57:02.055178955Z [2024-04-06 03:57:02,054: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:57:02.056130874Z [2024-04-06 03:57:02,055: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:57:02.056873876Z [2024-04-06 03:57:02,056: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:57:02.057795155Z [2024-04-06 03:57:02,056: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:57:02.058045940Z [2024-04-06 03:57:02,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:57:02.058112034Z [2024-04-06 03:57:02,058: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:57:02.129076088Z [2024-04-06 03:57:02,128: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:57:02.133050141Z [2024-04-06 03:57:02,132: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:57:02.133286486Z [2024-04-06 03:57:02,132: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:57:02.133518333Z [2024-04-06 03:57:02,133: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:57:02.133687593Z [2024-04-06 03:57:02,133: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:57:02.134247071Z [2024-04-06 03:57:02,134: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:57:02.134418815Z [2024-04-06 03:57:02,134: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:57:02.163645472Z [2024-04-06 03:57:02,163: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:57:02.368637771Z [2024-04-06 03:57:02,368: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:57:04.223839635Z [2024-04-06 03:57:04,223: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30447556-efad-4e69-a127-bd0aaf2e3c84] succeeded in 3.8639824420006335s: None 2024-04-06T03:57:04.946585027Z [2024-04-06 03:57:04,946: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36f2d49c-21e5-464c-b215-5c7b34acef93] succeeded in 4.597417390999908s: None 2024-04-06T03:58:00.737086146Z [2024-04-06 03:58:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a307f1fd-2198-4c88-9aaa-d74a6b6447c6] received 2024-04-06T03:58:00.743312610Z [2024-04-06 03:58:00,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[975d68a5-d1c8-4e38-9e9e-8fff9d734224] received 2024-04-06T03:58:00.768735770Z [2024-04-06 03:58:00,768: INFO/ForkPoolWorker-16] [975d68a5-d1c8-4e38-9e9e-8fff9d734224] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:58:00.775340086Z [2024-04-06 03:58:00,775: INFO/ForkPoolWorker-15] [a307f1fd-2198-4c88-9aaa-d74a6b6447c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:58:00.791745149Z [2024-04-06 03:58:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d640ce28-0a55-480d-b070-f2c7c771245f] received 2024-04-06T03:58:00.822775754Z [2024-04-06 03:58:00,822: INFO/ForkPoolWorker-1] [d640ce28-0a55-480d-b070-f2c7c771245f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:58:01.214479606Z [2024-04-06 03:58:01,211: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:58:01.262028251Z [2024-04-06 03:58:01,258: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:58:01.318510673Z [2024-04-06 03:58:01,314: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T03:58:01.844940148Z [2024-04-06 03:58:01,844: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:58:03.010978007Z [2024-04-06 03:58:03,010: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:58:03.014239523Z [2024-04-06 03:58:03,013: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:58:03.039510455Z [2024-04-06 03:58:03,039: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:58:03.040586332Z [2024-04-06 03:58:03,040: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:58:03.041195203Z [2024-04-06 03:58:03,041: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:58:03.041368819Z [2024-04-06 03:58:03,041: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:58:03.041448720Z [2024-04-06 03:58:03,041: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:58:03.041865601Z [2024-04-06 03:58:03,041: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:58:03.041949943Z [2024-04-06 03:58:03,041: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:58:03.068911417Z [2024-04-06 03:58:03,068: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:58:03.073453061Z [2024-04-06 03:58:03,072: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:58:03.073790576Z [2024-04-06 03:58:03,068: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d640ce28-0a55-480d-b070-f2c7c771245f] succeeded in 2.275136782000118s: None 2024-04-06T03:58:03.125332094Z [2024-04-06 03:58:03,125: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:58:03.131371979Z [2024-04-06 03:58:03,131: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:58:03.131514108Z [2024-04-06 03:58:03,131: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:58:03.131741215Z [2024-04-06 03:58:03,131: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:58:03.131866545Z [2024-04-06 03:58:03,131: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:58:03.132209322Z [2024-04-06 03:58:03,132: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:58:03.132370073Z [2024-04-06 03:58:03,132: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:58:03.150705536Z [2024-04-06 03:58:03,150: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:58:03.282257332Z [2024-04-06 03:58:03,282: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:58:04.994596996Z [2024-04-06 03:58:04,994: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[975d68a5-d1c8-4e38-9e9e-8fff9d734224] succeeded in 4.250810610999906s: None 2024-04-06T03:58:05.310553856Z [2024-04-06 03:58:05,310: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a307f1fd-2198-4c88-9aaa-d74a6b6447c6] succeeded in 4.562971630999527s: None 2024-04-06T03:59:00.739697940Z [2024-04-06 03:59:00,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c34f237-48d9-42ac-ae44-411010815317] received 2024-04-06T03:59:00.755185158Z [2024-04-06 03:59:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82714ea5-75d6-4966-9572-b319ea2cb879] received 2024-04-06T03:59:00.766006826Z [2024-04-06 03:59:00,760: INFO/ForkPoolWorker-15] [5c34f237-48d9-42ac-ae44-411010815317] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:59:00.767410317Z [2024-04-06 03:59:00,767: INFO/ForkPoolWorker-16] [82714ea5-75d6-4966-9572-b319ea2cb879] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:59:01.142276961Z [2024-04-06 03:59:01,138: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T03:59:01.168098979Z [2024-04-06 03:59:01,164: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T03:59:02.474705688Z [2024-04-06 03:59:02,474: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T03:59:02.478165220Z [2024-04-06 03:59:02,477: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:59:02.506644104Z [2024-04-06 03:59:02,506: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T03:59:02.508771775Z [2024-04-06 03:59:02,508: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:59:02.508893529Z [2024-04-06 03:59:02,508: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:59:02.509071372Z [2024-04-06 03:59:02,508: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:59:02.509185898Z [2024-04-06 03:59:02,509: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T03:59:02.509483491Z [2024-04-06 03:59:02,509: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T03:59:02.509621710Z [2024-04-06 03:59:02,509: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:59:02.595912453Z [2024-04-06 03:59:02,595: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:59:02.892969234Z [2024-04-06 03:59:02,892: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T03:59:02.896323178Z [2024-04-06 03:59:02,895: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T03:59:02.955228183Z [2024-04-06 03:59:02,955: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T03:59:02.958921795Z [2024-04-06 03:59:02,958: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T03:59:02.959033534Z [2024-04-06 03:59:02,958: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T03:59:02.959215372Z [2024-04-06 03:59:02,959: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T03:59:02.959317179Z [2024-04-06 03:59:02,959: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T03:59:02.959645025Z [2024-04-06 03:59:02,959: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T03:59:02.959807324Z [2024-04-06 03:59:02,959: INFO/ForkPoolWorker-15] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T03:59:03.056752735Z [2024-04-06 03:59:03,056: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T03:59:05.055492542Z [2024-04-06 03:59:05,055: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c34f237-48d9-42ac-ae44-411010815317] succeeded in 4.308823884000958s: None 2024-04-06T03:59:05.648627152Z [2024-04-06 03:59:05,647: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[82714ea5-75d6-4966-9572-b319ea2cb879] succeeded in 4.8895998029984185s: None 2024-04-06T04:00:00.915132438Z [2024-04-06 04:00:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74dc595a-0cd6-43a0-adb2-fb08e0ad3bae] received 2024-04-06T04:00:00.918200044Z [2024-04-06 04:00:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c69faef-09af-45c7-be54-afcca262c3c9] received 2024-04-06T04:00:00.931795911Z [2024-04-06 04:00:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af213bec-a12d-4833-9f51-2f78104fd3be] received 2024-04-06T04:00:00.932441628Z [2024-04-06 04:00:00,931: INFO/ForkPoolWorker-15] [74dc595a-0cd6-43a0-adb2-fb08e0ad3bae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T04:00:00.936403771Z [2024-04-06 04:00:00,936: INFO/ForkPoolWorker-16] [7c69faef-09af-45c7-be54-afcca262c3c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T04:00:00.941537116Z [2024-04-06 04:00:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a40fd583-6844-4fdc-a464-c9b822b25f49] received 2024-04-06T04:00:00.961297475Z [2024-04-06 04:00:00,960: INFO/ForkPoolWorker-1] [af213bec-a12d-4833-9f51-2f78104fd3be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T04:00:01.004216235Z [2024-04-06 04:00:00,995: INFO/ForkPoolWorker-2] [a40fd583-6844-4fdc-a464-c9b822b25f49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T04:00:01.539603410Z [2024-04-06 04:00:01,535: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T04:00:01.610805639Z [2024-04-06 04:00:01,607: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T04:00:01.632570291Z [2024-04-06 04:00:01,628: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T04:00:01.663204310Z [2024-04-06 04:00:01,643: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T04:00:01.861764587Z [2024-04-06 04:00:01,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:00:03.382989572Z [2024-04-06 04:00:03,382: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c69faef-09af-45c7-be54-afcca262c3c9] succeeded in 2.46036341800027s: None 2024-04-06T04:00:03.826580090Z [2024-04-06 04:00:03,826: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T04:00:03.830058891Z [2024-04-06 04:00:03,829: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:00:03.868698714Z [2024-04-06 04:00:03,868: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T04:00:03.870987901Z [2024-04-06 04:00:03,870: INFO/ForkPoolWorker-2] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:00:03.871125521Z [2024-04-06 04:00:03,870: INFO/ForkPoolWorker-2] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:00:03.871226514Z [2024-04-06 04:00:03,870: INFO/ForkPoolWorker-2] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:00:03.871238607Z [2024-04-06 04:00:03,871: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T04:00:03.871933566Z [2024-04-06 04:00:03,871: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T04:00:03.871993788Z [2024-04-06 04:00:03,871: INFO/ForkPoolWorker-2] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:00:03.996849698Z [2024-04-06 04:00:03,996: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:00:04.840485453Z [2024-04-06 04:00:04,840: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T04:00:04.844173592Z [2024-04-06 04:00:04,843: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:00:04.892128558Z [2024-04-06 04:00:04,891: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T04:00:04.893596999Z [2024-04-06 04:00:04,893: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:00:04.893951744Z [2024-04-06 04:00:04,893: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:00:04.894453612Z [2024-04-06 04:00:04,894: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:00:04.895439112Z [2024-04-06 04:00:04,894: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T04:00:04.896014627Z [2024-04-06 04:00:04,895: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T04:00:04.897373939Z [2024-04-06 04:00:04,897: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:00:04.979734831Z [2024-04-06 04:00:04,979: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:00:05.345530202Z [2024-04-06 04:00:05,345: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T04:00:05.349032739Z [2024-04-06 04:00:05,348: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:00:05.380320729Z [2024-04-06 04:00:05,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T04:00:05.384288710Z [2024-04-06 04:00:05,384: INFO/ForkPoolWorker-1] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:00:05.384476385Z [2024-04-06 04:00:05,384: INFO/ForkPoolWorker-1] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:00:05.384722674Z [2024-04-06 04:00:05,384: INFO/ForkPoolWorker-1] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:00:05.384887114Z [2024-04-06 04:00:05,384: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T04:00:05.385239443Z [2024-04-06 04:00:05,385: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T04:00:05.385439212Z [2024-04-06 04:00:05,385: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:00:05.502277114Z [2024-04-06 04:00:05,502: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:00:05.547690301Z [2024-04-06 04:00:05,547: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74dc595a-0cd6-43a0-adb2-fb08e0ad3bae] succeeded in 4.625615674000073s: None 2024-04-06T04:00:06.132321176Z [2024-04-06 04:00:06,131: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a40fd583-6844-4fdc-a464-c9b822b25f49] succeeded in 5.1735442009994586s: None 2024-04-06T04:00:06.318977631Z [2024-04-06 04:00:06,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f8b8be2-e60d-47cb-a268-0284dcf6d1b3] received 2024-04-06T04:00:06.326883460Z [2024-04-06 04:00:06,326: INFO/ForkPoolWorker-15] [5f8b8be2-e60d-47cb-a268-0284dcf6d1b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T04:00:06.615688406Z [2024-04-06 04:00:06,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T04:00:07.800533049Z [2024-04-06 04:00:07,800: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T04:00:07.805113254Z [2024-04-06 04:00:07,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:00:07.833523810Z [2024-04-06 04:00:07,833: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T04:00:07.836038444Z [2024-04-06 04:00:07,835: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:00:07.836054051Z [2024-04-06 04:00:07,835: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:00:07.836714324Z [2024-04-06 04:00:07,836: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:00:07.836866403Z [2024-04-06 04:00:07,836: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T04:00:07.837374054Z [2024-04-06 04:00:07,837: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T04:00:07.837578310Z [2024-04-06 04:00:07,837: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:00:07.937090580Z [2024-04-06 04:00:07,936: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:00:08.791845145Z [2024-04-06 04:00:08,790: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f8b8be2-e60d-47cb-a268-0284dcf6d1b3] succeeded in 2.469005192999248s: None 2024-04-06T04:00:08.827029770Z [2024-04-06 04:00:08,826: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[af213bec-a12d-4833-9f51-2f78104fd3be] succeeded in 7.883392629000809s: None 2024-04-06T04:00:08.898382676Z [2024-04-06 04:00:08,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8a37d2a-636a-46ac-8f1e-dc87e5e333ad] received 2024-04-06T04:00:08.907899116Z [2024-04-06 04:00:08,907: INFO/ForkPoolWorker-15] [f8a37d2a-636a-46ac-8f1e-dc87e5e333ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T04:00:09.197383937Z [2024-04-06 04:00:09,193: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T04:00:10.248417362Z [2024-04-06 04:00:10,248: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T04:00:10.251532369Z [2024-04-06 04:00:10,251: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:00:10.294631599Z [2024-04-06 04:00:10,294: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T04:00:10.298873582Z [2024-04-06 04:00:10,298: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:00:10.298989696Z [2024-04-06 04:00:10,298: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:00:10.299256246Z [2024-04-06 04:00:10,298: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:00:10.299374042Z [2024-04-06 04:00:10,299: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T04:00:10.299785234Z [2024-04-06 04:00:10,299: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T04:00:10.299911369Z [2024-04-06 04:00:10,299: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:00:10.430409082Z [2024-04-06 04:00:10,430: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:00:11.066135970Z [2024-04-06 04:00:11,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8a37d2a-636a-46ac-8f1e-dc87e5e333ad] succeeded in 2.1645230510002875s: None 2024-04-06T04:00:11.302000005Z [2024-04-06 04:00:11,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9759367b-488f-400a-b43a-6431884c9adc] received 2024-04-06T04:00:11.308209287Z [2024-04-06 04:00:11,306: INFO/ForkPoolWorker-15] [9759367b-488f-400a-b43a-6431884c9adc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T04:00:11.701373107Z [2024-04-06 04:00:11,690: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T04:00:12.932485304Z [2024-04-06 04:00:12,932: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T04:00:12.935980044Z [2024-04-06 04:00:12,935: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:00:12.965736930Z [2024-04-06 04:00:12,965: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T04:00:12.967444822Z [2024-04-06 04:00:12,967: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:00:12.967678600Z [2024-04-06 04:00:12,967: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:00:12.968071312Z [2024-04-06 04:00:12,967: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:00:12.968403783Z [2024-04-06 04:00:12,968: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T04:00:12.968999815Z [2024-04-06 04:00:12,968: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T04:00:12.969513473Z [2024-04-06 04:00:12,969: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:00:13.067614895Z [2024-04-06 04:00:13,067: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:00:13.690105297Z [2024-04-06 04:00:13,689: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9759367b-488f-400a-b43a-6431884c9adc] succeeded in 2.388552020000134s: None 2024-04-06T04:01:00.967025924Z [2024-04-06 04:01:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b469d98-36d2-441f-b4db-8d123e6f9d7b] received 2024-04-06T04:01:00.975746173Z [2024-04-06 04:01:00,975: INFO/ForkPoolWorker-15] [0b469d98-36d2-441f-b4db-8d123e6f9d7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T04:01:00.979391562Z [2024-04-06 04:01:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e418a01-b97e-48d4-95f1-86461e4bbb7c] received 2024-04-06T04:01:00.993478647Z [2024-04-06 04:01:00,993: INFO/ForkPoolWorker-16] [4e418a01-b97e-48d4-95f1-86461e4bbb7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T04:01:01.334242035Z [2024-04-06 04:01:01,330: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T04:01:01.355869205Z [2024-04-06 04:01:01,352: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T04:01:02.760202776Z [2024-04-06 04:01:02,759: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T04:01:02.763565776Z [2024-04-06 04:01:02,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:01:02.799756193Z [2024-04-06 04:01:02,799: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T04:01:02.801034441Z [2024-04-06 04:01:02,800: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:01:02.801054265Z [2024-04-06 04:01:02,800: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:01:02.801310481Z [2024-04-06 04:01:02,801: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:01:02.801351971Z [2024-04-06 04:01:02,801: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T04:01:02.801547769Z [2024-04-06 04:01:02,801: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T04:01:02.801601066Z [2024-04-06 04:01:02,801: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:01:02.838612938Z [2024-04-06 04:01:02,838: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T04:01:02.842368307Z [2024-04-06 04:01:02,841: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:01:02.880102057Z [2024-04-06 04:01:02,879: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T04:01:02.882038533Z [2024-04-06 04:01:02,880: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:01:02.882129892Z [2024-04-06 04:01:02,882: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:01:02.882255069Z [2024-04-06 04:01:02,882: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:01:02.882308420Z [2024-04-06 04:01:02,882: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T04:01:02.882610880Z [2024-04-06 04:01:02,882: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T04:01:02.882652051Z [2024-04-06 04:01:02,882: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:01:02.895860068Z [2024-04-06 04:01:02,895: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:01:03.046575507Z [2024-04-06 04:01:03,046: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:01:04.736870831Z [2024-04-06 04:01:04,736: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4e418a01-b97e-48d4-95f1-86461e4bbb7c] succeeded in 3.7554731679992983s: None 2024-04-06T04:01:05.309990797Z [2024-04-06 04:01:05,309: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b469d98-36d2-441f-b4db-8d123e6f9d7b] succeeded in 4.341149536001467s: None 2024-04-06T04:02:00.809907870Z [2024-04-06 04:02:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0d36da9-2fe6-48bc-a7a4-59b18398a401] received 2024-04-06T04:02:00.812333615Z [2024-04-06 04:02:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c13b054d-96dc-4319-a701-4bbf3994e8f7] received 2024-04-06T04:02:00.825688181Z [2024-04-06 04:02:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[260b4214-432a-4550-9f85-c8f9b693411d] received 2024-04-06T04:02:00.825771093Z [2024-04-06 04:02:00,824: INFO/ForkPoolWorker-15] [c0d36da9-2fe6-48bc-a7a4-59b18398a401] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T04:02:00.843181955Z [2024-04-06 04:02:00,842: INFO/ForkPoolWorker-16] [c13b054d-96dc-4319-a701-4bbf3994e8f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T04:02:00.860473086Z [2024-04-06 04:02:00,860: INFO/ForkPoolWorker-1] [260b4214-432a-4550-9f85-c8f9b693411d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T04:02:01.257494023Z [2024-04-06 04:02:01,253: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T04:02:01.394090708Z [2024-04-06 04:02:01,390: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T04:02:01.427747583Z [2024-04-06 04:02:01,422: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T04:02:01.908520001Z [2024-04-06 04:02:01,908: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:02:03.309464635Z [2024-04-06 04:02:03,309: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[260b4214-432a-4550-9f85-c8f9b693411d] succeeded in 2.4711559480001597s: None 2024-04-06T04:02:03.552258545Z [2024-04-06 04:02:03,551: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T04:02:03.555720883Z [2024-04-06 04:02:03,555: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:02:03.629243224Z [2024-04-06 04:02:03,629: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T04:02:03.631071034Z [2024-04-06 04:02:03,630: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:02:03.632497636Z [2024-04-06 04:02:03,631: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:02:03.632769227Z [2024-04-06 04:02:03,632: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:02:03.632915053Z [2024-04-06 04:02:03,632: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T04:02:03.633235290Z [2024-04-06 04:02:03,633: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T04:02:03.633642679Z [2024-04-06 04:02:03,633: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:02:03.822797026Z [2024-04-06 04:02:03,822: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:02:04.090968171Z [2024-04-06 04:02:04,090: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T04:02:04.094794440Z [2024-04-06 04:02:04,094: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:02:04.174099349Z [2024-04-06 04:02:04,173: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T04:02:04.176865068Z [2024-04-06 04:02:04,176: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:02:04.176989989Z [2024-04-06 04:02:04,176: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:02:04.177151588Z [2024-04-06 04:02:04,177: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:02:04.177245139Z [2024-04-06 04:02:04,177: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T04:02:04.177483503Z [2024-04-06 04:02:04,177: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T04:02:04.177605737Z [2024-04-06 04:02:04,177: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:02:04.331137337Z [2024-04-06 04:02:04,330: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:02:06.419426514Z [2024-04-06 04:02:06,418: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c13b054d-96dc-4319-a701-4bbf3994e8f7] succeeded in 5.597848552999494s: None 2024-04-06T04:02:06.930402402Z [2024-04-06 04:02:06,929: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0d36da9-2fe6-48bc-a7a4-59b18398a401] succeeded in 6.115126820001024s: None 2024-04-06T04:03:00.213396319Z [2024-04-06 04:03:00,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc76ae3d-b2cc-4b30-be06-9a8dcd75f747] received 2024-04-06T04:03:00.216988650Z [2024-04-06 04:03:00,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[810ebda6-d1e6-451b-9999-705de9227b73] received 2024-04-06T04:03:00.230555741Z [2024-04-06 04:03:00,230: INFO/ForkPoolWorker-15] [cc76ae3d-b2cc-4b30-be06-9a8dcd75f747] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T04:03:00.236789638Z [2024-04-06 04:03:00,236: INFO/ForkPoolWorker-16] [810ebda6-d1e6-451b-9999-705de9227b73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T04:03:00.518861452Z [2024-04-06 04:03:00,515: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T04:03:00.553326956Z [2024-04-06 04:03:00,549: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T04:03:01.866706279Z [2024-04-06 04:03:01,866: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T04:03:01.870912723Z [2024-04-06 04:03:01,870: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:03:01.918976326Z [2024-04-06 04:03:01,918: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T04:03:01.925786730Z [2024-04-06 04:03:01,925: INFO/ForkPoolWorker-15] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:03:01.925795282Z [2024-04-06 04:03:01,925: INFO/ForkPoolWorker-15] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:03:01.925935628Z [2024-04-06 04:03:01,925: INFO/ForkPoolWorker-15] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:03:01.925968140Z [2024-04-06 04:03:01,925: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T04:03:01.926183964Z [2024-04-06 04:03:01,926: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T04:03:01.926227725Z [2024-04-06 04:03:01,926: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:03:01.928539195Z [2024-04-06 04:03:01,928: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T04:03:01.931894584Z [2024-04-06 04:03:01,931: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'G8JdZY6ZQqDqZhshd49OGDM0QxLvVD8j'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T04:03:01.988328347Z [2024-04-06 04:03:01,988: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T04:03:01.992467171Z [2024-04-06 04:03:01,992: INFO/ForkPoolWorker-16] Read VIM 82c90c2d-11bf-4ca7-8786-12adb31c2d3f (_system-osm-vim) 2024-04-06T04:03:01.992722606Z [2024-04-06 04:03:01,992: INFO/ForkPoolWorker-16] Read VIM 26366e96-ab6b-4bac-84af-b822e289d1df (osm) 2024-04-06T04:03:01.992961104Z [2024-04-06 04:03:01,992: INFO/ForkPoolWorker-16] [{'_id': '82c90c2d-11bf-4ca7-8786-12adb31c2d3f', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '26366e96-ab6b-4bac-84af-b822e289d1df', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T04:03:01.993089618Z [2024-04-06 04:03:01,992: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T04:03:01.993508623Z [2024-04-06 04:03:01,993: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T04:03:01.993682532Z [2024-04-06 04:03:01,993: INFO/ForkPoolWorker-16] Creating DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df 2024-04-06T04:03:02.049999723Z [2024-04-06 04:03:02,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:03:02.151419203Z [2024-04-06 04:03:02,151: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T04:03:03.887971958Z [2024-04-06 04:03:03,887: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[810ebda6-d1e6-451b-9999-705de9227b73] succeeded in 3.668269715999486s: None 2024-04-06T04:03:04.211221552Z [2024-04-06 04:03:04,210: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc76ae3d-b2cc-4b30-be06-9a8dcd75f747] succeeded in 3.9938416439999855s: None 2024-04-06T01:29:57.588084563Z 2024-04-06T01:29:57.592327923Z Cleaning logs every 900 seconds 2024-04-06T01:29:57.592372570Z Trimming airflow logs to 15 days. 2024-04-06T01:30:00.637900802Z Trimming airflow logs to 15 days. 2024-04-06T01:30:01.833459872Z Trimming airflow logs to 15 days. 2024-04-06T01:45:00.909606707Z Trimming airflow logs to 15 days. 2024-04-06T01:45:01.953520525Z Trimming airflow logs to 15 days. 2024-04-06T02:00:00.049990433Z Trimming airflow logs to 15 days. 2024-04-06T02:00:01.099504934Z Trimming airflow logs to 15 days. 2024-04-06T02:15:00.184051713Z Trimming airflow logs to 15 days. 2024-04-06T02:15:01.228966735Z Trimming airflow logs to 15 days. 2024-04-06T02:30:00.301498333Z Trimming airflow logs to 15 days. 2024-04-06T02:30:01.341169347Z Trimming airflow logs to 15 days. 2024-04-06T02:45:00.423474869Z Trimming airflow logs to 15 days. 2024-04-06T02:45:01.463253956Z Trimming airflow logs to 15 days. 2024-04-06T03:00:00.549805916Z Trimming airflow logs to 15 days. 2024-04-06T03:00:01.602085333Z Trimming airflow logs to 15 days. 2024-04-06T03:15:00.661427461Z Trimming airflow logs to 15 days. 2024-04-06T03:15:01.755084099Z Trimming airflow logs to 15 days. 2024-04-06T03:30:00.814266218Z Trimming airflow logs to 15 days. 2024-04-06T03:30:01.890111295Z Trimming airflow logs to 15 days. 2024-04-06T03:45:00.950162874Z Trimming airflow logs to 15 days. 2024-04-06T04:00:00.077055251Z Trimming airflow logs to 15 days. 2024-04-06T04:00:01.145173924Z Trimming airflow logs to 15 days.