2024-06-24T22:08:23.673313157Z .. 2024-06-24T22:08:25.043947677Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-06-24T22:08:27.779119092Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-06-24T22:08:57.586760364Z 2024-06-24T22:09:00.208491236Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-06-24T22:09:07.602705234Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-06-24T22:09:24.287782070Z [2024-06-24 22:09:24 +0000] [29] [INFO] Starting gunicorn 20.1.0 2024-06-24T22:09:24.331914532Z [2024-06-24 22:09:24 +0000] [29] [INFO] Listening at: http://[::]:8793 (29) 2024-06-24T22:09:24.331963354Z [2024-06-24 22:09:24 +0000] [29] [INFO] Using worker: sync 2024-06-24T22:09:24.401355609Z [2024-06-24 22:09:24 +0000] [30] [INFO] Booting worker with pid: 30 2024-06-24T22:09:24.488314661Z [2024-06-24 22:09:24 +0000] [31] [INFO] Booting worker with pid: 31 2024-06-24T22:09:26.377214777Z 2024-06-24T22:09:26.377226829Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-06-24T22:09:26.377231068Z --- ***** ----- 2024-06-24T22:09:26.377234337Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-06-24 22:09:26 2024-06-24T22:09:26.377237197Z - *** --- * --- 2024-06-24T22:09:26.377241032Z - ** ---------- [config] 2024-06-24T22:09:26.377244491Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f10a8afae60 2024-06-24T22:09:26.377247281Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-06-24T22:09:26.377250086Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-06-24T22:09:26.377257625Z - *** --- * --- .> concurrency: 16 (prefork) 2024-06-24T22:09:26.377260424Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-06-24T22:09:26.377270276Z --- ***** ----- 2024-06-24T22:09:26.377273396Z -------------- [queues] 2024-06-24T22:09:26.377276313Z .> default exchange=default(direct) key=default 2024-06-24T22:09:26.377279176Z 2024-06-24T22:09:26.377281785Z 2024-06-24T22:09:26.377284559Z [tasks] 2024-06-24T22:09:26.377287403Z . airflow.executors.celery_executor.execute_command 2024-06-24T22:09:26.377290127Z 2024-06-24T22:09:36.772446646Z [2024-06-24 22:09:36,765: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-06-24T22:09:36.774761364Z [2024-06-24 22:09:36,773: INFO/MainProcess] mingle: searching for neighbors 2024-06-24T22:09:37.907552102Z [2024-06-24 22:09:37,906: INFO/MainProcess] mingle: all alone 2024-06-24T22:09:38.016144525Z [2024-06-24 22:09:38,013: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-06-24T22:09:38.484110440Z [2024-06-24 22:09:38,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72306e3c-7d60-4224-9a19-1c3c21768c81] received 2024-06-24T22:09:38.527356086Z [2024-06-24 22:09:38,526: INFO/ForkPoolWorker-15] [72306e3c-7d60-4224-9a19-1c3c21768c81] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:09:39.116677694Z [2024-06-24 22:09:39,113: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:09:40.034680591Z [2024-06-24 22:09:40,034: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:09:41.355065860Z [2024-06-24 22:09:41,353: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72306e3c-7d60-4224-9a19-1c3c21768c81] succeeded in 2.8709091979999357s: None 2024-06-24T22:10:01.139265385Z [2024-06-24 22:10:01,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15bb1afc-a585-440c-8458-32e827c8f4fa] received 2024-06-24T22:10:01.163365827Z [2024-06-24 22:10:01,162: INFO/ForkPoolWorker-15] [15bb1afc-a585-440c-8458-32e827c8f4fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:10:02.500694550Z [2024-06-24 22:10:02,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:10:03.333140609Z [2024-06-24 22:10:03,331: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:10:05.703793290Z [2024-06-24 22:10:05,703: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15bb1afc-a585-440c-8458-32e827c8f4fa] succeeded in 4.561837617999913s: None 2024-06-24T22:12:01.088110627Z [2024-06-24 22:12:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a2b8999-5c79-4996-a932-01fb07509c3f] received 2024-06-24T22:12:01.117569469Z [2024-06-24 22:12:01,117: INFO/ForkPoolWorker-15] [5a2b8999-5c79-4996-a932-01fb07509c3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:12:01.610442865Z [2024-06-24 22:12:01,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:12:01.954598616Z [2024-06-24 22:12:01,954: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:12:02.610940673Z [2024-06-24 22:12:02,610: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a2b8999-5c79-4996-a932-01fb07509c3f] succeeded in 1.515798487999973s: None 2024-06-24T22:14:00.692695494Z [2024-06-24 22:14:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b3877f7-7876-4233-80e1-1fe952714f71] received 2024-06-24T22:14:00.729759742Z [2024-06-24 22:14:00,729: INFO/ForkPoolWorker-15] [7b3877f7-7876-4233-80e1-1fe952714f71] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:14:01.213241712Z [2024-06-24 22:14:01,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:14:01.591687349Z [2024-06-24 22:14:01,591: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:14:02.267084713Z [2024-06-24 22:14:02,266: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b3877f7-7876-4233-80e1-1fe952714f71] succeeded in 1.564736757999981s: None 2024-06-24T22:15:55.676954303Z [2024-06-24 22:15:55,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ce9fce9-4fed-4aba-84f5-d16e7426ef9b] received 2024-06-24T22:15:55.717683544Z [2024-06-24 22:15:55,715: INFO/ForkPoolWorker-15] [4ce9fce9-4fed-4aba-84f5-d16e7426ef9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:15:56.200646647Z [2024-06-24 22:15:56,194: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:15:58.241258141Z [2024-06-24 22:15:58,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97e05e7b-9973-4e49-8e17-4531f719d95c] received 2024-06-24T22:15:58.327734635Z [2024-06-24 22:15:58,327: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:15:58.365171282Z [2024-06-24 22:15:58,364: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:15:58.582555061Z [2024-06-24 22:15:58,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:15:58.587621747Z [2024-06-24 22:15:58,587: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:15:58.590587082Z [2024-06-24 22:15:58,590: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:15:58.590749423Z [2024-06-24 22:15:58,590: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:15:58.590834143Z [2024-06-24 22:15:58,590: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:15:58.597001641Z [2024-06-24 22:15:58,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:15:58.598032382Z [2024-06-24 22:15:58,597: INFO/ForkPoolWorker-15] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:15:58.723495353Z [2024-06-24 22:15:58,722: INFO/ForkPoolWorker-16] [97e05e7b-9973-4e49-8e17-4531f719d95c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:15:58.953607587Z [2024-06-24 22:15:58,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:15:59.521112168Z [2024-06-24 22:15:59,516: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:16:01.891788600Z [2024-06-24 22:16:01,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccc83af7-8e54-48c9-b29f-c327492291d3] received 2024-06-24T22:16:01.978589091Z [2024-06-24 22:16:01,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc0cdfba-5c2b-465c-880c-a390619f55dc] received 2024-06-24T22:16:02.131180478Z [2024-06-24 22:16:02,130: INFO/ForkPoolWorker-1] [ccc83af7-8e54-48c9-b29f-c327492291d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:16:02.206338949Z [2024-06-24 22:16:02,205: INFO/ForkPoolWorker-2] [fc0cdfba-5c2b-465c-880c-a390619f55dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:16:02.275830481Z [2024-06-24 22:16:02,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ce9fce9-4fed-4aba-84f5-d16e7426ef9b] succeeded in 6.588442421999957s: None 2024-06-24T22:16:03.172040201Z [2024-06-24 22:16:03,168: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:16:03.452608525Z [2024-06-24 22:16:03,438: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:16:03.877450305Z [2024-06-24 22:16:03,877: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:16:03.962584859Z [2024-06-24 22:16:03,962: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:16:03.968268632Z [2024-06-24 22:16:03,967: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:16:04.118624801Z [2024-06-24 22:16:04,118: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:16:04.138190681Z [2024-06-24 22:16:04,136: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:16:04.138442245Z [2024-06-24 22:16:04,138: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:16:04.140236719Z [2024-06-24 22:16:04,139: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:16:04.145766331Z [2024-06-24 22:16:04,145: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:16:04.146579776Z [2024-06-24 22:16:04,146: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:16:04.149491398Z [2024-06-24 22:16:04,149: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:16:04.679116667Z [2024-06-24 22:16:04,678: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:16:05.430400298Z [2024-06-24 22:16:05,430: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ccc83af7-8e54-48c9-b29f-c327492291d3] succeeded in 3.525085783999998s: None 2024-06-24T22:16:05.969930650Z [2024-06-24 22:16:05,969: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-24T22:16:05.975177614Z [2024-06-24 22:16:05,974: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:16:06.063218784Z [2024-06-24 22:16:06,063: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-24T22:16:06.075312864Z [2024-06-24 22:16:06,075: INFO/ForkPoolWorker-2] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:16:06.075355515Z [2024-06-24 22:16:06,075: INFO/ForkPoolWorker-2] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:16:06.075512356Z [2024-06-24 22:16:06,075: INFO/ForkPoolWorker-2] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:16:06.075683802Z [2024-06-24 22:16:06,075: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-24T22:16:06.077375295Z [2024-06-24 22:16:06,077: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:16:06.077443715Z [2024-06-24 22:16:06,077: INFO/ForkPoolWorker-2] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:16:06.165411754Z [2024-06-24 22:16:06,165: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:16:06.470000926Z [2024-06-24 22:16:06,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20d97ac5-df96-4540-9383-ed3087ce3de0] received 2024-06-24T22:16:06.484138252Z [2024-06-24 22:16:06,483: INFO/ForkPoolWorker-15] [20d97ac5-df96-4540-9383-ed3087ce3de0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-24T22:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:16:07.129005664Z [2024-06-24 22:16:07,124: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:16:07.146030500Z [2024-06-24 22:16:07,145: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97e05e7b-9973-4e49-8e17-4531f719d95c] succeeded in 8.878602766000085s: None 2024-06-24T22:16:08.444371645Z [2024-06-24 22:16:08,443: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc0cdfba-5c2b-465c-880c-a390619f55dc] succeeded in 6.457433282000011s: None 2024-06-24T22:16:08.547075631Z [2024-06-24 22:16:08,546: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:16:08.551042976Z [2024-06-24 22:16:08,550: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:16:08.591567120Z [2024-06-24 22:16:08,590: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:16:08.595244594Z [2024-06-24 22:16:08,595: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:16:08.595335424Z [2024-06-24 22:16:08,595: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:16:08.595485936Z [2024-06-24 22:16:08,595: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:16:08.595563838Z [2024-06-24 22:16:08,595: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:16:08.595806575Z [2024-06-24 22:16:08,595: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:16:08.597100902Z [2024-06-24 22:16:08,596: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:16:08.688473612Z [2024-06-24 22:16:08,688: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:16:09.288600662Z [2024-06-24 22:16:09,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4549a26-59ae-4fff-a553-01079cb7867f] received 2024-06-24T22:16:09.305332222Z [2024-06-24 22:16:09,305: INFO/ForkPoolWorker-16] [f4549a26-59ae-4fff-a553-01079cb7867f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:16:09.475591804Z [2024-06-24 22:16:09,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20d97ac5-df96-4540-9383-ed3087ce3de0] succeeded in 3.004811399999994s: None 2024-06-24T22:16:09.497136106Z [2024-06-24 22:16:09,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ec28b16-d13e-49c0-ade4-bce26f629a51] received 2024-06-24T22:16:09.523613810Z [2024-06-24 22:16:09,523: INFO/ForkPoolWorker-15] [1ec28b16-d13e-49c0-ade4-bce26f629a51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'split_metrics', 'scheduled__2024-06-24T22:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:16:09.698094424Z [2024-06-24 22:16:09,694: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:16:09.924368051Z [2024-06-24 22:16:09,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:16:11.404011780Z [2024-06-24 22:16:11,403: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:16:11.409507159Z [2024-06-24 22:16:11,409: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:16:11.508132994Z [2024-06-24 22:16:11,507: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:16:11.509455987Z [2024-06-24 22:16:11,509: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:16:11.509561928Z [2024-06-24 22:16:11,509: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:16:11.512713730Z [2024-06-24 22:16:11,509: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:16:11.516792680Z [2024-06-24 22:16:11,516: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:16:11.517083180Z [2024-06-24 22:16:11,516: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:16:11.517113503Z [2024-06-24 22:16:11,516: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:16:11.626839712Z [2024-06-24 22:16:11,626: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:16:11.676265663Z [2024-06-24 22:16:11,675: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:16:11.700615564Z [2024-06-24 22:16:11,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:16:11.790274897Z [2024-06-24 22:16:11,790: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:16:11.794543135Z [2024-06-24 22:16:11,793: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:16:11.794621252Z [2024-06-24 22:16:11,794: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:16:11.794752474Z [2024-06-24 22:16:11,794: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:16:11.794782939Z [2024-06-24 22:16:11,794: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:16:11.795020520Z [2024-06-24 22:16:11,794: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:16:11.795061018Z [2024-06-24 22:16:11,794: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:16:11.989383969Z [2024-06-24 22:16:11,989: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:16:12.692765324Z [2024-06-24 22:16:12,692: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ec28b16-d13e-49c0-ade4-bce26f629a51] succeeded in 3.1930809300000647s: None 2024-06-24T22:16:13.244965934Z [2024-06-24 22:16:13,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a65b80c-4271-4f74-82d9-d8f1c69a41c1] received 2024-06-24T22:16:13.274506658Z [2024-06-24 22:16:13,274: INFO/ForkPoolWorker-15] [7a65b80c-4271-4f74-82d9-d8f1c69a41c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'collect_metrics', 'scheduled__2024-06-24T22:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-24T22:16:13.639688824Z [2024-06-24 22:16:13,635: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:16:13.769488495Z [2024-06-24 22:16:13,769: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4549a26-59ae-4fff-a553-01079cb7867f] succeeded in 4.472949842000048s: None 2024-06-24T22:16:15.200109540Z [2024-06-24 22:16:15,199: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:16:15.203751979Z [2024-06-24 22:16:15,203: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:16:15.230281336Z [2024-06-24 22:16:15,230: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:16:15.233588716Z [2024-06-24 22:16:15,233: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:16:15.245203805Z [2024-06-24 22:16:15,244: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:16:15.245867273Z [2024-06-24 22:16:15,245: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:16:15.246362707Z [2024-06-24 22:16:15,246: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:16:15.247037813Z [2024-06-24 22:16:15,246: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:16:15.247993276Z [2024-06-24 22:16:15,247: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:16:15.369503033Z [2024-06-24 22:16:15,369: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:16:15.901032257Z [2024-06-24 22:16:15,900: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a65b80c-4271-4f74-82d9-d8f1c69a41c1] succeeded in 2.6530995170001006s: None 2024-06-24T22:16:15.960212884Z [2024-06-24 22:16:15,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58280c20-77d8-48bd-a114-d3d05d9273b0] received 2024-06-24T22:16:15.968254137Z [2024-06-24 22:16:15,968: INFO/ForkPoolWorker-15] [58280c20-77d8-48bd-a114-d3d05d9273b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'send_prometheus', 'scheduled__2024-06-24T22:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:16:16.339284856Z [2024-06-24 22:16:16,335: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:16:17.816487178Z [2024-06-24 22:16:17,816: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:16:17.821286471Z [2024-06-24 22:16:17,820: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:16:17.897309276Z [2024-06-24 22:16:17,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:16:17.898380245Z [2024-06-24 22:16:17,898: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:16:17.898392153Z [2024-06-24 22:16:17,898: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:16:17.898507079Z [2024-06-24 22:16:17,898: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:16:17.898512967Z [2024-06-24 22:16:17,898: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:16:17.898767015Z [2024-06-24 22:16:17,898: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:16:17.898780313Z [2024-06-24 22:16:17,898: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:16:18.014231181Z [2024-06-24 22:16:18,014: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:16:18.763594432Z [2024-06-24 22:16:18,763: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58280c20-77d8-48bd-a114-d3d05d9273b0] succeeded in 2.8008621749999065s: None 2024-06-24T22:17:00.624707574Z [2024-06-24 22:17:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f549161-99c9-4b3d-a594-7871351af523] received 2024-06-24T22:17:00.648801496Z [2024-06-24 22:17:00,648: INFO/ForkPoolWorker-15] [7f549161-99c9-4b3d-a594-7871351af523] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:17:00.678119526Z [2024-06-24 22:17:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55352ba9-af26-4721-a18d-e49133f4906c] received 2024-06-24T22:17:00.717842216Z [2024-06-24 22:17:00,717: INFO/ForkPoolWorker-16] [55352ba9-af26-4721-a18d-e49133f4906c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:17:01.334985799Z [2024-06-24 22:17:01,330: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:17:01.351629556Z [2024-06-24 22:17:01,341: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:17:03.060455397Z [2024-06-24 22:17:03,057: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:17:03.065711577Z [2024-06-24 22:17:03,065: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:17:03.162318323Z [2024-06-24 22:17:03,162: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:17:03.164379703Z [2024-06-24 22:17:03,164: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:17:03.164420996Z [2024-06-24 22:17:03,164: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:17:03.164604781Z [2024-06-24 22:17:03,164: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:17:03.164776008Z [2024-06-24 22:17:03,164: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:17:03.166170253Z [2024-06-24 22:17:03,166: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:17:03.166704521Z [2024-06-24 22:17:03,166: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:17:03.195064144Z [2024-06-24 22:17:03,194: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:17:03.198679887Z [2024-06-24 22:17:03,198: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:17:03.277499622Z [2024-06-24 22:17:03,277: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:17:03.283880551Z [2024-06-24 22:17:03,283: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:17:03.284612653Z [2024-06-24 22:17:03,283: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:17:03.285086179Z [2024-06-24 22:17:03,284: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:17:03.286535826Z [2024-06-24 22:17:03,285: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:17:03.286921028Z [2024-06-24 22:17:03,286: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:17:03.287096521Z [2024-06-24 22:17:03,286: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:17:03.311669996Z [2024-06-24 22:17:03,311: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:17:03.465886532Z [2024-06-24 22:17:03,465: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:17:05.602584832Z [2024-06-24 22:17:05,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55352ba9-af26-4721-a18d-e49133f4906c] succeeded in 4.916471795000007s: None 2024-06-24T22:17:05.929430332Z [2024-06-24 22:17:05,928: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f549161-99c9-4b3d-a594-7871351af523] succeeded in 5.2971774560000995s: None 2024-06-24T22:18:00.468926923Z [2024-06-24 22:18:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[185794f9-4e46-4a83-a03b-b0e64bc5609b] received 2024-06-24T22:18:00.486911747Z [2024-06-24 22:18:00,484: INFO/ForkPoolWorker-15] [185794f9-4e46-4a83-a03b-b0e64bc5609b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:18:00.530836835Z [2024-06-24 22:18:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e72094e-5516-4e37-928f-9c224ef966bc] received 2024-06-24T22:18:00.541981816Z [2024-06-24 22:18:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[720e4fb1-d904-4033-b4a1-ed0646b870eb] received 2024-06-24T22:18:00.545652348Z [2024-06-24 22:18:00,545: INFO/ForkPoolWorker-16] [9e72094e-5516-4e37-928f-9c224ef966bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:18:00.664591181Z [2024-06-24 22:18:00,662: INFO/ForkPoolWorker-1] [720e4fb1-d904-4033-b4a1-ed0646b870eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:18:01.071911710Z [2024-06-24 22:18:01,068: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:18:01.345373876Z [2024-06-24 22:18:01,335: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:18:01.394140109Z [2024-06-24 22:18:01,365: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:18:02.273514008Z [2024-06-24 22:18:02,273: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:18:03.089915464Z [2024-06-24 22:18:03,089: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e72094e-5516-4e37-928f-9c224ef966bc] succeeded in 2.5572044609998557s: None 2024-06-24T22:18:03.153784432Z [2024-06-24 22:18:03,153: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:18:03.158072302Z [2024-06-24 22:18:03,157: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:18:03.184558665Z [2024-06-24 22:18:03,184: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:18:03.189130816Z [2024-06-24 22:18:03,188: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:18:03.189223401Z [2024-06-24 22:18:03,189: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:18:03.189582302Z [2024-06-24 22:18:03,189: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:18:03.189660182Z [2024-06-24 22:18:03,189: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:18:03.189895745Z [2024-06-24 22:18:03,189: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:18:03.189941349Z [2024-06-24 22:18:03,189: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:18:03.283263195Z [2024-06-24 22:18:03,283: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:18:03.408219541Z [2024-06-24 22:18:03,407: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:18:03.413353022Z [2024-06-24 22:18:03,412: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:18:03.493754466Z [2024-06-24 22:18:03,493: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:18:03.495716492Z [2024-06-24 22:18:03,495: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:18:03.495734445Z [2024-06-24 22:18:03,495: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:18:03.495856452Z [2024-06-24 22:18:03,495: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:18:03.495893078Z [2024-06-24 22:18:03,495: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:18:03.496289449Z [2024-06-24 22:18:03,496: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:18:03.496294757Z [2024-06-24 22:18:03,496: INFO/ForkPoolWorker-1] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:18:03.691470196Z [2024-06-24 22:18:03,691: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:18:05.513306707Z [2024-06-24 22:18:05,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[185794f9-4e46-4a83-a03b-b0e64bc5609b] succeeded in 5.039698649999991s: None 2024-06-24T22:18:05.690983606Z [2024-06-24 22:18:05,690: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[720e4fb1-d904-4033-b4a1-ed0646b870eb] succeeded in 5.117027456999949s: None 2024-06-24T22:19:00.433587047Z [2024-06-24 22:19:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[569e02ef-bda9-43eb-92c9-d3113ec56ef8] received 2024-06-24T22:19:00.454029896Z [2024-06-24 22:19:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecc8a0dd-066a-47ab-9825-fccf7bb7c5fe] received 2024-06-24T22:19:00.461393509Z [2024-06-24 22:19:00,460: INFO/ForkPoolWorker-15] [569e02ef-bda9-43eb-92c9-d3113ec56ef8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:19:00.476954834Z [2024-06-24 22:19:00,476: INFO/ForkPoolWorker-16] [ecc8a0dd-066a-47ab-9825-fccf7bb7c5fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:19:00.921784873Z [2024-06-24 22:19:00,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:19:01.273997588Z [2024-06-24 22:19:01,265: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:19:02.551204567Z [2024-06-24 22:19:02,550: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:19:02.555164584Z [2024-06-24 22:19:02,554: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:19:02.601877368Z [2024-06-24 22:19:02,601: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:19:02.607732635Z [2024-06-24 22:19:02,607: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:19:02.607885868Z [2024-06-24 22:19:02,607: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:19:02.608092972Z [2024-06-24 22:19:02,607: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:19:02.608205681Z [2024-06-24 22:19:02,608: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:19:02.608708434Z [2024-06-24 22:19:02,608: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:19:02.608970982Z [2024-06-24 22:19:02,608: INFO/ForkPoolWorker-15] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:19:02.703375907Z [2024-06-24 22:19:02,703: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:19:03.157184302Z [2024-06-24 22:19:03,156: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:19:03.163814112Z [2024-06-24 22:19:03,163: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:19:03.195890054Z [2024-06-24 22:19:03,195: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:19:03.197477676Z [2024-06-24 22:19:03,197: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:19:03.197645269Z [2024-06-24 22:19:03,197: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:19:03.197824335Z [2024-06-24 22:19:03,197: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:19:03.197906147Z [2024-06-24 22:19:03,197: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:19:03.198191250Z [2024-06-24 22:19:03,198: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:19:03.198246555Z [2024-06-24 22:19:03,198: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:19:03.328009804Z [2024-06-24 22:19:03,327: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:19:04.798344283Z [2024-06-24 22:19:04,797: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[569e02ef-bda9-43eb-92c9-d3113ec56ef8] succeeded in 4.356915131000051s: None 2024-06-24T22:19:05.331225530Z [2024-06-24 22:19:05,330: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ecc8a0dd-066a-47ab-9825-fccf7bb7c5fe] succeeded in 4.872068098s: None 2024-06-24T22:20:00.792540429Z [2024-06-24 22:20:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c27c55e8-9b54-464f-b561-de49e5cdb833] received 2024-06-24T22:20:00.807308712Z [2024-06-24 22:20:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c5465e8-f1d7-4b21-acf2-d277db3332f1] received 2024-06-24T22:20:00.810607273Z [2024-06-24 22:20:00,810: INFO/ForkPoolWorker-15] [c27c55e8-9b54-464f-b561-de49e5cdb833] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:20:00.821034918Z [2024-06-24 22:20:00,820: INFO/ForkPoolWorker-16] [4c5465e8-f1d7-4b21-acf2-d277db3332f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:20:00.825402151Z [2024-06-24 22:20:00,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b30b0134-1e31-4f20-92a9-2a518d3c2f16] received 2024-06-24T22:20:00.837414691Z [2024-06-24 22:20:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81fedd2f-0e1e-47ef-ae01-e89608c38e08] received 2024-06-24T22:20:00.842931100Z [2024-06-24 22:20:00,842: INFO/ForkPoolWorker-1] [b30b0134-1e31-4f20-92a9-2a518d3c2f16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-24T22:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:20:00.941748188Z [2024-06-24 22:20:00,941: INFO/ForkPoolWorker-2] [81fedd2f-0e1e-47ef-ae01-e89608c38e08] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:20:01.595137468Z [2024-06-24 22:20:01,588: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:20:01.658805225Z [2024-06-24 22:20:01,631: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:20:01.799684208Z [2024-06-24 22:20:01,795: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:20:02.002792453Z [2024-06-24 22:20:02,002: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:20:02.253792873Z [2024-06-24 22:20:02,248: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:20:03.111116346Z [2024-06-24 22:20:03,110: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[81fedd2f-0e1e-47ef-ae01-e89608c38e08] succeeded in 2.2691706509999676s: None 2024-06-24T22:20:03.869284248Z [2024-06-24 22:20:03,868: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:20:03.872870994Z [2024-06-24 22:20:03,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:20:03.875903250Z [2024-06-24 22:20:03,875: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:20:03.879977750Z [2024-06-24 22:20:03,879: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:20:03.917426958Z [2024-06-24 22:20:03,917: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:20:03.921095004Z [2024-06-24 22:20:03,920: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:20:03.921155663Z [2024-06-24 22:20:03,921: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:20:03.921268717Z [2024-06-24 22:20:03,921: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:20:03.921317552Z [2024-06-24 22:20:03,921: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:20:03.924799562Z [2024-06-24 22:20:03,923: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:20:03.924813755Z [2024-06-24 22:20:03,924: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:20:03.924922452Z [2024-06-24 22:20:03,924: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:20:03.926579629Z [2024-06-24 22:20:03,926: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:20:03.926725504Z [2024-06-24 22:20:03,926: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:20:03.926940862Z [2024-06-24 22:20:03,926: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:20:03.926952978Z [2024-06-24 22:20:03,926: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:20:03.927165337Z [2024-06-24 22:20:03,927: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:20:03.927212669Z [2024-06-24 22:20:03,927: INFO/ForkPoolWorker-15] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:20:04.042598921Z [2024-06-24 22:20:04,042: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:20:04.058405589Z [2024-06-24 22:20:04,058: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:20:04.331441109Z [2024-06-24 22:20:04,331: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:20:04.335285803Z [2024-06-24 22:20:04,334: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:20:04.396784359Z [2024-06-24 22:20:04,396: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:20:04.399371473Z [2024-06-24 22:20:04,398: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:20:04.399434885Z [2024-06-24 22:20:04,399: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:20:04.399721590Z [2024-06-24 22:20:04,399: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:20:04.399861558Z [2024-06-24 22:20:04,399: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:20:04.400244531Z [2024-06-24 22:20:04,400: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:20:04.401868554Z [2024-06-24 22:20:04,400: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:20:04.587682641Z [2024-06-24 22:20:04,587: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:20:04.950827578Z [2024-06-24 22:20:04,947: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b30b0134-1e31-4f20-92a9-2a518d3c2f16] succeeded in 4.118759422000039s: None 2024-06-24T22:20:05.184922640Z [2024-06-24 22:20:05,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[690b3692-5273-4312-8645-5317d1bfeff6] received 2024-06-24T22:20:05.200482227Z [2024-06-24 22:20:05,200: INFO/ForkPoolWorker-1] [690b3692-5273-4312-8645-5317d1bfeff6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'split_metrics', 'scheduled__2024-06-24T22:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:20:05.595235760Z [2024-06-24 22:20:05,590: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:20:05.877870509Z [2024-06-24 22:20:05,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c27c55e8-9b54-464f-b561-de49e5cdb833] succeeded in 5.0788827449998735s: None 2024-06-24T22:20:06.833396946Z [2024-06-24 22:20:06,832: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c5465e8-f1d7-4b21-acf2-d277db3332f1] succeeded in 6.021146543999976s: None 2024-06-24T22:20:07.319453195Z [2024-06-24 22:20:07,318: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:20:07.324194189Z [2024-06-24 22:20:07,323: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:20:07.365500993Z [2024-06-24 22:20:07,365: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:20:07.366503668Z [2024-06-24 22:20:07,366: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:20:07.366514283Z [2024-06-24 22:20:07,366: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:20:07.366643996Z [2024-06-24 22:20:07,366: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:20:07.366652587Z [2024-06-24 22:20:07,366: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:20:07.366922593Z [2024-06-24 22:20:07,366: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:20:07.366933377Z [2024-06-24 22:20:07,366: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:20:07.474068538Z [2024-06-24 22:20:07,473: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:20:08.285777980Z [2024-06-24 22:20:08,285: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[690b3692-5273-4312-8645-5317d1bfeff6] succeeded in 3.0980527850001636s: None 2024-06-24T22:20:09.082190556Z [2024-06-24 22:20:09,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32f8c2e7-9970-4000-948a-df106541e305] received 2024-06-24T22:20:09.094039893Z [2024-06-24 22:20:09,093: INFO/ForkPoolWorker-15] [32f8c2e7-9970-4000-948a-df106541e305] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'collect_metrics', 'scheduled__2024-06-24T22:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-24T22:20:09.449530395Z [2024-06-24 22:20:09,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:20:10.955082986Z [2024-06-24 22:20:10,954: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:20:10.960401599Z [2024-06-24 22:20:10,959: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:20:11.040105697Z [2024-06-24 22:20:11,039: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:20:11.044523316Z [2024-06-24 22:20:11,042: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:20:11.044771744Z [2024-06-24 22:20:11,044: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:20:11.045005589Z [2024-06-24 22:20:11,044: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:20:11.046015896Z [2024-06-24 22:20:11,044: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:20:11.047053086Z [2024-06-24 22:20:11,046: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:20:11.055194088Z [2024-06-24 22:20:11,046: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:20:11.147810032Z [2024-06-24 22:20:11,147: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:20:11.864737563Z [2024-06-24 22:20:11,864: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[32f8c2e7-9970-4000-948a-df106541e305] succeeded in 2.777956222000057s: None 2024-06-24T22:20:12.488648255Z [2024-06-24 22:20:12,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a25ad47c-13bb-4ab2-981a-dcdd0be58231] received 2024-06-24T22:20:12.502319008Z [2024-06-24 22:20:12,501: INFO/ForkPoolWorker-15] [a25ad47c-13bb-4ab2-981a-dcdd0be58231] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'send_prometheus', 'scheduled__2024-06-24T22:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:20:12.875936826Z [2024-06-24 22:20:12,865: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:20:14.497295015Z [2024-06-24 22:20:14,496: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:20:14.500955782Z [2024-06-24 22:20:14,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:20:14.552576091Z [2024-06-24 22:20:14,552: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:20:14.553979404Z [2024-06-24 22:20:14,553: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:20:14.554119354Z [2024-06-24 22:20:14,554: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:20:14.554254124Z [2024-06-24 22:20:14,554: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:20:14.554316773Z [2024-06-24 22:20:14,554: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:20:14.554556604Z [2024-06-24 22:20:14,554: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:20:14.554643978Z [2024-06-24 22:20:14,554: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:20:14.642030432Z [2024-06-24 22:20:14,641: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:20:15.380970600Z [2024-06-24 22:20:15,380: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a25ad47c-13bb-4ab2-981a-dcdd0be58231] succeeded in 2.8879403509999975s: None 2024-06-24T22:21:00.425590295Z [2024-06-24 22:21:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c8a2e02-fe60-4d9f-af3d-676d9c14d070] received 2024-06-24T22:21:00.437029772Z [2024-06-24 22:21:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8c39c72-312c-4c09-8443-c2c4a3339516] received 2024-06-24T22:21:00.468492445Z [2024-06-24 22:21:00,468: INFO/ForkPoolWorker-16] [f8c39c72-312c-4c09-8443-c2c4a3339516] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:21:00.489495838Z [2024-06-24 22:21:00,489: INFO/ForkPoolWorker-15] [0c8a2e02-fe60-4d9f-af3d-676d9c14d070] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:21:01.622979215Z [2024-06-24 22:21:01,593: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:21:01.732172495Z [2024-06-24 22:21:01,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:21:04.369010134Z [2024-06-24 22:21:04,368: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:21:04.372434418Z [2024-06-24 22:21:04,372: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:21:04.428482784Z [2024-06-24 22:21:04,428: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:21:04.430663570Z [2024-06-24 22:21:04,430: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:21:04.431927622Z [2024-06-24 22:21:04,431: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:21:04.432447323Z [2024-06-24 22:21:04,431: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:21:04.433421807Z [2024-06-24 22:21:04,433: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:21:04.433926669Z [2024-06-24 22:21:04,433: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:21:04.434358443Z [2024-06-24 22:21:04,434: INFO/ForkPoolWorker-15] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:21:04.571482313Z [2024-06-24 22:21:04,571: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:21:05.019389659Z [2024-06-24 22:21:05,018: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:21:05.032750652Z [2024-06-24 22:21:05,032: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:21:05.068539012Z [2024-06-24 22:21:05,068: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:21:05.073781896Z [2024-06-24 22:21:05,072: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:21:05.073794495Z [2024-06-24 22:21:05,072: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:21:05.073798884Z [2024-06-24 22:21:05,072: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:21:05.073802821Z [2024-06-24 22:21:05,073: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:21:05.073815617Z [2024-06-24 22:21:05,073: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:21:05.073818663Z [2024-06-24 22:21:05,073: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:21:05.212131516Z [2024-06-24 22:21:05,211: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:21:06.284388100Z [2024-06-24 22:21:06,283: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c8a2e02-fe60-4d9f-af3d-676d9c14d070] succeeded in 5.849058303999982s: None 2024-06-24T22:21:06.995897078Z [2024-06-24 22:21:06,995: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f8c39c72-312c-4c09-8443-c2c4a3339516] succeeded in 6.555887031000111s: None 2024-06-24T22:22:00.670472595Z [2024-06-24 22:22:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a9c1d58-8560-462e-b6f1-f24013fb918e] received 2024-06-24T22:22:00.676983168Z [2024-06-24 22:22:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59fce2a9-2ea4-4bb9-a694-b4b34888cc58] received 2024-06-24T22:22:00.686352132Z [2024-06-24 22:22:00,686: INFO/ForkPoolWorker-15] [7a9c1d58-8560-462e-b6f1-f24013fb918e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:22:00.688308202Z [2024-06-24 22:22:00,688: INFO/ForkPoolWorker-16] [59fce2a9-2ea4-4bb9-a694-b4b34888cc58] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:22:00.739099496Z [2024-06-24 22:22:00,738: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd4185d1-f677-4412-a870-005d5d23a24e] received 2024-06-24T22:22:00.839118908Z [2024-06-24 22:22:00,838: INFO/ForkPoolWorker-1] [bd4185d1-f677-4412-a870-005d5d23a24e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:22:01.273922828Z [2024-06-24 22:22:01,270: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:22:01.729739614Z [2024-06-24 22:22:01,726: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:22:01.910395071Z [2024-06-24 22:22:01,905: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:22:02.140778732Z [2024-06-24 22:22:02,140: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:22:03.211459366Z [2024-06-24 22:22:03,211: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59fce2a9-2ea4-4bb9-a694-b4b34888cc58] succeeded in 2.5323224720000326s: None 2024-06-24T22:22:04.002246921Z [2024-06-24 22:22:04,001: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:22:04.005986038Z [2024-06-24 22:22:04,005: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:22:04.062701084Z [2024-06-24 22:22:04,062: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:22:04.065987539Z [2024-06-24 22:22:04,065: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:22:04.072931152Z [2024-06-24 22:22:04,065: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:22:04.073186659Z [2024-06-24 22:22:04,072: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:22:04.073338705Z [2024-06-24 22:22:04,073: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:22:04.074183598Z [2024-06-24 22:22:04,073: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:22:04.074463712Z [2024-06-24 22:22:04,074: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:22:04.230207748Z [2024-06-24 22:22:04,229: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:22:04.317449557Z [2024-06-24 22:22:04,317: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:22:04.322065555Z [2024-06-24 22:22:04,321: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:22:04.363318633Z [2024-06-24 22:22:04,363: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:22:04.365232203Z [2024-06-24 22:22:04,365: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:22:04.365261123Z [2024-06-24 22:22:04,365: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:22:04.365519106Z [2024-06-24 22:22:04,365: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:22:04.365596688Z [2024-06-24 22:22:04,365: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:22:04.365912644Z [2024-06-24 22:22:04,365: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:22:04.365991829Z [2024-06-24 22:22:04,365: INFO/ForkPoolWorker-1] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:22:04.455638414Z [2024-06-24 22:22:04,455: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:22:08.440389302Z [2024-06-24 22:22:08,418: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a9c1d58-8560-462e-b6f1-f24013fb918e] succeeded in 7.741631425999913s: None 2024-06-24T22:22:08.446100284Z [2024-06-24 22:22:08,445: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bd4185d1-f677-4412-a870-005d5d23a24e] succeeded in 7.703646289000062s: None 2024-06-24T22:23:00.878669529Z [2024-06-24 22:23:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60e434b0-a4fc-42ea-865e-fa7423c39bad] received 2024-06-24T22:23:00.902203432Z [2024-06-24 22:23:00,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[276e7eb0-27ce-4f9f-ad5d-07d9ece30be5] received 2024-06-24T22:23:00.911217668Z [2024-06-24 22:23:00,910: INFO/ForkPoolWorker-15] [60e434b0-a4fc-42ea-865e-fa7423c39bad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:23:00.948291087Z [2024-06-24 22:23:00,947: INFO/ForkPoolWorker-16] [276e7eb0-27ce-4f9f-ad5d-07d9ece30be5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:23:01.575115448Z [2024-06-24 22:23:01,566: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:23:01.831438235Z [2024-06-24 22:23:01,815: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:23:04.227836774Z [2024-06-24 22:23:04,227: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:23:04.231305078Z [2024-06-24 22:23:04,230: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:23:04.277147108Z [2024-06-24 22:23:04,276: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:23:04.282880802Z [2024-06-24 22:23:04,282: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:23:04.283150281Z [2024-06-24 22:23:04,282: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:23:04.283607556Z [2024-06-24 22:23:04,283: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:23:04.285513415Z [2024-06-24 22:23:04,285: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:23:04.286451396Z [2024-06-24 22:23:04,286: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:23:04.286633931Z [2024-06-24 22:23:04,286: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:23:04.398057655Z [2024-06-24 22:23:04,397: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:23:04.401629371Z [2024-06-24 22:23:04,401: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:23:04.415838549Z [2024-06-24 22:23:04,413: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:23:04.473031206Z [2024-06-24 22:23:04,472: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:23:04.476610476Z [2024-06-24 22:23:04,474: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:23:04.477397260Z [2024-06-24 22:23:04,477: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:23:04.477698848Z [2024-06-24 22:23:04,477: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:23:04.478330696Z [2024-06-24 22:23:04,478: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:23:04.480482424Z [2024-06-24 22:23:04,480: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:23:04.481400304Z [2024-06-24 22:23:04,481: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:23:04.636269700Z [2024-06-24 22:23:04,636: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:23:06.139630744Z [2024-06-24 22:23:06,139: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[276e7eb0-27ce-4f9f-ad5d-07d9ece30be5] succeeded in 5.235145396999997s: None 2024-06-24T22:23:08.219698701Z [2024-06-24 22:23:08,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60e434b0-a4fc-42ea-865e-fa7423c39bad] succeeded in 7.336445428999923s: None 2024-06-24T22:24:00.757762162Z [2024-06-24 22:24:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[257ea448-9f5d-4ca2-b7dd-c0d8428d2c26] received 2024-06-24T22:24:00.763603199Z [2024-06-24 22:24:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b41e3cd7-c8b9-4069-8f06-0fba67ab262c] received 2024-06-24T22:24:00.778084741Z [2024-06-24 22:24:00,777: INFO/ForkPoolWorker-15] [257ea448-9f5d-4ca2-b7dd-c0d8428d2c26] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:24:00.781168583Z [2024-06-24 22:24:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec2872e0-1fd7-48c5-a08e-5ab253eb3426] received 2024-06-24T22:24:00.782439632Z [2024-06-24 22:24:00,782: INFO/ForkPoolWorker-16] [b41e3cd7-c8b9-4069-8f06-0fba67ab262c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:24:00.817203733Z [2024-06-24 22:24:00,816: INFO/ForkPoolWorker-1] [ec2872e0-1fd7-48c5-a08e-5ab253eb3426] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:24:01.530654816Z [2024-06-24 22:24:01,525: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:24:01.546163313Z [2024-06-24 22:24:01,540: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:24:01.662794872Z [2024-06-24 22:24:01,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:24:02.364977345Z [2024-06-24 22:24:02,364: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:24:03.394909168Z [2024-06-24 22:24:03,383: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[257ea448-9f5d-4ca2-b7dd-c0d8428d2c26] succeeded in 2.6156972480000604s: None 2024-06-24T22:24:03.721438433Z [2024-06-24 22:24:03,721: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:24:03.724983804Z [2024-06-24 22:24:03,724: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:24:03.795950977Z [2024-06-24 22:24:03,795: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:24:03.804310115Z [2024-06-24 22:24:03,804: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:24:03.804445621Z [2024-06-24 22:24:03,804: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:24:03.804649686Z [2024-06-24 22:24:03,804: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:24:03.804760967Z [2024-06-24 22:24:03,804: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:24:03.805128652Z [2024-06-24 22:24:03,804: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:24:03.805299807Z [2024-06-24 22:24:03,805: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:24:03.836447884Z [2024-06-24 22:24:03,836: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:24:03.841330891Z [2024-06-24 22:24:03,840: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:24:03.906873015Z [2024-06-24 22:24:03,906: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:24:03.909453597Z [2024-06-24 22:24:03,909: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:24:03.909587678Z [2024-06-24 22:24:03,909: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:24:03.909775937Z [2024-06-24 22:24:03,909: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:24:03.909886458Z [2024-06-24 22:24:03,909: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:24:03.910167706Z [2024-06-24 22:24:03,910: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:24:03.910282992Z [2024-06-24 22:24:03,910: INFO/ForkPoolWorker-1] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:24:03.923043602Z [2024-06-24 22:24:03,922: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:24:04.022966400Z [2024-06-24 22:24:04,022: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:24:05.870010794Z [2024-06-24 22:24:05,869: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ec2872e0-1fd7-48c5-a08e-5ab253eb3426] succeeded in 5.077308478000077s: None 2024-06-24T22:24:05.870799587Z [2024-06-24 22:24:05,870: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b41e3cd7-c8b9-4069-8f06-0fba67ab262c] succeeded in 5.102290313999902s: None 2024-06-24T22:25:00.587375297Z [2024-06-24 22:25:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27f637ce-2e29-424d-964e-4482d90e84b8] received 2024-06-24T22:25:00.589831049Z [2024-06-24 22:25:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b018340-0646-41c6-ba5d-357672241b72] received 2024-06-24T22:25:00.606893928Z [2024-06-24 22:25:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25af297c-320c-443e-be5f-ba55207a443a] received 2024-06-24T22:25:00.607884306Z [2024-06-24 22:25:00,607: INFO/ForkPoolWorker-16] [0b018340-0646-41c6-ba5d-357672241b72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:25:00.625688632Z [2024-06-24 22:25:00,625: INFO/ForkPoolWorker-15] [27f637ce-2e29-424d-964e-4482d90e84b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:25:00.628176638Z [2024-06-24 22:25:00,627: INFO/ForkPoolWorker-1] [25af297c-320c-443e-be5f-ba55207a443a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-24T22:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:25:01.281303094Z [2024-06-24 22:25:01,276: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:25:01.336080453Z [2024-06-24 22:25:01,333: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:25:01.558386616Z [2024-06-24 22:25:01,549: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:25:03.186370589Z [2024-06-24 22:25:03,186: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:25:03.190558558Z [2024-06-24 22:25:03,190: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:25:03.228869064Z [2024-06-24 22:25:03,228: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:25:03.233113403Z [2024-06-24 22:25:03,232: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:25:03.233361257Z [2024-06-24 22:25:03,233: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:25:03.233748247Z [2024-06-24 22:25:03,233: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:25:03.233908226Z [2024-06-24 22:25:03,233: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:25:03.234771827Z [2024-06-24 22:25:03,234: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:25:03.234971881Z [2024-06-24 22:25:03,234: INFO/ForkPoolWorker-15] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:25:03.304317584Z [2024-06-24 22:25:03,296: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:25:03.308632119Z [2024-06-24 22:25:03,308: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:25:03.335869080Z [2024-06-24 22:25:03,335: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:25:03.381542097Z [2024-06-24 22:25:03,381: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:25:03.384972907Z [2024-06-24 22:25:03,384: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:25:03.415771793Z [2024-06-24 22:25:03,415: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:25:03.416923432Z [2024-06-24 22:25:03,416: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:25:03.416964322Z [2024-06-24 22:25:03,416: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:25:03.417066658Z [2024-06-24 22:25:03,416: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:25:03.417115736Z [2024-06-24 22:25:03,417: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:25:03.417334434Z [2024-06-24 22:25:03,417: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:25:03.417387142Z [2024-06-24 22:25:03,417: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:25:03.462206010Z [2024-06-24 22:25:03,462: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:25:03.469254310Z [2024-06-24 22:25:03,468: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:25:03.469304499Z [2024-06-24 22:25:03,469: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:25:03.469444523Z [2024-06-24 22:25:03,469: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:25:03.469494976Z [2024-06-24 22:25:03,469: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:25:03.469764159Z [2024-06-24 22:25:03,469: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:25:03.469845338Z [2024-06-24 22:25:03,469: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:25:03.538006444Z [2024-06-24 22:25:03,537: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:25:03.614502279Z [2024-06-24 22:25:03,614: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:25:04.594052225Z [2024-06-24 22:25:04,593: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25af297c-320c-443e-be5f-ba55207a443a] succeeded in 3.973664640999914s: None 2024-06-24T22:25:04.799109857Z [2024-06-24 22:25:04,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f8b5233-304e-4721-9e78-3990b56e5bd4] received 2024-06-24T22:25:04.815379769Z [2024-06-24 22:25:04,815: INFO/ForkPoolWorker-1] [5f8b5233-304e-4721-9e78-3990b56e5bd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'split_metrics', 'scheduled__2024-06-24T22:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:25:05.167557768Z [2024-06-24 22:25:05,164: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:25:05.314175760Z [2024-06-24 22:25:05,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27f637ce-2e29-424d-964e-4482d90e84b8] succeeded in 4.722568698000032s: None 2024-06-24T22:25:05.916549098Z [2024-06-24 22:25:05,916: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b018340-0646-41c6-ba5d-357672241b72] succeeded in 5.324825184000019s: None 2024-06-24T22:25:06.846882797Z [2024-06-24 22:25:06,846: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:25:06.854808250Z [2024-06-24 22:25:06,853: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:25:06.906443534Z [2024-06-24 22:25:06,906: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:25:06.912851313Z [2024-06-24 22:25:06,912: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:25:06.914579998Z [2024-06-24 22:25:06,912: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:25:06.914816456Z [2024-06-24 22:25:06,914: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:25:06.914910198Z [2024-06-24 22:25:06,914: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:25:06.915341243Z [2024-06-24 22:25:06,915: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:25:06.915404818Z [2024-06-24 22:25:06,915: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:25:07.011770932Z [2024-06-24 22:25:07,011: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:25:07.904415114Z [2024-06-24 22:25:07,903: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f8b5233-304e-4721-9e78-3990b56e5bd4] succeeded in 3.1035850599998867s: None 2024-06-24T22:25:08.035812505Z [2024-06-24 22:25:08,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fb97f8a-946c-45cc-aa29-80904c58adaf] received 2024-06-24T22:25:08.074168037Z [2024-06-24 22:25:08,072: INFO/ForkPoolWorker-15] [1fb97f8a-946c-45cc-aa29-80904c58adaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'collect_metrics', 'scheduled__2024-06-24T22:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-24T22:25:08.649763034Z [2024-06-24 22:25:08,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:25:10.006490350Z [2024-06-24 22:25:10,006: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:25:10.009897376Z [2024-06-24 22:25:10,009: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:25:10.038784645Z [2024-06-24 22:25:10,038: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:25:10.042239015Z [2024-06-24 22:25:10,040: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:25:10.043400349Z [2024-06-24 22:25:10,043: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:25:10.043686330Z [2024-06-24 22:25:10,043: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:25:10.043913554Z [2024-06-24 22:25:10,043: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:25:10.044590481Z [2024-06-24 22:25:10,044: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:25:10.045219980Z [2024-06-24 22:25:10,045: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:25:10.142566288Z [2024-06-24 22:25:10,142: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:25:11.856807927Z [2024-06-24 22:25:11,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1fb97f8a-946c-45cc-aa29-80904c58adaf] succeeded in 3.817512403999899s: None 2024-06-24T22:25:12.389682162Z [2024-06-24 22:25:12,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0448f2e-e076-4972-a2c3-546822f04038] received 2024-06-24T22:25:12.397752058Z [2024-06-24 22:25:12,397: INFO/ForkPoolWorker-15] [f0448f2e-e076-4972-a2c3-546822f04038] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'send_prometheus', 'scheduled__2024-06-24T22:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:25:12.838418921Z [2024-06-24 22:25:12,834: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:25:14.248137652Z [2024-06-24 22:25:14,246: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:25:14.251005812Z [2024-06-24 22:25:14,250: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:25:14.277142943Z [2024-06-24 22:25:14,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:25:14.279311093Z [2024-06-24 22:25:14,279: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:25:14.279400885Z [2024-06-24 22:25:14,279: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:25:14.279579710Z [2024-06-24 22:25:14,279: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:25:14.279646655Z [2024-06-24 22:25:14,279: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:25:14.279917565Z [2024-06-24 22:25:14,279: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:25:14.279994450Z [2024-06-24 22:25:14,279: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:25:14.387720689Z [2024-06-24 22:25:14,387: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:25:15.002095198Z [2024-06-24 22:25:15,001: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0448f2e-e076-4972-a2c3-546822f04038] succeeded in 2.6108351369998672s: None 2024-06-24T22:26:00.393432171Z [2024-06-24 22:26:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd3ca73b-4582-4e64-b3a0-c2cb2bef0eb8] received 2024-06-24T22:26:00.397458780Z [2024-06-24 22:26:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89926002-1eba-4f77-900c-2b3964a39acb] received 2024-06-24T22:26:00.402382451Z [2024-06-24 22:26:00,402: INFO/ForkPoolWorker-15] [bd3ca73b-4582-4e64-b3a0-c2cb2bef0eb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:26:00.405847184Z [2024-06-24 22:26:00,405: INFO/ForkPoolWorker-16] [89926002-1eba-4f77-900c-2b3964a39acb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:26:00.437107625Z [2024-06-24 22:26:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df5bee30-36c5-43a5-99d9-244d5444861f] received 2024-06-24T22:26:00.493402221Z [2024-06-24 22:26:00,492: INFO/ForkPoolWorker-1] [df5bee30-36c5-43a5-99d9-244d5444861f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:26:01.193833472Z [2024-06-24 22:26:01,189: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:26:01.414117281Z [2024-06-24 22:26:01,410: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:26:01.424116452Z [2024-06-24 22:26:01,420: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:26:01.832699488Z [2024-06-24 22:26:01,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:26:02.611490268Z [2024-06-24 22:26:02,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd3ca73b-4582-4e64-b3a0-c2cb2bef0eb8] succeeded in 2.215790833000028s: None 2024-06-24T22:26:03.098984769Z [2024-06-24 22:26:03,098: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:26:03.102449132Z [2024-06-24 22:26:03,102: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:26:03.137543798Z [2024-06-24 22:26:03,136: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:26:03.137915647Z [2024-06-24 22:26:03,137: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:26:03.141196511Z [2024-06-24 22:26:03,140: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:26:03.141359562Z [2024-06-24 22:26:03,141: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:26:03.141734139Z [2024-06-24 22:26:03,141: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:26:03.141849749Z [2024-06-24 22:26:03,141: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:26:03.142141180Z [2024-06-24 22:26:03,142: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:26:03.142325482Z [2024-06-24 22:26:03,142: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:26:03.142940841Z [2024-06-24 22:26:03,141: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:26:03.214390482Z [2024-06-24 22:26:03,214: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:26:03.219523154Z [2024-06-24 22:26:03,219: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:26:03.219647824Z [2024-06-24 22:26:03,219: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:26:03.219869697Z [2024-06-24 22:26:03,219: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:26:03.220078966Z [2024-06-24 22:26:03,219: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:26:03.221657672Z [2024-06-24 22:26:03,221: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:26:03.222704434Z [2024-06-24 22:26:03,222: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:26:03.264820073Z [2024-06-24 22:26:03,264: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:26:03.325132392Z [2024-06-24 22:26:03,324: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:26:05.385470133Z [2024-06-24 22:26:05,385: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89926002-1eba-4f77-900c-2b3964a39acb] succeeded in 4.985620960000006s: None 2024-06-24T22:26:05.643125304Z [2024-06-24 22:26:05,642: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df5bee30-36c5-43a5-99d9-244d5444861f] succeeded in 5.196669462999807s: None 2024-06-24T22:27:01.170699911Z [2024-06-24 22:27:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[698d3f18-09e6-4623-830b-e37af6eb9476] received 2024-06-24T22:27:01.194022152Z [2024-06-24 22:27:01,193: INFO/ForkPoolWorker-15] [698d3f18-09e6-4623-830b-e37af6eb9476] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:27:01.195424442Z [2024-06-24 22:27:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ec7c6cb-e9fa-4335-abab-fdcab80407a1] received 2024-06-24T22:27:01.213033762Z [2024-06-24 22:27:01,212: INFO/ForkPoolWorker-16] [1ec7c6cb-e9fa-4335-abab-fdcab80407a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:27:01.659934982Z [2024-06-24 22:27:01,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:27:01.684276576Z [2024-06-24 22:27:01,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:27:03.046690005Z [2024-06-24 22:27:03,046: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:27:03.050107518Z [2024-06-24 22:27:03,049: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:27:03.087394547Z [2024-06-24 22:27:03,087: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:27:03.093556732Z [2024-06-24 22:27:03,093: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:27:03.093699118Z [2024-06-24 22:27:03,093: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:27:03.093890403Z [2024-06-24 22:27:03,093: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:27:03.093967204Z [2024-06-24 22:27:03,093: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:27:03.094275741Z [2024-06-24 22:27:03,094: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:27:03.094417227Z [2024-06-24 22:27:03,094: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:27:03.150078870Z [2024-06-24 22:27:03,149: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:27:03.154426135Z [2024-06-24 22:27:03,154: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:27:03.188302226Z [2024-06-24 22:27:03,188: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:27:03.213568464Z [2024-06-24 22:27:03,213: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:27:03.217399455Z [2024-06-24 22:27:03,217: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:27:03.217587975Z [2024-06-24 22:27:03,217: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:27:03.217798812Z [2024-06-24 22:27:03,217: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:27:03.217898374Z [2024-06-24 22:27:03,217: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:27:03.218211924Z [2024-06-24 22:27:03,218: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:27:03.218395435Z [2024-06-24 22:27:03,218: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:27:03.313413685Z [2024-06-24 22:27:03,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:27:05.059895967Z [2024-06-24 22:27:05,059: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ec7c6cb-e9fa-4335-abab-fdcab80407a1] succeeded in 3.8618377899999814s: None 2024-06-24T22:27:05.407734343Z [2024-06-24 22:27:05,406: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[698d3f18-09e6-4623-830b-e37af6eb9476] succeeded in 4.230668369000114s: None 2024-06-24T22:28:01.280039680Z [2024-06-24 22:28:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[198a2b47-b153-4f0b-9d8b-82e577719eb2] received 2024-06-24T22:28:01.288163930Z [2024-06-24 22:28:01,287: INFO/ForkPoolWorker-15] [198a2b47-b153-4f0b-9d8b-82e577719eb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:28:01.296320164Z [2024-06-24 22:28:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e14890da-3cd1-4323-979d-8d85ff73f06f] received 2024-06-24T22:28:01.307506287Z [2024-06-24 22:28:01,307: INFO/ForkPoolWorker-16] [e14890da-3cd1-4323-979d-8d85ff73f06f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:28:01.318779917Z [2024-06-24 22:28:01,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68625b07-b2da-4288-b1b2-15a92bd593e2] received 2024-06-24T22:28:01.363282832Z [2024-06-24 22:28:01,362: INFO/ForkPoolWorker-1] [68625b07-b2da-4288-b1b2-15a92bd593e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:28:01.750419008Z [2024-06-24 22:28:01,746: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:28:01.863234762Z [2024-06-24 22:28:01,857: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:28:01.899106361Z [2024-06-24 22:28:01,895: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:28:02.212047324Z [2024-06-24 22:28:02,211: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:28:02.910859374Z [2024-06-24 22:28:02,910: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e14890da-3cd1-4323-979d-8d85ff73f06f] succeeded in 1.6120582149999336s: None 2024-06-24T22:28:03.327218420Z [2024-06-24 22:28:03,326: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:28:03.332111774Z [2024-06-24 22:28:03,331: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:28:03.353479583Z [2024-06-24 22:28:03,353: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:28:03.359852912Z [2024-06-24 22:28:03,359: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:28:03.360001018Z [2024-06-24 22:28:03,359: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:28:03.360217702Z [2024-06-24 22:28:03,360: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:28:03.360490154Z [2024-06-24 22:28:03,360: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:28:03.361441453Z [2024-06-24 22:28:03,361: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:28:03.361581882Z [2024-06-24 22:28:03,361: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:28:03.451289119Z [2024-06-24 22:28:03,451: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:28:03.652460921Z [2024-06-24 22:28:03,651: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:28:03.655738882Z [2024-06-24 22:28:03,655: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:28:03.691079727Z [2024-06-24 22:28:03,690: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:28:03.694464612Z [2024-06-24 22:28:03,694: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:28:03.694482346Z [2024-06-24 22:28:03,694: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:28:03.694626138Z [2024-06-24 22:28:03,694: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:28:03.694694934Z [2024-06-24 22:28:03,694: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:28:03.695873843Z [2024-06-24 22:28:03,695: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:28:03.695911593Z [2024-06-24 22:28:03,695: INFO/ForkPoolWorker-1] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:28:03.818544811Z [2024-06-24 22:28:03,818: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:28:05.452394067Z [2024-06-24 22:28:05,451: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[68625b07-b2da-4288-b1b2-15a92bd593e2] succeeded in 4.122371590000057s: None 2024-06-24T22:28:05.525499939Z [2024-06-24 22:28:05,525: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[198a2b47-b153-4f0b-9d8b-82e577719eb2] succeeded in 4.243454720000045s: None 2024-06-24T22:29:01.211702502Z [2024-06-24 22:29:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31c9bb97-93a6-4bed-94e4-c8202603132b] received 2024-06-24T22:29:01.240800788Z [2024-06-24 22:29:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d51bfbb-5ba3-4571-ba65-56a681ced75f] received 2024-06-24T22:29:01.254250935Z [2024-06-24 22:29:01,253: INFO/ForkPoolWorker-15] [31c9bb97-93a6-4bed-94e4-c8202603132b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:29:01.272846725Z [2024-06-24 22:29:01,272: INFO/ForkPoolWorker-16] [9d51bfbb-5ba3-4571-ba65-56a681ced75f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:29:01.664693466Z [2024-06-24 22:29:01,660: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:29:01.703793090Z [2024-06-24 22:29:01,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:29:03.216551988Z [2024-06-24 22:29:03,216: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:29:03.220293479Z [2024-06-24 22:29:03,219: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:29:03.221633636Z [2024-06-24 22:29:03,221: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:29:03.228456190Z [2024-06-24 22:29:03,228: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:29:03.269536747Z [2024-06-24 22:29:03,269: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:29:03.274374065Z [2024-06-24 22:29:03,274: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:29:03.274702075Z [2024-06-24 22:29:03,274: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:29:03.274944013Z [2024-06-24 22:29:03,274: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:29:03.275073849Z [2024-06-24 22:29:03,274: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:29:03.275419435Z [2024-06-24 22:29:03,275: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:29:03.275532548Z [2024-06-24 22:29:03,275: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:29:03.276888415Z [2024-06-24 22:29:03,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:29:03.279927969Z [2024-06-24 22:29:03,279: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:29:03.279964947Z [2024-06-24 22:29:03,279: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:29:03.280140662Z [2024-06-24 22:29:03,279: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:29:03.280355083Z [2024-06-24 22:29:03,280: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:29:03.281094871Z [2024-06-24 22:29:03,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:29:03.281130677Z [2024-06-24 22:29:03,281: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:29:03.369549224Z [2024-06-24 22:29:03,369: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:29:03.414550237Z [2024-06-24 22:29:03,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:29:05.082289918Z [2024-06-24 22:29:05,081: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d51bfbb-5ba3-4571-ba65-56a681ced75f] succeeded in 3.8315017739998893s: None 2024-06-24T22:29:05.433422708Z [2024-06-24 22:29:05,432: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31c9bb97-93a6-4bed-94e4-c8202603132b] succeeded in 4.212845668s: None 2024-06-24T22:30:00.748836784Z [2024-06-24 22:30:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98584603-f4d6-43a9-89be-44eec5fc6357] received 2024-06-24T22:30:00.760198742Z [2024-06-24 22:30:00,759: INFO/ForkPoolWorker-15] [98584603-f4d6-43a9-89be-44eec5fc6357] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-24T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:30:00.790985324Z [2024-06-24 22:30:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f260582a-7394-425d-bc3b-3691bb5b9ddd] received 2024-06-24T22:30:00.806586023Z [2024-06-24 22:30:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee85a4a4-dbcb-42f5-a2f5-e6dd14a74fef] received 2024-06-24T22:30:00.814494984Z [2024-06-24 22:30:00,814: INFO/ForkPoolWorker-16] [f260582a-7394-425d-bc3b-3691bb5b9ddd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:30:00.825371592Z [2024-06-24 22:30:00,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34d18ee9-bbbd-48ce-b7d3-e2737f2dd1d9] received 2024-06-24T22:30:00.826757978Z [2024-06-24 22:30:00,825: INFO/ForkPoolWorker-1] [ee85a4a4-dbcb-42f5-a2f5-e6dd14a74fef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:30:00.874117217Z [2024-06-24 22:30:00,873: INFO/ForkPoolWorker-2] [34d18ee9-bbbd-48ce-b7d3-e2737f2dd1d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:30:01.279721215Z [2024-06-24 22:30:01,274: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:30:01.318055961Z [2024-06-24 22:30:01,313: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:30:01.492412049Z [2024-06-24 22:30:01,487: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:30:01.613442367Z [2024-06-24 22:30:01,613: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:30:01.954886249Z [2024-06-24 22:30:01,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:30:02.548954625Z [2024-06-24 22:30:02,548: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f260582a-7394-425d-bc3b-3691bb5b9ddd] succeeded in 1.7502551920001679s: None 2024-06-24T22:30:03.643867787Z [2024-06-24 22:30:03,643: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-24T22:30:03.652144970Z [2024-06-24 22:30:03,649: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:30:03.712768742Z [2024-06-24 22:30:03,712: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-24T22:30:03.721165621Z [2024-06-24 22:30:03,720: INFO/ForkPoolWorker-2] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:30:03.721339979Z [2024-06-24 22:30:03,721: INFO/ForkPoolWorker-2] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:30:03.721569075Z [2024-06-24 22:30:03,721: INFO/ForkPoolWorker-2] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:30:03.721874590Z [2024-06-24 22:30:03,721: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-24T22:30:03.722232952Z [2024-06-24 22:30:03,722: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:30:03.722388514Z [2024-06-24 22:30:03,722: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:30:03.804878009Z [2024-06-24 22:30:03,804: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:30:03.808924173Z [2024-06-24 22:30:03,808: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:30:03.810520165Z [2024-06-24 22:30:03,810: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:30:03.876563140Z [2024-06-24 22:30:03,876: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:30:03.879219105Z [2024-06-24 22:30:03,878: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:30:03.879360102Z [2024-06-24 22:30:03,879: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:30:03.879610189Z [2024-06-24 22:30:03,879: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:30:03.879850091Z [2024-06-24 22:30:03,879: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:30:03.880403900Z [2024-06-24 22:30:03,880: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:30:03.880515388Z [2024-06-24 22:30:03,880: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:30:04.014791183Z [2024-06-24 22:30:04,014: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:30:04.019875467Z [2024-06-24 22:30:04,019: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:30:04.064731836Z [2024-06-24 22:30:04,064: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:30:04.075641021Z [2024-06-24 22:30:04,075: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:30:04.077034778Z [2024-06-24 22:30:04,076: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:30:04.077083270Z [2024-06-24 22:30:04,076: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:30:04.077522718Z [2024-06-24 22:30:04,077: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:30:04.077642837Z [2024-06-24 22:30:04,077: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:30:04.077885828Z [2024-06-24 22:30:04,077: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:30:04.077889849Z [2024-06-24 22:30:04,077: INFO/ForkPoolWorker-1] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:30:04.213374782Z [2024-06-24 22:30:04,213: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:30:04.857054587Z [2024-06-24 22:30:04,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98584603-f4d6-43a9-89be-44eec5fc6357] succeeded in 4.1034649839998565s: None 2024-06-24T22:30:05.365536810Z [2024-06-24 22:30:05,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35ec45fa-5402-45fd-b9f7-7134d14410b6] received 2024-06-24T22:30:05.372005827Z [2024-06-24 22:30:05,371: INFO/ForkPoolWorker-15] [35ec45fa-5402-45fd-b9f7-7134d14410b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'split_metrics', 'scheduled__2024-06-24T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:30:05.922026000Z [2024-06-24 22:30:05,921: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ee85a4a4-dbcb-42f5-a2f5-e6dd14a74fef] succeeded in 5.11190180299991s: None 2024-06-24T22:30:05.975702129Z [2024-06-24 22:30:05,970: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:30:06.007331955Z [2024-06-24 22:30:06,006: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[34d18ee9-bbbd-48ce-b7d3-e2737f2dd1d9] succeeded in 5.174415499000133s: None 2024-06-24T22:30:07.622410457Z [2024-06-24 22:30:07,621: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:30:07.626125224Z [2024-06-24 22:30:07,625: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:30:07.710495617Z [2024-06-24 22:30:07,710: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:30:07.712076731Z [2024-06-24 22:30:07,711: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:30:07.712986269Z [2024-06-24 22:30:07,711: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:30:07.713308033Z [2024-06-24 22:30:07,713: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:30:07.713496960Z [2024-06-24 22:30:07,713: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:30:07.713797403Z [2024-06-24 22:30:07,713: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:30:07.713967899Z [2024-06-24 22:30:07,713: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:30:07.818075357Z [2024-06-24 22:30:07,817: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:30:08.603359791Z [2024-06-24 22:30:08,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35ec45fa-5402-45fd-b9f7-7134d14410b6] succeeded in 3.2361710779998702s: None 2024-06-24T22:30:09.359194074Z [2024-06-24 22:30:09,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce01088a-53d9-4c01-8474-5bb03dafff6d] received 2024-06-24T22:30:09.367349656Z [2024-06-24 22:30:09,367: INFO/ForkPoolWorker-15] [ce01088a-53d9-4c01-8474-5bb03dafff6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'collect_metrics', 'scheduled__2024-06-24T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-24T22:30:09.718364228Z [2024-06-24 22:30:09,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:30:11.073359371Z [2024-06-24 22:30:11,073: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:30:11.077069733Z [2024-06-24 22:30:11,076: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:30:11.117725201Z [2024-06-24 22:30:11,117: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:30:11.120709931Z [2024-06-24 22:30:11,120: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:30:11.120788074Z [2024-06-24 22:30:11,120: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:30:11.121011537Z [2024-06-24 22:30:11,120: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:30:11.121647718Z [2024-06-24 22:30:11,120: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:30:11.122463048Z [2024-06-24 22:30:11,122: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:30:11.122627548Z [2024-06-24 22:30:11,122: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:30:11.231340366Z [2024-06-24 22:30:11,231: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:30:13.077759470Z [2024-06-24 22:30:13,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61100f22-d974-4909-9bf5-1504370ab8ca] received 2024-06-24T22:30:13.082651257Z [2024-06-24 22:30:13,082: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce01088a-53d9-4c01-8474-5bb03dafff6d] succeeded in 3.7216047060001074s: None 2024-06-24T22:30:13.096144258Z [2024-06-24 22:30:13,095: INFO/ForkPoolWorker-16] [61100f22-d974-4909-9bf5-1504370ab8ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'send_prometheus', 'scheduled__2024-06-24T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:30:13.647119761Z [2024-06-24 22:30:13,643: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:30:15.105289970Z [2024-06-24 22:30:15,104: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:30:15.109547915Z [2024-06-24 22:30:15,109: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:30:15.139257198Z [2024-06-24 22:30:15,139: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:30:15.141524303Z [2024-06-24 22:30:15,141: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:30:15.142496514Z [2024-06-24 22:30:15,142: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:30:15.142935443Z [2024-06-24 22:30:15,142: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:30:15.143424902Z [2024-06-24 22:30:15,143: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:30:15.144670152Z [2024-06-24 22:30:15,144: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:30:15.144877571Z [2024-06-24 22:30:15,144: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:30:15.251091452Z [2024-06-24 22:30:15,250: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:30:15.872527665Z [2024-06-24 22:30:15,872: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61100f22-d974-4909-9bf5-1504370ab8ca] succeeded in 2.794352522000054s: None 2024-06-24T22:31:01.201982674Z [2024-06-24 22:31:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04722705-cc60-4724-8dca-28e7f113c20a] received 2024-06-24T22:31:01.213735259Z [2024-06-24 22:31:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2beae782-ef03-429e-a4bd-c22e504ab24b] received 2024-06-24T22:31:01.214232694Z [2024-06-24 22:31:01,213: INFO/ForkPoolWorker-15] [04722705-cc60-4724-8dca-28e7f113c20a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:31:01.275177563Z [2024-06-24 22:31:01,274: INFO/ForkPoolWorker-16] [2beae782-ef03-429e-a4bd-c22e504ab24b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:31:01.643895883Z [2024-06-24 22:31:01,639: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:31:01.830723908Z [2024-06-24 22:31:01,826: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:31:03.483788569Z [2024-06-24 22:31:03,482: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:31:03.488880916Z [2024-06-24 22:31:03,488: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:31:03.545549754Z [2024-06-24 22:31:03,545: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:31:03.548004047Z [2024-06-24 22:31:03,547: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:31:03.548153516Z [2024-06-24 22:31:03,547: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:31:03.549463111Z [2024-06-24 22:31:03,548: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:31:03.549475552Z [2024-06-24 22:31:03,548: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:31:03.549480596Z [2024-06-24 22:31:03,549: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:31:03.549483782Z [2024-06-24 22:31:03,549: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:31:03.611884187Z [2024-06-24 22:31:03,611: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:31:03.615877167Z [2024-06-24 22:31:03,615: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:31:03.648207482Z [2024-06-24 22:31:03,647: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:31:03.649363929Z [2024-06-24 22:31:03,649: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:31:03.649384225Z [2024-06-24 22:31:03,649: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:31:03.649511602Z [2024-06-24 22:31:03,649: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:31:03.649548650Z [2024-06-24 22:31:03,649: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:31:03.649795012Z [2024-06-24 22:31:03,649: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:31:03.649902675Z [2024-06-24 22:31:03,649: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:31:03.687000371Z [2024-06-24 22:31:03,686: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:31:03.749381032Z [2024-06-24 22:31:03,749: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:31:05.617685701Z [2024-06-24 22:31:05,616: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2beae782-ef03-429e-a4bd-c22e504ab24b] succeeded in 4.399544049000042s: None 2024-06-24T22:31:05.864194290Z [2024-06-24 22:31:05,863: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[04722705-cc60-4724-8dca-28e7f113c20a] succeeded in 4.6590893759998835s: None 2024-06-24T22:32:00.853837522Z [2024-06-24 22:32:00,853: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe87268a-9800-4ef4-8ddd-ce61a85ddca1] received 2024-06-24T22:32:00.886240349Z [2024-06-24 22:32:00,885: INFO/ForkPoolWorker-15] [fe87268a-9800-4ef4-8ddd-ce61a85ddca1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:32:00.888906634Z [2024-06-24 22:32:00,888: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed4db64d-c99d-4b34-8c67-16eeb2669df6] received 2024-06-24T22:32:00.906267374Z [2024-06-24 22:32:00,905: INFO/ForkPoolWorker-16] [ed4db64d-c99d-4b34-8c67-16eeb2669df6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:32:00.954821121Z [2024-06-24 22:32:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8b95bc9-cdad-494b-8fc8-e89d8b53eb01] received 2024-06-24T22:32:01.005405505Z [2024-06-24 22:32:01,005: INFO/ForkPoolWorker-1] [e8b95bc9-cdad-494b-8fc8-e89d8b53eb01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:32:01.433952187Z [2024-06-24 22:32:01,430: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:32:01.545239979Z [2024-06-24 22:32:01,541: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:32:01.726908500Z [2024-06-24 22:32:01,721: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:32:01.959347671Z [2024-06-24 22:32:01,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:32:02.657582419Z [2024-06-24 22:32:02,657: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe87268a-9800-4ef4-8ddd-ce61a85ddca1] succeeded in 1.7900897070001065s: None 2024-06-24T22:32:03.085841371Z [2024-06-24 22:32:03,085: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:32:03.089781204Z [2024-06-24 22:32:03,089: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:32:03.121550304Z [2024-06-24 22:32:03,121: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:32:03.123028626Z [2024-06-24 22:32:03,122: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:32:03.123091719Z [2024-06-24 22:32:03,122: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:32:03.123297748Z [2024-06-24 22:32:03,123: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:32:03.123350806Z [2024-06-24 22:32:03,123: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:32:03.123629865Z [2024-06-24 22:32:03,123: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:32:03.123873659Z [2024-06-24 22:32:03,123: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:32:03.217724824Z [2024-06-24 22:32:03,217: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:32:03.223960485Z [2024-06-24 22:32:03,223: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:32:03.228119540Z [2024-06-24 22:32:03,227: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:32:03.270162768Z [2024-06-24 22:32:03,269: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:32:03.271313503Z [2024-06-24 22:32:03,271: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:32:03.271457618Z [2024-06-24 22:32:03,271: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:32:03.271655590Z [2024-06-24 22:32:03,271: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:32:03.271820256Z [2024-06-24 22:32:03,271: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:32:03.272172536Z [2024-06-24 22:32:03,272: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:32:03.272525079Z [2024-06-24 22:32:03,272: INFO/ForkPoolWorker-1] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:32:03.355780758Z [2024-06-24 22:32:03,355: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:32:05.457730619Z [2024-06-24 22:32:05,457: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e8b95bc9-cdad-494b-8fc8-e89d8b53eb01] succeeded in 4.498425746000066s: None 2024-06-24T22:32:05.565955815Z [2024-06-24 22:32:05,565: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed4db64d-c99d-4b34-8c67-16eeb2669df6] succeeded in 4.6750638809999145s: None 2024-06-24T22:33:00.698146514Z [2024-06-24 22:33:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6743df6-ccdb-43f9-a31e-ce3eb80c4038] received 2024-06-24T22:33:00.711413987Z [2024-06-24 22:33:00,711: INFO/ForkPoolWorker-15] [a6743df6-ccdb-43f9-a31e-ce3eb80c4038] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:33:00.717568532Z [2024-06-24 22:33:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7325bb8-c20b-4a6d-b42e-529dd34d2353] received 2024-06-24T22:33:00.741400321Z [2024-06-24 22:33:00,741: INFO/ForkPoolWorker-16] [e7325bb8-c20b-4a6d-b42e-529dd34d2353] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:33:01.325078296Z [2024-06-24 22:33:01,321: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:33:01.402690624Z [2024-06-24 22:33:01,398: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:33:02.756213091Z [2024-06-24 22:33:02,755: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:33:02.759698602Z [2024-06-24 22:33:02,759: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:33:02.787394670Z [2024-06-24 22:33:02,787: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:33:02.789049382Z [2024-06-24 22:33:02,788: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:33:02.789335445Z [2024-06-24 22:33:02,789: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:33:02.789473239Z [2024-06-24 22:33:02,789: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:33:02.789618293Z [2024-06-24 22:33:02,789: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:33:02.790389206Z [2024-06-24 22:33:02,790: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:33:02.790965803Z [2024-06-24 22:33:02,790: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:33:02.792961222Z [2024-06-24 22:33:02,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:33:02.796324755Z [2024-06-24 22:33:02,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:33:02.835082120Z [2024-06-24 22:33:02,834: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:33:02.836102995Z [2024-06-24 22:33:02,835: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:33:02.836180721Z [2024-06-24 22:33:02,836: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:33:02.836350475Z [2024-06-24 22:33:02,836: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:33:02.836437435Z [2024-06-24 22:33:02,836: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:33:02.836694280Z [2024-06-24 22:33:02,836: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:33:02.836756118Z [2024-06-24 22:33:02,836: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:33:02.896370474Z [2024-06-24 22:33:02,896: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:33:02.927340579Z [2024-06-24 22:33:02,927: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:33:04.749150109Z [2024-06-24 22:33:04,748: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7325bb8-c20b-4a6d-b42e-529dd34d2353] succeeded in 4.0286810170000535s: None 2024-06-24T22:33:05.210814656Z [2024-06-24 22:33:05,210: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6743df6-ccdb-43f9-a31e-ce3eb80c4038] succeeded in 4.50856852600009s: None 2024-06-24T22:34:00.667801232Z [2024-06-24 22:34:00,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[938d4d9d-450e-468d-872a-a10020188536] received 2024-06-24T22:34:00.682675362Z [2024-06-24 22:34:00,682: INFO/ForkPoolWorker-15] [938d4d9d-450e-468d-872a-a10020188536] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:34:00.694787785Z [2024-06-24 22:34:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67fde7c6-793c-4e9b-a747-0d307edb7537] received 2024-06-24T22:34:00.717091776Z [2024-06-24 22:34:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc5f2143-ff89-4bf5-8e2a-11b20113496d] received 2024-06-24T22:34:00.743922668Z [2024-06-24 22:34:00,743: INFO/ForkPoolWorker-1] [bc5f2143-ff89-4bf5-8e2a-11b20113496d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:34:00.762941672Z [2024-06-24 22:34:00,761: INFO/ForkPoolWorker-16] [67fde7c6-793c-4e9b-a747-0d307edb7537] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:34:01.303706939Z [2024-06-24 22:34:01,292: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:34:01.503727194Z [2024-06-24 22:34:01,486: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:34:01.692312574Z [2024-06-24 22:34:01,692: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:34:01.779381252Z [2024-06-24 22:34:01,754: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:34:02.769628218Z [2024-06-24 22:34:02,769: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[938d4d9d-450e-468d-872a-a10020188536] succeeded in 2.0973011120001956s: None 2024-06-24T22:34:03.566457486Z [2024-06-24 22:34:03,566: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:34:03.576468121Z [2024-06-24 22:34:03,575: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:34:03.636272723Z [2024-06-24 22:34:03,636: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:34:03.638713254Z [2024-06-24 22:34:03,638: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:34:03.638830755Z [2024-06-24 22:34:03,638: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:34:03.639074291Z [2024-06-24 22:34:03,638: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:34:03.639209582Z [2024-06-24 22:34:03,639: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:34:03.639669674Z [2024-06-24 22:34:03,639: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:34:03.639833841Z [2024-06-24 22:34:03,639: INFO/ForkPoolWorker-1] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:34:03.652295698Z [2024-06-24 22:34:03,650: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:34:03.660313389Z [2024-06-24 22:34:03,659: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:34:03.718248247Z [2024-06-24 22:34:03,718: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:34:03.722303335Z [2024-06-24 22:34:03,722: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:34:03.722407831Z [2024-06-24 22:34:03,722: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:34:03.722585345Z [2024-06-24 22:34:03,722: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:34:03.722683743Z [2024-06-24 22:34:03,722: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:34:03.723034291Z [2024-06-24 22:34:03,722: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:34:03.723099423Z [2024-06-24 22:34:03,722: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:34:03.784981846Z [2024-06-24 22:34:03,784: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:34:03.847903579Z [2024-06-24 22:34:03,847: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:34:05.582010743Z [2024-06-24 22:34:05,581: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bc5f2143-ff89-4bf5-8e2a-11b20113496d] succeeded in 4.859395769999992s: None 2024-06-24T22:34:06.016571672Z [2024-06-24 22:34:06,016: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67fde7c6-793c-4e9b-a747-0d307edb7537] succeeded in 5.291009432999772s: None 2024-06-24T22:35:00.673313873Z [2024-06-24 22:35:00,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2825e083-5a42-4092-ab2a-c99b2108443b] received 2024-06-24T22:35:00.688947988Z [2024-06-24 22:35:00,688: INFO/ForkPoolWorker-15] [2825e083-5a42-4092-ab2a-c99b2108443b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-24T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:35:00.695938874Z [2024-06-24 22:35:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[304e20f9-3bb7-43e1-9469-17d9eb2fc14e] received 2024-06-24T22:35:00.703605016Z [2024-06-24 22:35:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85e39061-1f05-4829-a8ee-7ef5b0182119] received 2024-06-24T22:35:00.727315222Z [2024-06-24 22:35:00,727: INFO/ForkPoolWorker-16] [304e20f9-3bb7-43e1-9469-17d9eb2fc14e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:35:00.750625255Z [2024-06-24 22:35:00,750: INFO/ForkPoolWorker-1] [85e39061-1f05-4829-a8ee-7ef5b0182119] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:35:01.363991598Z [2024-06-24 22:35:01,342: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:35:01.518798506Z [2024-06-24 22:35:01,506: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:35:01.592434552Z [2024-06-24 22:35:01,588: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:35:03.464420528Z [2024-06-24 22:35:03,462: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:35:03.472147439Z [2024-06-24 22:35:03,468: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:35:03.525929112Z [2024-06-24 22:35:03,524: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:35:03.538508795Z [2024-06-24 22:35:03,526: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:35:03.538531307Z [2024-06-24 22:35:03,537: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:35:03.538547041Z [2024-06-24 22:35:03,537: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:35:03.538551789Z [2024-06-24 22:35:03,537: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:35:03.538554874Z [2024-06-24 22:35:03,537: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:35:03.538576715Z [2024-06-24 22:35:03,537: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:35:03.581110159Z [2024-06-24 22:35:03,580: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:35:03.586947681Z [2024-06-24 22:35:03,585: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:35:03.661493363Z [2024-06-24 22:35:03,661: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:35:03.666228018Z [2024-06-24 22:35:03,665: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:35:03.666399201Z [2024-06-24 22:35:03,666: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:35:03.667373218Z [2024-06-24 22:35:03,666: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:35:03.667409217Z [2024-06-24 22:35:03,667: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:35:03.668131958Z [2024-06-24 22:35:03,667: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:35:03.668883492Z [2024-06-24 22:35:03,668: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:35:03.678777703Z [2024-06-24 22:35:03,678: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:35:03.801126805Z [2024-06-24 22:35:03,800: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:35:03.972624019Z [2024-06-24 22:35:03,972: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:35:03.976845475Z [2024-06-24 22:35:03,976: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:35:04.032538561Z [2024-06-24 22:35:04,032: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:35:04.035623045Z [2024-06-24 22:35:04,035: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:35:04.035803138Z [2024-06-24 22:35:04,035: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:35:04.036681223Z [2024-06-24 22:35:04,036: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:35:04.037143264Z [2024-06-24 22:35:04,036: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:35:04.037697286Z [2024-06-24 22:35:04,037: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:35:04.038399621Z [2024-06-24 22:35:04,038: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:35:04.192199485Z [2024-06-24 22:35:04,191: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:35:04.501377138Z [2024-06-24 22:35:04,500: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2825e083-5a42-4092-ab2a-c99b2108443b] succeeded in 3.8232296529999985s: None 2024-06-24T22:35:04.645305418Z [2024-06-24 22:35:04,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfe16b0f-8a52-4d8a-b169-f3b8638331ba] received 2024-06-24T22:35:04.654082251Z [2024-06-24 22:35:04,652: INFO/ForkPoolWorker-15] [dfe16b0f-8a52-4d8a-b169-f3b8638331ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'split_metrics', 'scheduled__2024-06-24T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:35:05.078042313Z [2024-06-24 22:35:05,074: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:35:05.380079761Z [2024-06-24 22:35:05,379: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[304e20f9-3bb7-43e1-9469-17d9eb2fc14e] succeeded in 4.676568420999956s: None 2024-06-24T22:35:06.190159206Z [2024-06-24 22:35:06,189: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[85e39061-1f05-4829-a8ee-7ef5b0182119] succeeded in 5.476185306999923s: None 2024-06-24T22:35:06.521558164Z [2024-06-24 22:35:06,520: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:35:06.530176443Z [2024-06-24 22:35:06,525: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:35:06.598278298Z [2024-06-24 22:35:06,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:35:06.603770908Z [2024-06-24 22:35:06,598: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:35:06.603791418Z [2024-06-24 22:35:06,599: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:35:06.603796160Z [2024-06-24 22:35:06,599: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:35:06.603801378Z [2024-06-24 22:35:06,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:35:06.603805227Z [2024-06-24 22:35:06,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:35:06.603808743Z [2024-06-24 22:35:06,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:35:06.724485263Z [2024-06-24 22:35:06,724: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:35:07.307545840Z [2024-06-24 22:35:07,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d02a6a4-8293-4e31-b479-ec72ea13957b] received 2024-06-24T22:35:07.316957851Z [2024-06-24 22:35:07,316: INFO/ForkPoolWorker-16] [1d02a6a4-8293-4e31-b479-ec72ea13957b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'collect_metrics', 'scheduled__2024-06-24T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-24T22:35:07.456203767Z [2024-06-24 22:35:07,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfe16b0f-8a52-4d8a-b169-f3b8638331ba] succeeded in 2.809420308999961s: None 2024-06-24T22:35:07.710055410Z [2024-06-24 22:35:07,705: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:35:09.247395940Z [2024-06-24 22:35:09,246: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:35:09.250660226Z [2024-06-24 22:35:09,250: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:35:09.278084465Z [2024-06-24 22:35:09,277: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:35:09.280744649Z [2024-06-24 22:35:09,280: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:35:09.280776176Z [2024-06-24 22:35:09,280: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:35:09.280860333Z [2024-06-24 22:35:09,280: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:35:09.280898983Z [2024-06-24 22:35:09,280: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:35:09.281916140Z [2024-06-24 22:35:09,281: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:35:09.281933866Z [2024-06-24 22:35:09,281: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:35:09.401030377Z [2024-06-24 22:35:09,400: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:35:11.063495509Z [2024-06-24 22:35:11,063: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d02a6a4-8293-4e31-b479-ec72ea13957b] succeeded in 3.7530303250000543s: None 2024-06-24T22:35:11.713092233Z [2024-06-24 22:35:11,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ccdca10-d740-42af-b146-62e9f33afc75] received 2024-06-24T22:35:11.726274488Z [2024-06-24 22:35:11,726: INFO/ForkPoolWorker-15] [5ccdca10-d740-42af-b146-62e9f33afc75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'send_prometheus', 'scheduled__2024-06-24T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:35:12.112880194Z [2024-06-24 22:35:12,109: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:35:13.766628131Z [2024-06-24 22:35:13,766: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:35:13.770049025Z [2024-06-24 22:35:13,769: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:35:13.797464954Z [2024-06-24 22:35:13,797: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:35:13.798700412Z [2024-06-24 22:35:13,798: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:35:13.798858603Z [2024-06-24 22:35:13,798: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:35:13.799122949Z [2024-06-24 22:35:13,798: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:35:13.799246388Z [2024-06-24 22:35:13,799: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:35:13.799599154Z [2024-06-24 22:35:13,799: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:35:13.799777481Z [2024-06-24 22:35:13,799: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:35:13.881145265Z [2024-06-24 22:35:13,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:35:14.492526173Z [2024-06-24 22:35:14,492: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ccdca10-d740-42af-b146-62e9f33afc75] succeeded in 2.7746254040002896s: None 2024-06-24T22:36:01.024199042Z [2024-06-24 22:36:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba44041d-2e8c-4b1d-b6bc-bf7248d73a16] received 2024-06-24T22:36:01.046343988Z [2024-06-24 22:36:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da7e32bd-f9ae-47c0-b335-cb0d89a25be1] received 2024-06-24T22:36:01.049289299Z [2024-06-24 22:36:01,048: INFO/ForkPoolWorker-15] [ba44041d-2e8c-4b1d-b6bc-bf7248d73a16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:36:01.060502982Z [2024-06-24 22:36:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[791b00c2-3c47-4e71-88d3-c955389f1aa7] received 2024-06-24T22:36:01.061642384Z [2024-06-24 22:36:01,061: INFO/ForkPoolWorker-16] [da7e32bd-f9ae-47c0-b335-cb0d89a25be1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:36:01.120798538Z [2024-06-24 22:36:01,120: INFO/ForkPoolWorker-1] [791b00c2-3c47-4e71-88d3-c955389f1aa7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:36:01.561160657Z [2024-06-24 22:36:01,555: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:36:01.683309417Z [2024-06-24 22:36:01,677: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:36:01.883153650Z [2024-06-24 22:36:01,869: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:36:02.184441842Z [2024-06-24 22:36:02,184: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:36:03.041580774Z [2024-06-24 22:36:03,041: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[791b00c2-3c47-4e71-88d3-c955389f1aa7] succeeded in 1.9697631919998457s: None 2024-06-24T22:36:03.903719550Z [2024-06-24 22:36:03,903: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:36:03.907753329Z [2024-06-24 22:36:03,907: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:36:03.941356003Z [2024-06-24 22:36:03,938: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:36:03.946936405Z [2024-06-24 22:36:03,946: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:36:03.948725044Z [2024-06-24 22:36:03,948: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:36:03.951085838Z [2024-06-24 22:36:03,950: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:36:03.951268279Z [2024-06-24 22:36:03,951: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:36:03.951871777Z [2024-06-24 22:36:03,951: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:36:03.952149469Z [2024-06-24 22:36:03,952: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:36:03.952547876Z [2024-06-24 22:36:03,952: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:36:03.952624296Z [2024-06-24 22:36:03,952: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:36:03.993489004Z [2024-06-24 22:36:03,993: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:36:03.995209644Z [2024-06-24 22:36:03,994: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:36:03.995349803Z [2024-06-24 22:36:03,995: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:36:03.995861166Z [2024-06-24 22:36:03,995: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:36:03.996052349Z [2024-06-24 22:36:03,995: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:36:03.996484395Z [2024-06-24 22:36:03,996: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:36:03.997066667Z [2024-06-24 22:36:03,996: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:36:04.077942388Z [2024-06-24 22:36:04,077: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:36:04.149038427Z [2024-06-24 22:36:04,148: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:36:05.795702362Z [2024-06-24 22:36:05,795: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[da7e32bd-f9ae-47c0-b335-cb0d89a25be1] succeeded in 4.746332283999891s: None 2024-06-24T22:36:06.010741628Z [2024-06-24 22:36:06,009: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba44041d-2e8c-4b1d-b6bc-bf7248d73a16] succeeded in 4.979063370999938s: None 2024-06-24T22:37:01.356014281Z [2024-06-24 22:37:01,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f749181-5c45-4024-a40e-4a4762bd0dab] received 2024-06-24T22:37:01.373790579Z [2024-06-24 22:37:01,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63a6a633-57c6-4aa3-8b65-43dbe14f21a9] received 2024-06-24T22:37:01.378201705Z [2024-06-24 22:37:01,377: INFO/ForkPoolWorker-15] [3f749181-5c45-4024-a40e-4a4762bd0dab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:37:01.398523661Z [2024-06-24 22:37:01,398: INFO/ForkPoolWorker-16] [63a6a633-57c6-4aa3-8b65-43dbe14f21a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:37:01.808001525Z [2024-06-24 22:37:01,801: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:37:01.846623940Z [2024-06-24 22:37:01,842: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:37:03.176681191Z [2024-06-24 22:37:03,175: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:37:03.188844342Z [2024-06-24 22:37:03,188: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:37:03.236844134Z [2024-06-24 22:37:03,235: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:37:03.244626932Z [2024-06-24 22:37:03,244: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:37:03.245395769Z [2024-06-24 22:37:03,245: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:37:03.245569476Z [2024-06-24 22:37:03,245: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:37:03.245684148Z [2024-06-24 22:37:03,245: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:37:03.246062013Z [2024-06-24 22:37:03,245: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:37:03.246356329Z [2024-06-24 22:37:03,246: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:37:03.258626830Z [2024-06-24 22:37:03,258: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:37:03.262142903Z [2024-06-24 22:37:03,261: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:37:03.288119675Z [2024-06-24 22:37:03,287: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:37:03.290229881Z [2024-06-24 22:37:03,290: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:37:03.290328923Z [2024-06-24 22:37:03,290: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:37:03.290613985Z [2024-06-24 22:37:03,290: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:37:03.290686405Z [2024-06-24 22:37:03,290: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:37:03.291234952Z [2024-06-24 22:37:03,291: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:37:03.291312075Z [2024-06-24 22:37:03,291: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:37:03.370968613Z [2024-06-24 22:37:03,370: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:37:03.400984758Z [2024-06-24 22:37:03,400: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:37:05.357932099Z [2024-06-24 22:37:05,357: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63a6a633-57c6-4aa3-8b65-43dbe14f21a9] succeeded in 3.9800254020001375s: None 2024-06-24T22:37:05.845284779Z [2024-06-24 22:37:05,844: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f749181-5c45-4024-a40e-4a4762bd0dab] succeeded in 4.487039309000011s: None 2024-06-24T22:37:08.802006027Z [2024-06-24 22:37:08,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c602eb3-e742-4409-a3f1-700b408cf418] received 2024-06-24T22:37:08.810170321Z [2024-06-24 22:37:08,809: INFO/ForkPoolWorker-15] [6c602eb3-e742-4409-a3f1-700b408cf418] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240624223708_068477', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-24T22:37:09.204440699Z [2024-06-24 22:37:09,201: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-06-24T22:37:09.598088138Z [2024-06-24 22:37:09,597: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:37:10.307127251Z [2024-06-24 22:37:10,306: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c602eb3-e742-4409-a3f1-700b408cf418] succeeded in 1.5028015449997838s: None 2024-06-24T22:38:00.645950743Z [2024-06-24 22:38:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e4a6e87-3867-4547-8232-c6fcbae0729d] received 2024-06-24T22:38:00.669320309Z [2024-06-24 22:38:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea42a990-7ca4-4c6c-b4c8-68db4c0c9625] received 2024-06-24T22:38:00.692624875Z [2024-06-24 22:38:00,689: INFO/ForkPoolWorker-16] [ea42a990-7ca4-4c6c-b4c8-68db4c0c9625] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:38:00.693463133Z [2024-06-24 22:38:00,693: INFO/ForkPoolWorker-15] [8e4a6e87-3867-4547-8232-c6fcbae0729d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:38:00.830087740Z [2024-06-24 22:38:00,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bb1839e-d910-4159-9168-391e75bfa6c9] received 2024-06-24T22:38:00.858150023Z [2024-06-24 22:38:00,857: INFO/ForkPoolWorker-1] [2bb1839e-d910-4159-9168-391e75bfa6c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:38:01.423834198Z [2024-06-24 22:38:01,419: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:38:01.680984865Z [2024-06-24 22:38:01,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:38:01.798863140Z [2024-06-24 22:38:01,798: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:38:01.982239854Z [2024-06-24 22:38:01,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:38:02.707466256Z [2024-06-24 22:38:02,707: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e4a6e87-3867-4547-8232-c6fcbae0729d] succeeded in 2.0543028870001763s: None 2024-06-24T22:38:04.281753869Z [2024-06-24 22:38:04,281: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:38:04.286972172Z [2024-06-24 22:38:04,286: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:38:04.328020188Z [2024-06-24 22:38:04,327: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:38:04.332614621Z [2024-06-24 22:38:04,332: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:38:04.332715938Z [2024-06-24 22:38:04,332: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:38:04.333446831Z [2024-06-24 22:38:04,333: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:38:04.334679047Z [2024-06-24 22:38:04,334: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:38:04.336738125Z [2024-06-24 22:38:04,336: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:38:04.344526625Z [2024-06-24 22:38:04,336: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:38:04.532395921Z [2024-06-24 22:38:04,532: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:38:04.633680768Z [2024-06-24 22:38:04,633: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:38:04.637187687Z [2024-06-24 22:38:04,636: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:38:04.702329371Z [2024-06-24 22:38:04,702: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:38:04.703575835Z [2024-06-24 22:38:04,703: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:38:04.703737426Z [2024-06-24 22:38:04,703: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:38:04.703888459Z [2024-06-24 22:38:04,703: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:38:04.703962536Z [2024-06-24 22:38:04,703: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:38:04.704592339Z [2024-06-24 22:38:04,704: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:38:04.704726709Z [2024-06-24 22:38:04,704: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:38:04.824208847Z [2024-06-24 22:38:04,823: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:38:06.346345464Z [2024-06-24 22:38:06,345: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ea42a990-7ca4-4c6c-b4c8-68db4c0c9625] succeeded in 5.674237127000197s: None 2024-06-24T22:38:06.794367805Z [2024-06-24 22:38:06,794: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2bb1839e-d910-4159-9168-391e75bfa6c9] succeeded in 5.954398889999993s: None 2024-06-24T22:39:00.420000632Z [2024-06-24 22:39:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51a453af-8285-4f31-9633-95a2cec54933] received 2024-06-24T22:39:00.431753101Z [2024-06-24 22:39:00,431: INFO/ForkPoolWorker-15] [51a453af-8285-4f31-9633-95a2cec54933] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:39:00.454297885Z [2024-06-24 22:39:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d6642eb-de26-478b-9087-c7e3d2ff6393] received 2024-06-24T22:39:00.492101841Z [2024-06-24 22:39:00,491: INFO/ForkPoolWorker-16] [3d6642eb-de26-478b-9087-c7e3d2ff6393] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:39:00.960753760Z [2024-06-24 22:39:00,957: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:39:01.007958480Z [2024-06-24 22:39:00,999: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:39:02.377825822Z [2024-06-24 22:39:02,377: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-24T22:39:02.383013146Z [2024-06-24 22:39:02,382: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:39:02.443022212Z [2024-06-24 22:39:02,442: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-24T22:39:02.446335593Z [2024-06-24 22:39:02,446: INFO/ForkPoolWorker-16] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:39:02.446517626Z [2024-06-24 22:39:02,446: INFO/ForkPoolWorker-16] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:39:02.446680798Z [2024-06-24 22:39:02,446: INFO/ForkPoolWorker-16] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:39:02.446834908Z [2024-06-24 22:39:02,446: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-24T22:39:02.447722577Z [2024-06-24 22:39:02,447: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:39:02.449226615Z [2024-06-24 22:39:02,447: INFO/ForkPoolWorker-16] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:39:02.526311933Z [2024-06-24 22:39:02,525: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:39:02.529967647Z [2024-06-24 22:39:02,529: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:39:02.573100799Z [2024-06-24 22:39:02,572: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:39:02.575161443Z [2024-06-24 22:39:02,574: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:39:02.575336869Z [2024-06-24 22:39:02,575: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:39:02.575536064Z [2024-06-24 22:39:02,575: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:39:02.575661041Z [2024-06-24 22:39:02,575: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:39:02.575989040Z [2024-06-24 22:39:02,575: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:39:02.576124381Z [2024-06-24 22:39:02,576: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:39:02.580711516Z [2024-06-24 22:39:02,580: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:39:02.661258788Z [2024-06-24 22:39:02,661: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:39:04.449803550Z [2024-06-24 22:39:04,449: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d6642eb-de26-478b-9087-c7e3d2ff6393] succeeded in 3.9914616119999664s: None 2024-06-24T22:39:05.277708796Z [2024-06-24 22:39:05,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51a453af-8285-4f31-9633-95a2cec54933] succeeded in 4.855763886000204s: None 2024-06-24T22:40:00.666499450Z [2024-06-24 22:40:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[530670ef-e9a2-4d9a-92c8-70609ba5d04c] received 2024-06-24T22:40:00.682417987Z [2024-06-24 22:40:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c66315ae-5509-4f3e-8e31-5337f5989ed3] received 2024-06-24T22:40:00.687179223Z [2024-06-24 22:40:00,686: INFO/ForkPoolWorker-15] [530670ef-e9a2-4d9a-92c8-70609ba5d04c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-24T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:40:00.701607438Z [2024-06-24 22:40:00,700: INFO/ForkPoolWorker-16] [c66315ae-5509-4f3e-8e31-5337f5989ed3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-24T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-24T22:40:00.717307726Z [2024-06-24 22:40:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b7342a8-7b85-4208-be3a-e6ebf038b61a] received 2024-06-24T22:40:00.725054401Z [2024-06-24 22:40:00,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[823489b4-8b8b-4461-9bd9-b040029fd66e] received 2024-06-24T22:40:00.773649626Z [2024-06-24 22:40:00,773: INFO/ForkPoolWorker-1] [3b7342a8-7b85-4208-be3a-e6ebf038b61a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-24T22:40:00.776278757Z [2024-06-24 22:40:00,775: INFO/ForkPoolWorker-2] [823489b4-8b8b-4461-9bd9-b040029fd66e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-24T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-24T22:40:01.667326619Z [2024-06-24 22:40:01,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:40:01.753707613Z [2024-06-24 22:40:01,747: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-24T22:40:02.085239854Z [2024-06-24 22:40:02,074: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-24T22:40:02.132240280Z [2024-06-24 22:40:02,106: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-24T22:40:02.689872418Z [2024-06-24 22:40:02,689: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:40:03.568201777Z [2024-06-24 22:40:03,567: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:40:03.572488888Z [2024-06-24 22:40:03,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:40:03.633677652Z [2024-06-24 22:40:03,633: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c66315ae-5509-4f3e-8e31-5337f5989ed3] succeeded in 2.946606220999911s: None 2024-06-24T22:40:03.683342353Z [2024-06-24 22:40:03,683: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:40:03.684983138Z [2024-06-24 22:40:03,684: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:40:03.685027081Z [2024-06-24 22:40:03,684: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:40:03.685343052Z [2024-06-24 22:40:03,685: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:40:03.685402922Z [2024-06-24 22:40:03,685: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:40:03.688099386Z [2024-06-24 22:40:03,685: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:40:03.688110701Z [2024-06-24 22:40:03,685: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:40:03.814668941Z [2024-06-24 22:40:03,814: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:40:04.280299684Z [2024-06-24 22:40:04,279: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-24T22:40:04.284554699Z [2024-06-24 22:40:04,284: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:40:04.309642687Z [2024-06-24 22:40:04,309: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-24T22:40:04.320853011Z [2024-06-24 22:40:04,320: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:40:04.372942151Z [2024-06-24 22:40:04,372: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-24T22:40:04.374677198Z [2024-06-24 22:40:04,374: INFO/ForkPoolWorker-2] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:40:04.374689053Z [2024-06-24 22:40:04,374: INFO/ForkPoolWorker-2] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:40:04.374803368Z [2024-06-24 22:40:04,374: INFO/ForkPoolWorker-2] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:40:04.374812402Z [2024-06-24 22:40:04,374: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-24T22:40:04.376404874Z [2024-06-24 22:40:04,375: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-24T22:40:04.376417248Z [2024-06-24 22:40:04,376: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:40:04.377919010Z [2024-06-24 22:40:04,377: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-24T22:40:04.379773629Z [2024-06-24 22:40:04,379: INFO/ForkPoolWorker-1] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:40:04.380088896Z [2024-06-24 22:40:04,379: INFO/ForkPoolWorker-1] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:40:04.380525971Z [2024-06-24 22:40:04,380: INFO/ForkPoolWorker-1] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:40:04.380736296Z [2024-06-24 22:40:04,380: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-24T22:40:04.381550321Z [2024-06-24 22:40:04,381: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-24T22:40:04.381781353Z [2024-06-24 22:40:04,381: INFO/ForkPoolWorker-1] Creating DAG vim_status_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:40:04.488869029Z [2024-06-24 22:40:04,488: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:40:04.498811012Z [2024-06-24 22:40:04,498: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:40:04.545496837Z [2024-06-24 22:40:04,541: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[530670ef-e9a2-4d9a-92c8-70609ba5d04c] succeeded in 3.8708873560003667s: None 2024-06-24T22:40:05.503633772Z [2024-06-24 22:40:05,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30817a90-b3de-42d6-ab5e-b1a096745cae] received 2024-06-24T22:40:05.522800501Z [2024-06-24 22:40:05,522: INFO/ForkPoolWorker-15] [30817a90-b3de-42d6-ab5e-b1a096745cae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'split_metrics', 'scheduled__2024-06-24T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:40:05.906859488Z [2024-06-24 22:40:05,902: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:40:06.326346927Z [2024-06-24 22:40:06,325: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3b7342a8-7b85-4208-be3a-e6ebf038b61a] succeeded in 5.604027135000251s: None 2024-06-24T22:40:06.840415235Z [2024-06-24 22:40:06,840: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[823489b4-8b8b-4461-9bd9-b040029fd66e] succeeded in 6.1089211580001574s: None 2024-06-24T22:40:07.600681187Z [2024-06-24 22:40:07,600: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:40:07.607361394Z [2024-06-24 22:40:07,606: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:40:07.700972975Z [2024-06-24 22:40:07,700: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:40:07.702443169Z [2024-06-24 22:40:07,702: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:40:07.702509680Z [2024-06-24 22:40:07,702: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:40:07.702626652Z [2024-06-24 22:40:07,702: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:40:07.702670243Z [2024-06-24 22:40:07,702: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:40:07.703152656Z [2024-06-24 22:40:07,703: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:40:07.703197025Z [2024-06-24 22:40:07,703: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:40:07.827645718Z [2024-06-24 22:40:07,827: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:40:08.648788136Z [2024-06-24 22:40:08,648: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[30817a90-b3de-42d6-ab5e-b1a096745cae] succeeded in 3.1420685709999816s: None 2024-06-24T22:40:09.397532759Z [2024-06-24 22:40:09,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ede1ce7-98b9-4264-8e70-d358b6f2fc0d] received 2024-06-24T22:40:09.405196108Z [2024-06-24 22:40:09,404: INFO/ForkPoolWorker-15] [1ede1ce7-98b9-4264-8e70-d358b6f2fc0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'collect_metrics', 'scheduled__2024-06-24T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-24T22:40:09.723310962Z [2024-06-24 22:40:09,719: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:40:11.257383087Z [2024-06-24 22:40:11,257: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:40:11.260934906Z [2024-06-24 22:40:11,260: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:40:11.301216999Z [2024-06-24 22:40:11,300: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:40:11.304083849Z [2024-06-24 22:40:11,303: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:40:11.304123671Z [2024-06-24 22:40:11,304: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:40:11.304204727Z [2024-06-24 22:40:11,304: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:40:11.304279358Z [2024-06-24 22:40:11,304: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:40:11.304682432Z [2024-06-24 22:40:11,304: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:40:11.304704400Z [2024-06-24 22:40:11,304: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:40:11.430691726Z [2024-06-24 22:40:11,430: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:40:13.607106632Z [2024-06-24 22:40:13,606: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ede1ce7-98b9-4264-8e70-d358b6f2fc0d] succeeded in 4.207951200000025s: None 2024-06-24T22:40:14.514977061Z [2024-06-24 22:40:14,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62eca025-ae30-41a5-8500-462443d5d120] received 2024-06-24T22:40:14.522523746Z [2024-06-24 22:40:14,522: INFO/ForkPoolWorker-15] [62eca025-ae30-41a5-8500-462443d5d120] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'send_prometheus', 'scheduled__2024-06-24T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-24T22:40:14.956398895Z [2024-06-24 22:40:14,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-24T22:40:16.374467702Z [2024-06-24 22:40:16,374: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-24T22:40:16.380672276Z [2024-06-24 22:40:16,380: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'aQp0tUXQ6nrVj02k8FPMwdYCXiu2wqGt'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-24T22:40:16.428560942Z [2024-06-24 22:40:16,428: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-24T22:40:16.442978535Z [2024-06-24 22:40:16,434: INFO/ForkPoolWorker-15] Read VIM 0b9bc573-cae2-4860-875c-6a993efab3fc (_system-osm-vim) 2024-06-24T22:40:16.442988975Z [2024-06-24 22:40:16,434: INFO/ForkPoolWorker-15] Read VIM f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f (osm) 2024-06-24T22:40:16.442992855Z [2024-06-24 22:40:16,434: INFO/ForkPoolWorker-15] [{'_id': '0b9bc573-cae2-4860-875c-6a993efab3fc', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-24T22:40:16.443054714Z [2024-06-24 22:40:16,434: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-24T22:40:16.443059840Z [2024-06-24 22:40:16,435: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-24T22:40:16.443063211Z [2024-06-24 22:40:16,435: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f5ee2d66-6137-4ded-a0fb-2d70bef0fd9f 2024-06-24T22:40:16.618488619Z [2024-06-24 22:40:16,618: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-24T22:40:17.235432041Z [2024-06-24 22:40:17,234: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62eca025-ae30-41a5-8500-462443d5d120] succeeded in 2.7177491769998596s: None 2024-06-24T22:08:57.800782228Z 2024-06-24T22:08:57.804462108Z Cleaning logs every 900 seconds 2024-06-24T22:08:57.804472079Z Trimming airflow logs to 15 days. 2024-06-24T22:15:00.843681115Z Trimming airflow logs to 15 days. 2024-06-24T22:15:01.888474074Z Trimming airflow logs to 15 days. 2024-06-24T22:30:00.938533314Z Trimming airflow logs to 15 days.